2024-09-21T13:21:46.580 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T13:21:46.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T13:21:46.690 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7914021 branch: wip-guits-main-2024-09-21-0842 description: orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} email: gabrioux@ibm.com first_in_suite: false job_id: '7914021' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-main-2024-09-21-0842 ceph: conf: client: debug ms: 1 global: mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - CEPHADM_STRAY_DAEMON log-only-match: - CEPHADM_ sha1: 441784946648ff53dd310293f9dd752afeeea72a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: cephadm-package install: ceph: flavor: default sha1: 441784946648ff53dd310293f9dd752afeeea72a extra_packages: - cephadm selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-guits-main-2024-09-21-0842 sha1: 441784946648ff53dd310293f9dd752afeeea72a owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 5896 sha1: 441784946648ff53dd310293f9dd752afeeea72a sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-21-0842 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 441784946648ff53dd310293f9dd752afeeea72a targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9VH02lxmsLvGhToDsGVepP5xA+WLV1KVS4VP+M2gqbU3vOTSZF+lQo+dx65YIZpfAqtq7PvNTSSr9pWue0Zog= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDhqzRLNW5L9TnRyLDnVJAcXYQcMT3Zx+ANWIN1MS9nNIb34uD40df+SBe5YQviKX+q2gUVQtKLSWJZs1zx5qQ= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install runc nvmetcli nvme-cli -y - sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf - sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_11:23:40 tube: smithi user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T13:21:46.690 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa; will attempt to use it 2024-09-21T13:21:46.691 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa/tasks 2024-09-21T13:21:46.691 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T13:21:46.692 INFO:teuthology.task.internal:Checking packages... 2024-09-21T13:21:46.711 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '441784946648ff53dd310293f9dd752afeeea72a' 2024-09-21T13:21:46.711 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T13:21:46.711 INFO:teuthology.packaging:ref: None 2024-09-21T13:21:46.711 INFO:teuthology.packaging:tag: None 2024-09-21T13:21:46.711 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-21-0842 2024-09-21T13:21:46.711 INFO:teuthology.packaging:sha1: 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T13:21:46.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-main-2024-09-21-0842 2024-09-21T13:21:46.850 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5104.g44178494 2024-09-21T13:21:46.853 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T13:21:46.860 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T13:21:46.860 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T13:21:46.877 INFO:teuthology.task.internal:Saving configuration 2024-09-21T13:21:46.888 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T13:21:46.909 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T13:21:46.931 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7914021', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 13:16:38.603060', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9VH02lxmsLvGhToDsGVepP5xA+WLV1KVS4VP+M2gqbU3vOTSZF+lQo+dx65YIZpfAqtq7PvNTSSr9pWue0Zog='} 2024-09-21T13:21:46.954 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7914021', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 13:16:38.604572', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDhqzRLNW5L9TnRyLDnVJAcXYQcMT3Zx+ANWIN1MS9nNIb34uD40df+SBe5YQviKX+q2gUVQtKLSWJZs1zx5qQ='} 2024-09-21T13:21:46.955 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T13:21:46.963 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-09-21T13:21:46.963 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-09-21T13:21:46.963 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T13:21:47.024 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc6be6b8280>, signals=[15]) 2024-09-21T13:21:47.024 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T13:21:47.032 INFO:teuthology.task.internal:Opening connections... 2024-09-21T13:21:47.032 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-21T13:21:47.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:21:47.108 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T13:21:47.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:21:47.183 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T13:21:47.191 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-21T13:21:47.209 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-21T13:21:47.209 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-21T13:21:47.267 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-09-21T13:21:47.267 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-09-21T13:21:47.267 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-09-21T13:21:47.267 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-09-21T13:21:47.267 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-09-21T13:21:47.267 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-09-21T13:21:47.267 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T13:21:47.267 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-09-21T13:21:47.267 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-09-21T13:21:47.267 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T13:21:47.268 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-09-21T13:21:47.268 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T13:21:47.268 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T13:21:47.268 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T13:21:47.268 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-21T13:21:47.294 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-21T13:21:47.311 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-21T13:21:47.311 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-21T13:21:47.369 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T13:21:47.370 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T13:21:47.370 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T13:21:47.370 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-21T13:21:47.393 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T13:21:47.407 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T13:21:47.421 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T13:21:47.421 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-21T13:21:47.424 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-21T13:21:47.440 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T13:21:47.451 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T13:21:47.451 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-21T13:21:47.480 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-21T13:21:47.507 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T13:21:47.564 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T13:21:47.593 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T13:21:47.594 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T13:21:47.594 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T13:21:47.594 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T13:21:47.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:21:47.611 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-21T13:21:47.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:21:47.611 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-21T13:21:47.668 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-09-21T13:21:47.668 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-503.el9.x86_64 2024-09-21T13:21:47.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-09-21T13:21:47.669 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-503.el9.x86_64 2024-09-21T13:21:47.670 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.14.0-503.el9.x86_64 2024-09-21T13:21:47.670 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum install -y kernel 2024-09-21T13:21:49.979 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-21T13:21:51.043 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.3 MB 00:01 2024-09-21T13:21:52.196 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-21T13:21:54.677 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 20 MB 00:02 2024-09-21T13:21:56.597 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-21T13:21:58.130 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 19 kB 00:00 2024-09-21T13:21:59.076 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T13:21:59.469 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-21T13:22:00.962 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-21T13:22:02.066 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T13:22:04.407 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-21T13:22:06.280 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T13:22:06.280 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T13:22:06.368 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:22:06.379 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:22:06.379 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout:Install 4 Packages 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:22:06.380 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 79 M 2024-09-21T13:22:06.381 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 126 M 2024-09-21T13:22:06.381 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:22:06.508 INFO:teuthology.orchestra.run.smithi162.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 345 kB/s | 36 kB 00:00 2024-09-21T13:22:06.892 INFO:teuthology.orchestra.run.smithi162.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-21T13:22:07.283 INFO:teuthology.orchestra.run.smithi162.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-21T13:22:07.600 INFO:teuthology.orchestra.run.smithi162.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-21T13:22:07.601 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:22:07.601 INFO:teuthology.orchestra.run.smithi162.stdout:Total 65 MB/s | 79 MB 00:01 2024-09-21T13:22:07.672 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T13:22:08.283 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:22:08.659 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:22:08.659 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:22:09.625 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:22:09.625 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:22:09.636 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T13:22:09.636 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T13:22:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:22:09.742 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:22:09.742 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-21T13:22:09.742 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:22:09.742 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:22:09.742 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T13:22:09.742 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-21T13:22:09.742 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T13:22:09.742 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T13:22:09.743 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T13:22:09.743 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:22:09.743 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:22:09.743 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:22:09.743 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-21T13:22:09.743 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:22:09.743 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 79 M 2024-09-21T13:22:09.743 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 126 M 2024-09-21T13:22:09.743 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:22:10.081 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 124 kB/s | 36 kB 00:00 2024-09-21T13:22:12.087 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:22:12.809 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T13:22:12.900 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T13:22:13.090 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.7 MB/s | 16 MB 00:03 2024-09-21T13:22:15.649 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T13:22:15.784 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T13:22:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T13:22:20.660 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:22:25.547 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:22:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 892 kB/s | 29 MB 00:32 2024-09-21T13:22:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 1.0 MB/s | 35 MB 00:33 2024-09-21T13:22:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:22:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:Total 2.3 MB/s | 79 MB 00:33 2024-09-21T13:22:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:22:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:22:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:22:45.455 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:22:45.455 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:22:48.020 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:22:48.690 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T13:22:48.778 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T13:22:51.531 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T13:22:51.664 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T13:22:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T13:22:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:23:02.001 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:23:04.255 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:23:04.299 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:23:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:23:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T13:23:04.676 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T13:23:04.676 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T13:23:05.490 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:23:05.490 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:23:05.490 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:23:05.490 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T13:23:05.490 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T13:23:05.490 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T13:23:05.491 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T13:23:05.491 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:23:05.491 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:23:05.862 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T13:23:05.946 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T13:23:05.946 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T13:23:05.946 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T13:23:05.946 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T13:23:05.946 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T13:23:05.946 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T13:23:05.947 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T13:23:05.947 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T13:23:06.006 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T13:23:06.006 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T13:23:06.006 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-09-21T13:23:06.038 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-09-21T13:23:06.038 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-09-21T13:23:06.038 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-09-21T13:23:06.038 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 82.el9 2024-09-21T13:23:06.038 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-09-21T13:23:06.038 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T13:23:06.038 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-09-21T13:23:06.038 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8274670 2024-09-21T13:23:06.038 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-09-21T13:23:06.038 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T13:23:06.038 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-09-21T13:23:06.039 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:23:06.040 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T13:23:06.040 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T13:23:06.040 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 5.14.0-508.el9.x86_64 2024-09-21T13:23:06.040 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T13:23:06.723 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-09-21T13:23:07.996 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T13:23:08.033 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-09-21T13:23:08.036 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-21T13:23:08.052 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.Wfmtu7sZ0s 2024-09-21T13:23:08.053 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Wfmtu7sZ0s 2024-09-21T13:23:08.122 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.Wfmtu7sZ0s 2024-09-21T13:23:08.260 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.Wfmtu7sZ0s is 6KB 2024-09-21T13:23:08.308 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.Wfmtu7sZ0s 2024-09-21T13:23:08.323 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T13:23:08.398 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T13:23:08.398 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T13:23:08.398 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T13:23:08.398 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T13:23:08.399 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T13:23:08.550 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-09-21T13:23:38.553 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T13:23:38.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T13:23:38.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:23:40.916 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:23:40.958 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:23:41.309 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:23:41.309 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T13:23:41.309 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T13:23:41.309 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T13:23:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T13:23:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:23:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:23:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T13:23:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T13:23:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T13:23:42.129 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T13:23:42.129 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:23:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:23:42.487 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T13:23:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T13:23:42.581 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T13:23:42.582 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T13:23:42.582 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T13:23:42.582 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T13:23:42.582 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T13:23:42.582 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T13:23:42.582 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T13:23:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T13:23:42.640 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T13:23:42.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-09-21T13:23:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 82.el9 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8274670 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T13:23:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-09-21T13:23:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-09-21T13:23:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T13:23:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-09-21T13:23:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-09-21T13:23:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:23:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T13:23:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T13:23:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T13:23:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-09-21T13:23:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:23:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T13:23:42.677 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T13:23:42.677 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-508.el9.x86_64 2024-09-21T13:23:42.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T13:23:43.353 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-21T13:23:44.671 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T13:23:44.711 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-21T13:23:44.713 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-21T13:23:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.uN2kmjjEec 2024-09-21T13:23:44.728 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uN2kmjjEec 2024-09-21T13:23:44.801 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.uN2kmjjEec 2024-09-21T13:23:44.941 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.uN2kmjjEec is 6KB 2024-09-21T13:23:44.961 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.uN2kmjjEec 2024-09-21T13:23:44.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T13:23:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T13:23:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T13:23:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T13:23:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T13:23:45.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T13:23:45.197 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-21T13:23:57.041 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-21T13:24:06.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T13:24:06.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:24:09.103 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-21T13:24:15.204 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T13:24:15.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-21T13:24:15.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:24:21.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T13:24:21.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:24:33.647 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-09-21T13:24:39.539 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-21T13:24:42.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-21T13:24:42.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:24:54.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T13:24:54.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:24:55.907 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-21T13:24:56.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T13:24:56.329 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T13:24:56.329 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-21T13:24:56.346 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-508.el9.x86_64 2024-09-21T13:24:56.346 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T13:24:56.346 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T13:24:56.346 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T13:24:57.347 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T13:24:57.347 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T13:24:57.448 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2024-09-21T13:24:57.494 DEBUG:teuthology.parallel:result is None 2024-09-21T13:25:42.653 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T13:25:54.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-21T13:25:54.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:25:54.967 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-21T13:25:55.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-21T13:25:55.321 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T13:25:55.321 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-21T13:25:55.339 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-508.el9.x86_64 2024-09-21T13:25:55.339 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T13:25:55.339 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T13:25:55.339 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T13:25:56.340 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T13:25:56.340 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T13:25:56.424 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2024-09-21T13:25:56.449 DEBUG:teuthology.parallel:result is None 2024-09-21T13:25:56.449 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T13:25:56.455 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T13:25:56.455 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T13:25:56.457 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T13:25:56.479 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T13:25:56.485 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T13:25:56.495 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T13:25:56.495 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T13:25:56.516 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T13:25:56.548 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T13:25:56.554 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T13:25:56.554 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T13:25:56.576 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T13:25:56.608 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T13:25:56.620 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T13:25:56.632 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T13:25:56.644 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T13:25:56.646 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T13:25:56.652 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T13:25:56.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T13:25:56.664 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T13:25:56.692 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T13:25:56.701 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T13:25:56.701 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T13:25:56.732 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T13:25:56.749 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T13:25:56.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T13:25:56.875 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T13:25:56.955 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T13:25:56.999 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:25:57.000 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T13:25:57.066 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T13:25:57.107 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T13:25:57.158 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T13:25:57.239 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T13:25:57.286 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:25:57.286 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T13:25:57.354 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-21T13:25:57.356 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-21T13:25:57.401 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T13:25:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T13:25:57.915 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T13:25:57.930 INFO:teuthology.task.internal:Starting timer... 2024-09-21T13:25:57.930 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T13:25:57.939 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T13:25:57.947 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T13:25:57.948 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-09-21T13:25:58.034 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-09-21T13:25:58.036 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-21T13:25:58.104 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-21T13:25:58.106 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T13:25:58.106 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-09-21T13:25:58.133 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-09-21T13:25:58.133 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-21T13:25:58.178 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-21T13:25:58.178 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-09-21T13:25:58.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T13:25:58.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:25:58.206 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T13:25:58.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:25:58.245 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T13:25:58.245 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-09-21T13:25:58.280 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-21T13:25:58.316 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T13:25:58.325 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T13:25:58.327 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T13:25:58.426 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T13:25:58.435 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T13:25:58.436 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T13:29:43.992 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-09-21T13:29:43.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-21T13:29:43.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:29:44.068 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-21T13:29:44.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-21T13:29:44.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T13:29:44.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:29:44.224 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-21T13:29:44.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T13:29:44.302 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T13:29:44.312 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T13:29:44.312 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T13:29:44.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T13:29:44.315 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T13:29:44.315 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T13:29:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T13:29:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T13:29:44.370 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T13:29:44.384 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T13:29:44.386 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-09-21T13:29:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-09-21T13:29:44.409 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-21T13:29:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T13:29:44.420 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-21T13:29:44.426 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T13:29:44.434 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T13:29:44.449 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T13:29:44.485 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-21T13:29:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T13:29:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-21T13:29:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:29:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:29:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:29:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:29:44.503 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-21T13:29:44.507 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T13:29:44.507 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-21T13:29:44.507 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:29:44.507 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:29:44.508 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:29:44.508 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:29:44.509 INFO:teuthology.run_tasks:Running task pexec... 2024-09-21T13:29:44.518 INFO:teuthology.task.pexec:Executing custom commands... 2024-09-21T13:29:44.518 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi002.front.sepia.ceph.com 2024-09-21T13:29:44.519 DEBUG:teuthology.orchestra.run.smithi002:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-21T13:29:44.519 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T13:29:44.519 DEBUG:teuthology.orchestra.run.smithi162:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-21T13:29:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:29:44.898 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:29:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:29:44.905 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-21T13:29:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:29:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:Removing: 2024-09-21T13:29:44.905 INFO:teuthology.orchestra.run.smithi002.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-21T13:29:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:Removing unused dependencies: 2024-09-21T13:29:44.906 INFO:teuthology.orchestra.run.smithi002.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-21T13:29:44.906 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:29:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:29:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:29:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:Remove 2 Packages 2024-09-21T13:29:44.906 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:29:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:Freed space: 5.5 M 2024-09-21T13:29:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:29:44.909 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:29:44.909 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-21T13:29:44.909 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:29:44.909 INFO:teuthology.orchestra.run.smithi162.stdout:Removing: 2024-09-21T13:29:44.909 INFO:teuthology.orchestra.run.smithi162.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-21T13:29:44.909 INFO:teuthology.orchestra.run.smithi162.stdout:Removing unused dependencies: 2024-09-21T13:29:44.910 INFO:teuthology.orchestra.run.smithi162.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-21T13:29:44.910 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:29:44.910 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:29:44.910 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:29:44.910 INFO:teuthology.orchestra.run.smithi162.stdout:Remove 2 Packages 2024-09-21T13:29:44.910 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:29:44.910 INFO:teuthology.orchestra.run.smithi162.stdout:Freed space: 5.5 M 2024-09-21T13:29:44.910 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:29:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:29:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:29:44.914 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:29:44.914 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:29:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:29:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:29:44.982 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:29:44.982 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:29:45.130 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:29:45.141 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:29:45.203 INFO:teuthology.orchestra.run.smithi162.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-21T13:29:45.228 INFO:teuthology.orchestra.run.smithi002.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-21T13:29:45.261 INFO:teuthology.orchestra.run.smithi162.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-21T13:29:45.290 INFO:teuthology.orchestra.run.smithi002.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-21T13:29:45.754 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-21T13:29:45.754 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-21T13:29:45.778 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-21T13:29:45.778 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-21T13:29:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-21T13:29:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:29:46.013 INFO:teuthology.orchestra.run.smithi162.stdout:Removed: 2024-09-21T13:29:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-21T13:29:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:29:46.013 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:29:46.060 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-21T13:29:46.060 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:29:46.060 INFO:teuthology.orchestra.run.smithi002.stdout:Removed: 2024-09-21T13:29:46.060 INFO:teuthology.orchestra.run.smithi002.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-21T13:29:46.060 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:29:46.060 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:29:46.870 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:47 ago on Sat 21 Sep 2024 01:28:59 PM UTC. 2024-09-21T13:29:46.885 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:44 ago on Sat 21 Sep 2024 01:29:02 PM UTC. 2024-09-21T13:29:47.008 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:29:47.009 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:29:47.009 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T13:29:47.009 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:29:47.009 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:29:47.009 INFO:teuthology.orchestra.run.smithi162.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-21T13:29:47.009 INFO:teuthology.orchestra.run.smithi162.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-21T13:29:47.009 INFO:teuthology.orchestra.run.smithi162.stdout: runc x86_64 4:1.1.13-4.el9 appstream 3.2 M 2024-09-21T13:29:47.009 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T13:29:47.010 INFO:teuthology.orchestra.run.smithi162.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-21T13:29:47.010 INFO:teuthology.orchestra.run.smithi162.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-21T13:29:47.010 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-21T13:29:47.010 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-21T13:29:47.010 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:29:47.010 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:29:47.010 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:29:47.010 INFO:teuthology.orchestra.run.smithi162.stdout:Install 7 Packages 2024-09-21T13:29:47.010 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:29:47.022 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 5.2 M 2024-09-21T13:29:47.022 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 19 M 2024-09-21T13:29:47.022 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:29:47.023 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:29:47.023 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:29:47.023 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout: runc x86_64 4:1.1.13-4.el9 appstream 3.2 M 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout:Install 7 Packages 2024-09-21T13:29:47.024 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:29:47.031 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 5.2 M 2024-09-21T13:29:47.031 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 19 M 2024-09-21T13:29:47.031 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:29:47.167 INFO:teuthology.orchestra.run.smithi162.stdout:(1/7): nvmetcli-0.7-3.el9.noarch.rpm 438 kB/s | 44 kB 00:00 2024-09-21T13:29:47.192 INFO:teuthology.orchestra.run.smithi162.stdout:(2/7): libnvme-1.9-3.el9.x86_64.rpm 835 kB/s | 106 kB 00:00 2024-09-21T13:29:47.193 INFO:teuthology.orchestra.run.smithi002.stdout:(1/7): nvmetcli-0.7-3.el9.noarch.rpm 473 kB/s | 44 kB 00:00 2024-09-21T13:29:47.226 INFO:teuthology.orchestra.run.smithi162.stdout:(3/7): python3-configshell-1.1.30-1.el9.noarch. 1.2 MB/s | 72 kB 00:00 2024-09-21T13:29:47.227 INFO:teuthology.orchestra.run.smithi002.stdout:(2/7): libnvme-1.9-3.el9.x86_64.rpm 831 kB/s | 106 kB 00:00 2024-09-21T13:29:47.251 INFO:teuthology.orchestra.run.smithi162.stdout:(4/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.4 MB/s | 84 kB 00:00 2024-09-21T13:29:47.252 INFO:teuthology.orchestra.run.smithi002.stdout:(3/7): python3-configshell-1.1.30-1.el9.noarch. 1.2 MB/s | 72 kB 00:00 2024-09-21T13:29:47.286 INFO:teuthology.orchestra.run.smithi002.stdout:(4/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.4 MB/s | 84 kB 00:00 2024-09-21T13:29:47.320 INFO:teuthology.orchestra.run.smithi002.stdout:(5/7): nvme-cli-2.9.1-6.el9.x86_64.rpm 4.0 MB/s | 906 kB 00:00 2024-09-21T13:29:47.351 INFO:teuthology.orchestra.run.smithi162.stdout:(5/7): nvme-cli-2.9.1-6.el9.x86_64.rpm 3.1 MB/s | 906 kB 00:00 2024-09-21T13:29:47.370 INFO:teuthology.orchestra.run.smithi002.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 7.0 MB/s | 837 kB 00:00 2024-09-21T13:29:47.385 INFO:teuthology.orchestra.run.smithi162.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 5.1 MB/s | 837 kB 00:00 2024-09-21T13:29:47.604 INFO:teuthology.orchestra.run.smithi002.stdout:(7/7): runc-1.1.13-4.el9.x86_64.rpm 10 MB/s | 3.2 MB 00:00 2024-09-21T13:29:47.604 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:29:47.604 INFO:teuthology.orchestra.run.smithi002.stdout:Total 9.0 MB/s | 5.2 MB 00:00 2024-09-21T13:29:47.644 INFO:teuthology.orchestra.run.smithi162.stdout:(7/7): runc-1.1.13-4.el9.x86_64.rpm 8.1 MB/s | 3.2 MB 00:00 2024-09-21T13:29:47.644 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:29:47.644 INFO:teuthology.orchestra.run.smithi162.stdout:Total 8.3 MB/s | 5.2 MB 00:00 2024-09-21T13:29:47.718 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:29:47.734 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:29:47.734 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:29:47.754 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:29:47.769 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:29:47.769 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:29:48.040 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:29:48.040 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:29:48.068 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:29:48.068 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:29:48.519 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:29:48.534 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:29:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2024-09-21T13:29:48.621 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2024-09-21T13:29:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/7 2024-09-21T13:29:48.666 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/7 2024-09-21T13:29:48.669 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/7 2024-09-21T13:29:48.695 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/7 2024-09-21T13:29:48.882 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/7 2024-09-21T13:29:48.905 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/7 2024-09-21T13:29:48.917 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-21T13:29:48.934 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-21T13:29:49.377 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-21T13:29:49.389 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-21T13:29:49.404 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/7 2024-09-21T13:29:49.416 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/7 2024-09-21T13:29:49.518 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/7 2024-09-21T13:29:49.541 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/7 2024-09-21T13:29:49.583 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-21T13:29:49.612 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-21T13:29:50.526 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-21T13:29:50.527 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/7 2024-09-21T13:29:50.527 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/7 2024-09-21T13:29:50.527 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/7 2024-09-21T13:29:50.527 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/7 2024-09-21T13:29:50.527 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/7 2024-09-21T13:29:50.527 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2024-09-21T13:29:50.619 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-21T13:29:50.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/7 2024-09-21T13:29:50.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/7 2024-09-21T13:29:50.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/7 2024-09-21T13:29:50.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/7 2024-09-21T13:29:50.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/7 2024-09-21T13:29:50.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2024-09-21T13:29:50.935 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-21T13:29:50.935 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:29:50.935 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:29:50.935 INFO:teuthology.orchestra.run.smithi002.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-21T13:29:50.935 INFO:teuthology.orchestra.run.smithi002.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-21T13:29:50.935 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-21T13:29:50.935 INFO:teuthology.orchestra.run.smithi002.stdout: runc-4:1.1.13-4.el9.x86_64 2024-09-21T13:29:50.935 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:29:50.935 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:29:51.026 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-21T13:29:51.026 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:29:51.026 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:29:51.026 INFO:teuthology.orchestra.run.smithi162.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-21T13:29:51.026 INFO:teuthology.orchestra.run.smithi162.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-21T13:29:51.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-21T13:29:51.026 INFO:teuthology.orchestra.run.smithi162.stdout: runc-4:1.1.13-4.el9.x86_64 2024-09-21T13:29:51.026 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:29:51.027 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:29:51.431 DEBUG:teuthology.parallel:result is None 2024-09-21T13:29:51.463 DEBUG:teuthology.parallel:result is None 2024-09-21T13:29:51.463 INFO:teuthology.run_tasks:Running task install... 2024-09-21T13:29:51.473 DEBUG:teuthology.task.install:project ceph 2024-09-21T13:29:51.473 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '441784946648ff53dd310293f9dd752afeeea72a'}, 'extra_packages': ['cephadm']} 2024-09-21T13:29:51.473 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '441784946648ff53dd310293f9dd752afeeea72a'} 2024-09-21T13:29:51.473 INFO:teuthology.task.install:Using flavor: default 2024-09-21T13:29:51.479 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T13:29:51.479 INFO:teuthology.task.install:extra packages: [] 2024-09-21T13:29:51.479 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '441784946648ff53dd310293f9dd752afeeea72a', 'tag': None, 'wait_for_package': False} 2024-09-21T13:29:51.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T13:29:51.481 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '441784946648ff53dd310293f9dd752afeeea72a', 'tag': None, 'wait_for_package': False} 2024-09-21T13:29:51.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T13:29:51.624 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0842/441784946648ff53dd310293f9dd752afeeea72a/centos/9/flavors/default/ 2024-09-21T13:29:51.624 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5104.g44178494 2024-09-21T13:29:51.630 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0842/441784946648ff53dd310293f9dd752afeeea72a/centos/9/flavors/default/ 2024-09-21T13:29:51.631 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5104.g44178494 2024-09-21T13:29:51.736 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0842/441784946648ff53dd310293f9dd752afeeea72a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0842/441784946648ff53dd310293f9dd752afeeea72a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0842/441784946648ff53dd310293f9dd752afeeea72a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T13:29:51.737 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:29:51.737 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T13:29:51.742 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0842/441784946648ff53dd310293f9dd752afeeea72a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0842/441784946648ff53dd310293f9dd752afeeea72a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0842/441784946648ff53dd310293f9dd752afeeea72a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T13:29:51.743 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:29:51.743 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T13:29:51.765 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T13:29:51.765 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/441784946648ff53dd310293f9dd752afeeea72a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T13:29:51.768 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T13:29:51.768 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/441784946648ff53dd310293f9dd752afeeea72a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T13:29:51.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T13:29:51.834 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T13:29:51.910 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T13:29:51.942 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T13:29:51.967 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-09-21T13:29:51.968 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-09-21T13:29:51.985 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-21T13:29:51.986 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-21T13:29:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-09-21T13:29:52.215 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-21T13:29:52.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw 2024-09-21T13:29:52.242 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw 2024-09-21T13:29:52.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-21T13:29:52.796 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-21T13:29:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T13:29:53.088 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T13:29:53.364 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T13:29:53.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T13:29:53.796 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 21 MB/s | 8.3 MB 00:00 2024-09-21T13:29:54.182 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T13:29:56.183 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-21T13:29:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 20 MB 00:02 2024-09-21T13:30:00.450 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-21T13:30:02.151 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-21T13:30:02.963 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T13:30:03.006 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-21T13:30:05.315 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-21T13:30:06.077 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-21T13:30:08.352 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T13:30:10.607 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:30:10.609 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:30:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T13:30:10.609 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:30:10.609 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.3.0-5104.g44178494.el9 ceph 11 M 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.3.0-5104.g44178494.el9 ceph 3.5 M 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.3.0-5104.g44178494.el9 ceph 3.2 M 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.3.0-5104.g44178494.el9 ceph 5.5 M 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.3.0-5104.g44178494.el9 ceph 22 M 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.3.0-5104.g44178494.el9 ceph 25 k 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T13:30:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.3.0-5104.g44178494.el9 ceph 754 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.3.0-5104.g44178494.el9 ceph 508 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.3.0-5104.g44178494.el9 ceph 5.5 M 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.3.0-5104.g44178494.el9 ceph 45 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.3.0-5104.g44178494.el9 ceph 148 k 2024-09-21T13:30:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.3.0-5104.g44178494.el9 ceph 161 k 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.3.0-5104.g44178494.el9 ceph 320 k 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.3.0-5104.g44178494.el9 ceph 307 k 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.3.0-5104.g44178494.el9 ceph 99 k 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:30:10.612 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:30:10.613 INFO:teuthology.orchestra.run.smithi162.stdout:Install 31 Packages 2024-09-21T13:30:10.613 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 2 Packages 2024-09-21T13:30:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:10.613 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 62 M 2024-09-21T13:30:10.613 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:30:11.345 INFO:teuthology.orchestra.run.smithi162.stdout:(1/33): ceph-base-19.3.0-5104.g44178494.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-21T13:30:11.396 INFO:teuthology.orchestra.run.smithi162.stdout:(2/33): ceph-selinux-19.3.0-5104.g44178494.el9. 504 kB/s | 25 kB 00:00 2024-09-21T13:30:11.496 INFO:teuthology.orchestra.run.smithi162.stdout:(3/33): libcephfs2-19.3.0-5104.g44178494.el9.x8 7.4 MB/s | 754 kB 00:00 2024-09-21T13:30:11.588 INFO:teuthology.orchestra.run.smithi162.stdout:(4/33): libradosstriper1-19.3.0-5104.g44178494. 5.4 MB/s | 508 kB 00:00 2024-09-21T13:30:11.617 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-21T13:30:11.955 INFO:teuthology.orchestra.run.smithi162.stdout:(5/33): ceph-common-19.3.0-5104.g44178494.el9.x 20 MB/s | 22 MB 00:01 2024-09-21T13:30:12.005 INFO:teuthology.orchestra.run.smithi162.stdout:(6/33): python3-ceph-argparse-19.3.0-5104.g4417 908 kB/s | 45 kB 00:00 2024-09-21T13:30:12.089 INFO:teuthology.orchestra.run.smithi162.stdout:(7/33): librgw2-19.3.0-5104.g44178494.el9.x86_6 11 MB/s | 5.5 MB 00:00 2024-09-21T13:30:12.206 INFO:teuthology.orchestra.run.smithi162.stdout:(8/33): ceph-radosgw-19.3.0-5104.g44178494.el9. 8.3 MB/s | 11 MB 00:01 2024-09-21T13:30:12.231 INFO:teuthology.orchestra.run.smithi162.stdout:(9/33): python3-ceph-common-19.3.0-5104.g441784 658 kB/s | 148 kB 00:00 2024-09-21T13:30:12.256 INFO:teuthology.orchestra.run.smithi162.stdout:(10/33): python3-cephfs-19.3.0-5104.g44178494.e 964 kB/s | 161 kB 00:00 2024-09-21T13:30:12.281 INFO:teuthology.orchestra.run.smithi162.stdout:(11/33): python3-rados-19.3.0-5104.g44178494.el 4.1 MB/s | 320 kB 00:00 2024-09-21T13:30:12.307 INFO:teuthology.orchestra.run.smithi162.stdout:(12/33): python3-rgw-19.3.0-5104.g44178494.el9. 1.9 MB/s | 99 kB 00:00 2024-09-21T13:30:12.332 INFO:teuthology.orchestra.run.smithi162.stdout:(13/33): python3-rbd-19.3.0-5104.g44178494.el9. 3.0 MB/s | 307 kB 00:00 2024-09-21T13:30:12.407 INFO:teuthology.orchestra.run.smithi162.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 852 kB/s | 107 kB 00:00 2024-09-21T13:30:12.433 INFO:teuthology.orchestra.run.smithi162.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-21T13:30:12.458 INFO:teuthology.orchestra.run.smithi162.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.1 MB/s | 171 kB 00:00 2024-09-21T13:30:12.483 INFO:teuthology.orchestra.run.smithi162.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-21T13:30:12.559 INFO:teuthology.orchestra.run.smithi162.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-21T13:30:12.584 INFO:teuthology.orchestra.run.smithi162.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 421 kB/s | 42 kB 00:00 2024-09-21T13:30:12.623 INFO:teuthology.orchestra.run.smithi162.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-21T13:30:12.665 INFO:teuthology.orchestra.run.smithi162.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 445 kB/s | 36 kB 00:00 2024-09-21T13:30:12.690 INFO:teuthology.orchestra.run.smithi162.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-21T13:30:12.716 INFO:teuthology.orchestra.run.smithi162.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 514 kB/s | 47 kB 00:00 2024-09-21T13:30:12.774 INFO:teuthology.orchestra.run.smithi162.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-21T13:30:12.799 INFO:teuthology.orchestra.run.smithi162.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-09-21T13:30:12.825 INFO:teuthology.orchestra.run.smithi162.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-21T13:30:12.850 INFO:teuthology.orchestra.run.smithi162.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T13:30:12.892 INFO:teuthology.orchestra.run.smithi162.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T13:30:12.926 INFO:teuthology.orchestra.run.smithi162.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 839 kB 00:00 2024-09-21T13:30:12.993 INFO:teuthology.orchestra.run.smithi162.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T13:30:13.068 INFO:teuthology.orchestra.run.smithi162.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-21T13:30:13.135 INFO:teuthology.orchestra.run.smithi162.stdout:(32/33): librados2-19.3.0-5104.g44178494.el9.x8 17 MB/s | 3.5 MB 00:00 2024-09-21T13:30:13.243 INFO:teuthology.orchestra.run.smithi162.stdout:(33/33): librbd1-19.3.0-5104.g44178494.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-21T13:30:13.249 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:30:13.249 INFO:teuthology.orchestra.run.smithi162.stdout:Total 23 MB/s | 62 MB 00:02 2024-09-21T13:30:13.355 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:30:13.393 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:30:13.393 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:30:13.912 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:30:13.914 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:30:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-21T13:30:13.914 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:30:13.914 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:30:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.3.0-5104.g44178494.el9 ceph 11 M 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.3.0-5104.g44178494.el9 ceph 3.5 M 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.3.0-5104.g44178494.el9 ceph 3.2 M 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.3.0-5104.g44178494.el9 ceph 5.5 M 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.3.0-5104.g44178494.el9 ceph 22 M 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.3.0-5104.g44178494.el9 ceph 25 k 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T13:30:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.3.0-5104.g44178494.el9 ceph 754 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.3.0-5104.g44178494.el9 ceph 508 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.3.0-5104.g44178494.el9 ceph 5.5 M 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.3.0-5104.g44178494.el9 ceph 45 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.3.0-5104.g44178494.el9 ceph 148 k 2024-09-21T13:30:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.3.0-5104.g44178494.el9 ceph 161 k 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.3.0-5104.g44178494.el9 ceph 320 k 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.3.0-5104.g44178494.el9 ceph 307 k 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.3.0-5104.g44178494.el9 ceph 99 k 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:30:13.917 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:30:13.918 INFO:teuthology.orchestra.run.smithi002.stdout:Install 31 Packages 2024-09-21T13:30:13.918 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 2 Packages 2024-09-21T13:30:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:13.918 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 62 M 2024-09-21T13:30:13.918 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:30:13.941 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:30:13.942 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:30:14.560 INFO:teuthology.orchestra.run.smithi002.stdout:(1/33): ceph-base-19.3.0-5104.g44178494.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-21T13:30:14.626 INFO:teuthology.orchestra.run.smithi002.stdout:(2/33): ceph-selinux-19.3.0-5104.g44178494.el9. 378 kB/s | 25 kB 00:00 2024-09-21T13:30:14.727 INFO:teuthology.orchestra.run.smithi002.stdout:(3/33): libcephfs2-19.3.0-5104.g44178494.el9.x8 7.4 MB/s | 754 kB 00:00 2024-09-21T13:30:14.802 INFO:teuthology.orchestra.run.smithi002.stdout:(4/33): libradosstriper1-19.3.0-5104.g44178494. 6.6 MB/s | 508 kB 00:00 2024-09-21T13:30:15.227 INFO:teuthology.orchestra.run.smithi002.stdout:(5/33): ceph-common-19.3.0-5104.g44178494.el9.x 19 MB/s | 22 MB 00:01 2024-09-21T13:30:15.303 INFO:teuthology.orchestra.run.smithi002.stdout:(6/33): librgw2-19.3.0-5104.g44178494.el9.x86_6 11 MB/s | 5.5 MB 00:00 2024-09-21T13:30:15.319 INFO:teuthology.orchestra.run.smithi002.stdout:(7/33): python3-ceph-argparse-19.3.0-5104.g4417 492 kB/s | 45 kB 00:00 2024-09-21T13:30:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:30:15.436 INFO:teuthology.orchestra.run.smithi002.stdout:(8/33): ceph-radosgw-19.3.0-5104.g44178494.el9. 8.1 MB/s | 11 MB 00:01 2024-09-21T13:30:15.453 INFO:teuthology.orchestra.run.smithi002.stdout:(9/33): python3-ceph-common-19.3.0-5104.g441784 988 kB/s | 148 kB 00:00 2024-09-21T13:30:15.478 INFO:teuthology.orchestra.run.smithi002.stdout:(10/33): python3-cephfs-19.3.0-5104.g44178494.e 1.0 MB/s | 161 kB 00:00 2024-09-21T13:30:15.504 INFO:teuthology.orchestra.run.smithi002.stdout:(11/33): python3-rados-19.3.0-5104.g44178494.el 4.7 MB/s | 320 kB 00:00 2024-09-21T13:30:15.519 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-21T13:30:15.529 INFO:teuthology.orchestra.run.smithi002.stdout:(12/33): python3-rbd-19.3.0-5104.g44178494.el9. 4.0 MB/s | 307 kB 00:00 2024-09-21T13:30:15.554 INFO:teuthology.orchestra.run.smithi002.stdout:(13/33): python3-rgw-19.3.0-5104.g44178494.el9. 1.3 MB/s | 99 kB 00:00 2024-09-21T13:30:15.557 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-21T13:30:15.591 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-21T13:30:15.622 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-21T13:30:15.656 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-21T13:30:15.688 INFO:teuthology.orchestra.run.smithi002.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 674 kB/s | 107 kB 00:00 2024-09-21T13:30:15.713 INFO:teuthology.orchestra.run.smithi002.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 929 kB/s | 171 kB 00:00 2024-09-21T13:30:15.738 INFO:teuthology.orchestra.run.smithi002.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 873 kB/s | 160 kB 00:00 2024-09-21T13:30:15.763 INFO:teuthology.orchestra.run.smithi002.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-09-21T13:30:15.814 INFO:teuthology.orchestra.run.smithi002.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-21T13:30:15.815 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-21T13:30:15.842 INFO:teuthology.orchestra.run.smithi002.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-21T13:30:15.864 INFO:teuthology.orchestra.run.smithi002.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-21T13:30:15.868 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-21T13:30:15.889 INFO:teuthology.orchestra.run.smithi002.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 716 kB/s | 36 kB 00:00 2024-09-21T13:30:15.915 INFO:teuthology.orchestra.run.smithi002.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-21T13:30:15.932 INFO:teuthology.orchestra.run.smithi002.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-21T13:30:15.990 INFO:teuthology.orchestra.run.smithi002.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-21T13:30:16.016 INFO:teuthology.orchestra.run.smithi002.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T13:30:16.050 INFO:teuthology.orchestra.run.smithi002.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-09-21T13:30:16.074 INFO:teuthology.orchestra.run.smithi002.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-21T13:30:16.091 INFO:teuthology.orchestra.run.smithi002.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 11 MB/s | 191 kB 00:00 2024-09-21T13:30:16.150 INFO:teuthology.orchestra.run.smithi002.stdout:(29/33): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-21T13:30:16.184 INFO:teuthology.orchestra.run.smithi002.stdout:(30/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-21T13:30:16.260 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-21T13:30:16.276 INFO:teuthology.orchestra.run.smithi002.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T13:30:16.351 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.3.0-5104.g44178494.el9.x86_64 7/35 2024-09-21T13:30:16.384 INFO:teuthology.orchestra.run.smithi002.stdout:(32/33): librados2-19.3.0-5104.g44178494.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-21T13:30:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.3.0-5104.g44178494.el9.x86_64 7/35 2024-09-21T13:30:16.443 INFO:teuthology.orchestra.run.smithi002.stdout:(33/33): librbd1-19.3.0-5104.g44178494.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-21T13:30:16.448 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:30:16.448 INFO:teuthology.orchestra.run.smithi002.stdout:Total 24 MB/s | 62 MB 00:02 2024-09-21T13:30:16.530 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.3.0-5104.g44178494.el9.x86_64 8/35 2024-09-21T13:30:16.568 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:30:16.570 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.3.0-5104.g44178494.el9.x86_64 9/35 2024-09-21T13:30:16.609 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:30:16.609 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:30:16.633 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.3.0-5104.g44178494.el9.x86_64 9/35 2024-09-21T13:30:16.678 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-21T13:30:16.722 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.3.0-5104.g44178494.el9. 11/35 2024-09-21T13:30:16.802 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.3.0-5104.g44178494.el9.x86_64 12/35 2024-09-21T13:30:16.830 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.3.0-5104.g44178494.el9.x86_6 13/35 2024-09-21T13:30:16.895 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5104.g44178494.el9.x86_6 13/35 2024-09-21T13:30:16.929 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-21T13:30:17.041 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-21T13:30:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-21T13:30:17.122 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-21T13:30:17.154 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-21T13:30:17.155 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:30:17.155 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:30:17.183 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-21T13:30:17.216 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-21T13:30:17.253 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-21T13:30:17.574 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-21T13:30:17.613 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.3.0-5104.g44178494.el9.x86_64 23/35 2024-09-21T13:30:17.689 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.3.0-5104.g44178494.el9.x86_64 23/35 2024-09-21T13:30:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.3.0-5104.g44178494.el9.x86_64 24/35 2024-09-21T13:30:17.763 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-21T13:30:18.266 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-21T13:30:18.299 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.3.0-5104.g44178494.el9.x86_64 27/35 2024-09-21T13:30:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.3.0-5104.g44178494.el9.x86_64 27/35 2024-09-21T13:30:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.3.0-5104.g44178494.el9.x86_64 28/35 2024-09-21T13:30:18.493 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.3.0-5104.g44178494.el9.x8 29/35 2024-09-21T13:30:18.783 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:30:18.870 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-21T13:30:18.898 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-21T13:30:18.923 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-21T13:30:18.945 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-21T13:30:18.982 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-21T13:30:19.192 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-21T13:30:19.252 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-21T13:30:19.606 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-21T13:30:19.716 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.3.0-5104.g44178494.el9.x86_64 7/35 2024-09-21T13:30:19.809 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.3.0-5104.g44178494.el9.x86_64 7/35 2024-09-21T13:30:19.900 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.3.0-5104.g44178494.el9.x86_64 8/35 2024-09-21T13:30:19.926 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.3.0-5104.g44178494.el9.x86_64 9/35 2024-09-21T13:30:19.998 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.3.0-5104.g44178494.el9.x86_64 9/35 2024-09-21T13:30:20.026 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-21T13:30:20.070 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.3.0-5104.g44178494.el9. 11/35 2024-09-21T13:30:20.140 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.3.0-5104.g44178494.el9.x86_64 12/35 2024-09-21T13:30:20.170 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.3.0-5104.g44178494.el9.x86_6 13/35 2024-09-21T13:30:20.226 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5104.g44178494.el9.x86_6 13/35 2024-09-21T13:30:20.260 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-21T13:30:20.371 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-21T13:30:20.403 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-21T13:30:20.454 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-21T13:30:20.484 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-21T13:30:20.513 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-21T13:30:20.546 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-21T13:30:20.584 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-21T13:30:20.822 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 30/35 2024-09-21T13:30:20.873 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 30/35 2024-09-21T13:30:20.941 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-21T13:30:20.985 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.3.0-5104.g44178494.el9.x86_64 23/35 2024-09-21T13:30:21.077 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.3.0-5104.g44178494.el9.x86_64 23/35 2024-09-21T13:30:21.106 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.3.0-5104.g44178494.el9.x86_64 24/35 2024-09-21T13:30:21.142 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-21T13:30:21.455 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 30/35 2024-09-21T13:30:21.494 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.3.0-5104.g44178494.el9.x86_64 31/35 2024-09-21T13:30:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.3.0-5104.g44178494.el9.x86_64 31/35 2024-09-21T13:30:21.595 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T13:30:21.595 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T13:30:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:21.628 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.3.0-5104.g44178494.el9.x86_64 32/35 2024-09-21T13:30:21.660 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-21T13:30:21.687 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.3.0-5104.g44178494.el9.x86_64 27/35 2024-09-21T13:30:21.759 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.3.0-5104.g44178494.el9.x86_64 27/35 2024-09-21T13:30:21.844 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.3.0-5104.g44178494.el9.x86_64 28/35 2024-09-21T13:30:21.872 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.3.0-5104.g44178494.el9.x8 29/35 2024-09-21T13:30:24.359 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 30/35 2024-09-21T13:30:24.394 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 30/35 2024-09-21T13:30:25.021 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 30/35 2024-09-21T13:30:25.055 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.3.0-5104.g44178494.el9.x86_64 31/35 2024-09-21T13:30:25.146 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.3.0-5104.g44178494.el9.x86_64 31/35 2024-09-21T13:30:25.146 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T13:30:25.146 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T13:30:25.146 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:25.198 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.3.0-5104.g44178494.el9.x86_64 32/35 2024-09-21T13:30:31.748 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5104.g44178494.el9.x86_64 32/35 2024-09-21T13:30:31.748 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-21T13:30:31.748 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-21T13:30:31.748 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-21T13:30:31.748 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-21T13:30:31.748 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-21T13:30:31.748 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-21T13:30:31.749 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-21T13:30:31.749 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:32.768 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.3.0-5104.g44178494.el9.x86_64 33/35 2024-09-21T13:30:32.793 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5104.g44178494.el9.x86_64 33/35 2024-09-21T13:30:32.793 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:30:32.793 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T13:30:32.793 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T13:30:32.793 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T13:30:32.793 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:32.795 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T13:30:32.879 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T13:30:32.879 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T13:30:34.184 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T13:30:34.184 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.3.0-5104.g44178494.el9.x86_64 1/35 2024-09-21T13:30:34.184 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 2/35 2024-09-21T13:30:34.184 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.3.0-5104.g44178494.el9.x86_64 3/35 2024-09-21T13:30:34.184 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.3.0-5104.g44178494.el9.x86_64 4/35 2024-09-21T13:30:34.184 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.3.0-5104.g44178494.el9.x86_64 5/35 2024-09-21T13:30:34.184 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.3.0-5104.g44178494.el9.x86_6 6/35 2024-09-21T13:30:34.184 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.3.0-5104.g44178494.el9.x86_64 7/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5104.g44178494.el9. 8/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.3.0-5104.g44178494.el9.x8 9/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.3.0-5104.g44178494.el9.x86_64 10/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.3.0-5104.g44178494.el9.x86_64 11/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.3.0-5104.g44178494.el9.x86_64 12/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.3.0-5104.g44178494.el9.x86_64 13/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-21T13:30:34.185 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-21T13:30:34.186 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-21T13:30:34.186 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-21T13:30:34.186 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-21T13:30:34.186 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-21T13:30:34.187 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-21T13:30:34.187 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-21T13:30:34.187 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-21T13:30:34.187 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-21T13:30:34.187 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.3.0-5104.g44178494.el9.x86_64 32/35 2024-09-21T13:30:34.187 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-21T13:30:34.187 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.3.0-5104.g44178494.el9.x86_64 34/35 2024-09-21T13:30:35.221 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T13:30:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:35.224 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:30:35.515 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5104.g44178494.el9.x86_64 32/35 2024-09-21T13:30:35.515 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-09-21T13:30:35.515 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-09-21T13:30:35.515 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-09-21T13:30:35.515 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-09-21T13:30:35.515 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-09-21T13:30:35.515 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-09-21T13:30:35.516 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-09-21T13:30:35.516 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:35.614 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-test 2024-09-21T13:30:36.210 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:28 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:30:36.343 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:30:36.343 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:30:36.344 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T13:30:36.344 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:30:36.344 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:30:36.344 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.3.0-5104.g44178494.el9 ceph 46 M 2024-09-21T13:30:36.344 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T13:30:36.344 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.3.0-5104.g44178494.el9 ceph 161 k 2024-09-21T13:30:36.344 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T13:30:36.344 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T13:30:36.344 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:36.345 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:30:36.345 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:30:36.345 INFO:teuthology.orchestra.run.smithi162.stdout:Install 4 Packages 2024-09-21T13:30:36.345 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:36.345 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 46 M 2024-09-21T13:30:36.345 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 201 M 2024-09-21T13:30:36.345 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:30:36.565 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.3.0-5104.g44178494.el9.x86_64 33/35 2024-09-21T13:30:36.596 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5104.g44178494.el9.x86_64 33/35 2024-09-21T13:30:36.596 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:30:36.596 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T13:30:36.596 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T13:30:36.597 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T13:30:36.597 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:36.598 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T13:30:36.667 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T13:30:36.667 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T13:30:36.667 INFO:teuthology.orchestra.run.smithi162.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-21T13:30:36.693 INFO:teuthology.orchestra.run.smithi162.stdout:(2/4): libcephsqlite-19.3.0-5104.g44178494.el9. 692 kB/s | 161 kB 00:00 2024-09-21T13:30:36.718 INFO:teuthology.orchestra.run.smithi162.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T13:30:37.837 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.3.0-5104.g44178494.el9.x86_64 1/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 2/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.3.0-5104.g44178494.el9.x86_64 3/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.3.0-5104.g44178494.el9.x86_64 4/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.3.0-5104.g44178494.el9.x86_64 5/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.3.0-5104.g44178494.el9.x86_6 6/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.3.0-5104.g44178494.el9.x86_64 7/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5104.g44178494.el9. 8/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.3.0-5104.g44178494.el9.x8 9/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.3.0-5104.g44178494.el9.x86_64 10/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.3.0-5104.g44178494.el9.x86_64 11/35 2024-09-21T13:30:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.3.0-5104.g44178494.el9.x86_64 12/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.3.0-5104.g44178494.el9.x86_64 13/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-21T13:30:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-21T13:30:37.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-21T13:30:37.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-21T13:30:37.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-21T13:30:37.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-21T13:30:37.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.3.0-5104.g44178494.el9.x86_64 32/35 2024-09-21T13:30:37.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-21T13:30:37.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.3.0-5104.g44178494.el9.x86_64 34/35 2024-09-21T13:30:37.918 INFO:teuthology.orchestra.run.smithi162.stdout:(4/4): ceph-test-19.3.0-5104.g44178494.el9.x86_ 31 MB/s | 46 MB 00:01 2024-09-21T13:30:37.920 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:30:37.921 INFO:teuthology.orchestra.run.smithi162.stdout:Total 29 MB/s | 46 MB 00:01 2024-09-21T13:30:37.949 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:30:37.970 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:30:37.970 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:30:38.336 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:30:38.336 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:30:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T13:30:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T13:30:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.735 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.736 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T13:30:38.736 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.736 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.736 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:38.736 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T13:30:38.736 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T13:30:38.736 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T13:30:38.736 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T13:30:38.736 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T13:30:38.736 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:38.736 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:30:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:30:38.992 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T13:30:39.047 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T13:30:39.076 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.3.0-5104.g44178494.el9.x86_64 3/4 2024-09-21T13:30:39.168 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-test 2024-09-21T13:30:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:28 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:30:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:30:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:30:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-21T13:30:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:30:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:30:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.3.0-5104.g44178494.el9 ceph 46 M 2024-09-21T13:30:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-21T13:30:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.3.0-5104.g44178494.el9 ceph 161 k 2024-09-21T13:30:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T13:30:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T13:30:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:30:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:30:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-21T13:30:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 46 M 2024-09-21T13:30:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 201 M 2024-09-21T13:30:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:30:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-21T13:30:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-21T13:30:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): libcephsqlite-19.3.0-5104.g44178494.el9. 677 kB/s | 161 kB 00:00 2024-09-21T13:30:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): ceph-test-19.3.0-5104.g44178494.el9.x86_ 32 MB/s | 46 MB 00:01 2024-09-21T13:30:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:30:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:Total 30 MB/s | 46 MB 00:01 2024-09-21T13:30:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:30:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:30:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:30:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:30:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:30:42.503 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:30:42.586 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T13:30:42.633 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T13:30:42.661 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.3.0-5104.g44178494.el9.x86_64 3/4 2024-09-21T13:30:43.442 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5104.g44178494.el9.x86_64 3/4 2024-09-21T13:30:43.541 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.3.0-5104.g44178494.el9.x86_64 4/4 2024-09-21T13:30:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-test-2:19.3.0-5104.g44178494.el9.x86_64 4/4 2024-09-21T13:30:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.3.0-5104.g44178494.el9.x86_64 1/4 2024-09-21T13:30:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.3.0-5104.g44178494.el9.x86_64 2/4 2024-09-21T13:30:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T13:30:46.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T13:30:46.338 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:46.339 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:30:46.339 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:46.339 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:46.339 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T13:30:46.339 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T13:30:46.339 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:46.339 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:30:46.611 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph 2024-09-21T13:30:47.229 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:39 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:30:47.254 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5104.g44178494.el9.x86_64 3/4 2024-09-21T13:30:47.345 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.3.0-5104.g44178494.el9.x86_64 4/4 2024-09-21T13:30:47.370 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:30:47.373 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:30:47.373 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T13:30:47.373 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:30:47.373 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:30:47.373 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.3.0-5104.g44178494.el9 ceph 6.6 k 2024-09-21T13:30:47.373 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T13:30:47.373 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.3.0-5104.g44178494.el9 ceph 2.4 M 2024-09-21T13:30:47.373 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.3.0-5104.g44178494.el9 ceph 1.5 M 2024-09-21T13:30:47.373 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 292 k 2024-09-21T13:30:47.373 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.3.0-5104.g44178494.el9 ceph 4.8 M 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.3.0-5104.g44178494.el9 ceph 17 M 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections 2024-09-21T13:30:47.374 INFO:teuthology.orchestra.run.smithi162.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T13:30:47.375 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout:Install 37 Packages 2024-09-21T13:30:47.376 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:47.377 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 31 M 2024-09-21T13:30:47.377 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 109 M 2024-09-21T13:30:47.377 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:30:47.952 INFO:teuthology.orchestra.run.smithi162.stdout:(1/37): ceph-19.3.0-5104.g44178494.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-09-21T13:30:48.161 INFO:teuthology.orchestra.run.smithi162.stdout:(2/37): ceph-mds-19.3.0-5104.g44178494.el9.x86_ 7.2 MB/s | 2.4 MB 00:00 2024-09-21T13:30:48.203 INFO:teuthology.orchestra.run.smithi162.stdout:(3/37): ceph-mgr-19.3.0-5104.g44178494.el9.x86_ 4.1 MB/s | 1.5 MB 00:00 2024-09-21T13:30:48.295 INFO:teuthology.orchestra.run.smithi162.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5104.g4417 3.1 MB/s | 292 kB 00:00 2024-09-21T13:30:48.453 INFO:teuthology.orchestra.run.smithi162.stdout:(5/37): ceph-mon-19.3.0-5104.g44178494.el9.x86_ 9.6 MB/s | 4.8 MB 00:00 2024-09-21T13:30:48.504 INFO:teuthology.orchestra.run.smithi162.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-21T13:30:48.562 INFO:teuthology.orchestra.run.smithi162.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T13:30:48.738 INFO:teuthology.orchestra.run.smithi162.stdout:(8/37): ceph-osd-19.3.0-5104.g44178494.el9.x86_ 30 MB/s | 17 MB 00:00 2024-09-21T13:30:48.763 INFO:teuthology.orchestra.run.smithi162.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 674 kB/s | 135 kB 00:00 2024-09-21T13:30:48.830 INFO:teuthology.orchestra.run.smithi162.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.2 MB/s | 215 kB 00:00 2024-09-21T13:30:48.872 INFO:teuthology.orchestra.run.smithi162.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 2.9 MB/s | 1.2 MB 00:00 2024-09-21T13:30:48.897 INFO:teuthology.orchestra.run.smithi162.stdout:(12/37): python3-requests-2.25.1-8.el9.noarch.r 785 kB/s | 125 kB 00:00 2024-09-21T13:30:49.464 INFO:teuthology.orchestra.run.smithi162.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 61 kB/s | 35 kB 00:00 2024-09-21T13:30:49.573 INFO:teuthology.orchestra.run.smithi162.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 254 kB/s | 188 kB 00:00 2024-09-21T13:30:49.615 INFO:teuthology.orchestra.run.smithi162.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 232 kB/s | 172 kB 00:00 2024-09-21T13:30:49.656 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-test-2:19.3.0-5104.g44178494.el9.x86_64 4/4 2024-09-21T13:30:49.656 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.3.0-5104.g44178494.el9.x86_64 1/4 2024-09-21T13:30:49.657 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.3.0-5104.g44178494.el9.x86_64 2/4 2024-09-21T13:30:49.657 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T13:30:49.951 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T13:30:49.951 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:49.951 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:30:49.951 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:49.951 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:30:49.951 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T13:30:49.951 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T13:30:49.952 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:49.952 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:30:50.107 INFO:teuthology.orchestra.run.smithi162.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 120 kB/s | 77 kB 00:00 2024-09-21T13:30:50.149 INFO:teuthology.orchestra.run.smithi162.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 540 kB/s | 22 kB 00:00 2024-09-21T13:30:50.182 INFO:teuthology.orchestra.run.smithi162.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-09-21T13:30:50.216 INFO:teuthology.orchestra.run.smithi162.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 69 kB/s | 42 kB 00:00 2024-09-21T13:30:50.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph 2024-09-21T13:30:50.250 INFO:teuthology.orchestra.run.smithi162.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-09-21T13:30:50.275 INFO:teuthology.orchestra.run.smithi162.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 481 kB/s | 43 kB 00:00 2024-09-21T13:30:50.300 INFO:teuthology.orchestra.run.smithi162.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-21T13:30:50.326 INFO:teuthology.orchestra.run.smithi162.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 711 kB/s | 18 kB 00:00 2024-09-21T13:30:50.351 INFO:teuthology.orchestra.run.smithi162.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-21T13:30:50.376 INFO:teuthology.orchestra.run.smithi162.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 459 kB/s | 23 kB 00:00 2024-09-21T13:30:50.402 INFO:teuthology.orchestra.run.smithi162.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-21T13:30:50.427 INFO:teuthology.orchestra.run.smithi162.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-21T13:30:50.452 INFO:teuthology.orchestra.run.smithi162.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-21T13:30:50.478 INFO:teuthology.orchestra.run.smithi162.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-09-21T13:30:50.503 INFO:teuthology.orchestra.run.smithi162.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-21T13:30:50.528 INFO:teuthology.orchestra.run.smithi162.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-21T13:30:50.554 INFO:teuthology.orchestra.run.smithi162.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-21T13:30:50.579 INFO:teuthology.orchestra.run.smithi162.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-21T13:30:50.604 INFO:teuthology.orchestra.run.smithi162.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-21T13:30:50.630 INFO:teuthology.orchestra.run.smithi162.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T13:30:50.655 INFO:teuthology.orchestra.run.smithi162.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 397 kB/s | 20 kB 00:00 2024-09-21T13:30:50.680 INFO:teuthology.orchestra.run.smithi162.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-21T13:30:50.685 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:30:50.685 INFO:teuthology.orchestra.run.smithi162.stdout:Total 9.3 MB/s | 31 MB 00:03 2024-09-21T13:30:50.841 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:30:50.860 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:39 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:30:50.882 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:30:50.882 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:30:51.005 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:30:51.008 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:30:51.008 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-21T13:30:51.008 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:30:51.008 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:30:51.008 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.3.0-5104.g44178494.el9 ceph 6.6 k 2024-09-21T13:30:51.008 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-21T13:30:51.008 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.3.0-5104.g44178494.el9 ceph 2.4 M 2024-09-21T13:30:51.008 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.3.0-5104.g44178494.el9 ceph 1.5 M 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 292 k 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.3.0-5104.g44178494.el9 ceph 4.8 M 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.3.0-5104.g44178494.el9 ceph 17 M 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T13:30:51.009 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections 2024-09-21T13:30:51.010 INFO:teuthology.orchestra.run.smithi002.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-21T13:30:51.010 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T13:30:51.010 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T13:30:51.010 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T13:30:51.010 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T13:30:51.010 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T13:30:51.010 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T13:30:51.010 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T13:30:51.011 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T13:30:51.011 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T13:30:51.011 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T13:30:51.011 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T13:30:51.011 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T13:30:51.011 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T13:30:51.011 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T13:30:51.011 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T13:30:51.011 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T13:30:51.012 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T13:30:51.012 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T13:30:51.012 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T13:30:51.012 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T13:30:51.012 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:30:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:30:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:Install 37 Packages 2024-09-21T13:30:51.012 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 31 M 2024-09-21T13:30:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 109 M 2024-09-21T13:30:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:30:51.350 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:30:51.350 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:30:51.601 INFO:teuthology.orchestra.run.smithi002.stdout:(1/37): ceph-19.3.0-5104.g44178494.el9.x86_64.r 52 kB/s | 6.6 kB 00:00 2024-09-21T13:30:51.793 INFO:teuthology.orchestra.run.smithi002.stdout:(2/37): ceph-mgr-19.3.0-5104.g44178494.el9.x86_ 4.8 MB/s | 1.5 MB 00:00 2024-09-21T13:30:51.852 INFO:teuthology.orchestra.run.smithi002.stdout:(3/37): ceph-mds-19.3.0-5104.g44178494.el9.x86_ 6.3 MB/s | 2.4 MB 00:00 2024-09-21T13:30:51.919 INFO:teuthology.orchestra.run.smithi002.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5104.g4417 4.3 MB/s | 292 kB 00:00 2024-09-21T13:30:52.144 INFO:teuthology.orchestra.run.smithi002.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-21T13:30:52.227 INFO:teuthology.orchestra.run.smithi002.stdout:(6/37): ceph-mon-19.3.0-5104.g44178494.el9.x86_ 7.7 MB/s | 4.8 MB 00:00 2024-09-21T13:30:52.395 INFO:teuthology.orchestra.run.smithi002.stdout:(7/37): ceph-osd-19.3.0-5104.g44178494.el9.x86_ 29 MB/s | 17 MB 00:00 2024-09-21T13:30:52.503 INFO:teuthology.orchestra.run.smithi002.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 387 kB/s | 106 kB 00:00 2024-09-21T13:30:52.553 INFO:teuthology.orchestra.run.smithi002.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 854 kB/s | 135 kB 00:00 2024-09-21T13:30:52.578 INFO:teuthology.orchestra.run.smithi002.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-09-21T13:30:52.637 INFO:teuthology.orchestra.run.smithi002.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-21T13:30:52.646 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:30:52.718 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T13:30:52.721 INFO:teuthology.orchestra.run.smithi002.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-21T13:30:52.757 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T13:30:52.762 INFO:teuthology.orchestra.run.smithi002.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 836 kB/s | 35 kB 00:00 2024-09-21T13:30:52.785 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T13:30:52.788 INFO:teuthology.orchestra.run.smithi002.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-21T13:30:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-21T13:30:52.838 INFO:teuthology.orchestra.run.smithi002.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T13:30:52.856 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T13:30:52.872 INFO:teuthology.orchestra.run.smithi002.stdout:(17/37): python3-cryptography-36.0.1-4.el9.x86_ 1.7 MB/s | 1.2 MB 00:00 2024-09-21T13:30:52.897 INFO:teuthology.orchestra.run.smithi002.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 497 kB/s | 42 kB 00:00 2024-09-21T13:30:52.918 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T13:30:52.923 INFO:teuthology.orchestra.run.smithi002.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-09-21T13:30:52.959 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T13:30:52.981 INFO:teuthology.orchestra.run.smithi002.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 522 kB/s | 43 kB 00:00 2024-09-21T13:30:53.006 INFO:teuthology.orchestra.run.smithi002.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-21T13:30:53.032 INFO:teuthology.orchestra.run.smithi002.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 428 kB/s | 11 kB 00:00 2024-09-21T13:30:53.057 INFO:teuthology.orchestra.run.smithi002.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 714 kB/s | 18 kB 00:00 2024-09-21T13:30:53.059 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T13:30:53.082 INFO:teuthology.orchestra.run.smithi002.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-21T13:30:53.108 INFO:teuthology.orchestra.run.smithi002.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-21T13:30:53.130 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T13:30:53.133 INFO:teuthology.orchestra.run.smithi002.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-21T13:30:53.158 INFO:teuthology.orchestra.run.smithi002.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-09-21T13:30:53.171 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T13:30:53.184 INFO:teuthology.orchestra.run.smithi002.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 918 kB/s | 46 kB 00:00 2024-09-21T13:30:53.214 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T13:30:53.217 INFO:teuthology.orchestra.run.smithi002.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-21T13:30:53.234 INFO:teuthology.orchestra.run.smithi002.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-21T13:30:53.244 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T13:30:53.251 INFO:teuthology.orchestra.run.smithi002.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 489 kB/s | 16 kB 00:00 2024-09-21T13:30:53.268 INFO:teuthology.orchestra.run.smithi002.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 2.1 MB/s | 36 kB 00:00 2024-09-21T13:30:53.278 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T13:30:53.293 INFO:teuthology.orchestra.run.smithi002.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-21T13:30:53.312 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T13:30:53.318 INFO:teuthology.orchestra.run.smithi002.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-21T13:30:53.344 INFO:teuthology.orchestra.run.smithi002.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-21T13:30:53.369 INFO:teuthology.orchestra.run.smithi002.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T13:30:53.377 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T13:30:53.394 INFO:teuthology.orchestra.run.smithi002.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-21T13:30:53.398 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:30:53.399 INFO:teuthology.orchestra.run.smithi002.stdout:Total 13 MB/s | 31 MB 00:02 2024-09-21T13:30:53.437 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T13:30:53.472 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T13:30:53.520 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T13:30:53.552 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T13:30:53.559 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:30:53.603 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:30:53.603 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:30:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T13:30:53.773 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T13:30:53.861 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T13:30:53.914 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T13:30:53.952 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T13:30:54.001 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T13:30:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T13:30:54.089 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:30:54.089 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:30:54.254 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T13:30:54.299 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T13:30:54.377 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T13:30:54.483 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T13:30:54.531 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T13:30:54.660 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T13:30:54.833 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5104.g44178494.el9. 32/37 2024-09-21T13:30:54.861 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.3.0-5104.g44178494.el9.x86_64 33/37 2024-09-21T13:30:54.888 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5104.g44178494.el9.x86_64 33/37 2024-09-21T13:30:54.888 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:30:54.888 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T13:30:54.889 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T13:30:54.889 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T13:30:54.889 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:55.419 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:30:55.488 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T13:30:55.522 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T13:30:55.549 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T13:30:55.626 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T13:30:55.674 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T13:30:55.706 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T13:30:55.802 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T13:30:55.880 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T13:30:55.927 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T13:30:55.961 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T13:30:55.990 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T13:30:56.025 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T13:30:56.058 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T13:30:56.099 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T13:30:56.151 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T13:30:56.184 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T13:30:56.226 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T13:30:56.265 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T13:30:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T13:30:56.345 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.3.0-5104.g44178494.el9.x86_64 34/37 2024-09-21T13:30:56.373 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.3.0-5104.g44178494.el9.x86_64 34/37 2024-09-21T13:30:56.373 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:30:56.373 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T13:30:56.373 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T13:30:56.373 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T13:30:56.373 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T13:30:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T13:30:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T13:30:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T13:30:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T13:30:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T13:30:56.837 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.3.0-5104.g44178494.el9.x86_64 35/37 2024-09-21T13:30:56.861 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.3.0-5104.g44178494.el9.x86_64 35/37 2024-09-21T13:30:56.861 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:30:56.862 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T13:30:56.862 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T13:30:56.862 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T13:30:56.862 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T13:30:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T13:30:57.088 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.3.0-5104.g44178494.el9.x86_64 36/37 2024-09-21T13:30:57.112 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.3.0-5104.g44178494.el9.x86_64 36/37 2024-09-21T13:30:57.112 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:30:57.112 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T13:30:57.113 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T13:30:57.113 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T13:30:57.113 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:30:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T13:30:57.176 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.3.0-5104.g44178494.el9.x86_64 37/37 2024-09-21T13:30:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T13:30:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T13:30:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T13:30:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5104.g44178494.el9. 32/37 2024-09-21T13:30:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.3.0-5104.g44178494.el9.x86_64 33/37 2024-09-21T13:30:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5104.g44178494.el9.x86_64 33/37 2024-09-21T13:30:57.631 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:30:57.631 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T13:30:57.631 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T13:30:57.631 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T13:30:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-2:19.3.0-5104.g44178494.el9.x86_64 37/37 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.3.0-5104.g44178494.el9.x86_64 1/37 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.3.0-5104.g44178494.el9.x86_64 2/37 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.3.0-5104.g44178494.el9.x86_64 3/37 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.3.0-5104.g44178494.el9.x86_64 4/37 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.3.0-5104.g44178494.el9.x86_64 5/37 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5104.g44178494.el9. 6/37 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T13:30:59.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T13:30:59.136 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T13:30:59.137 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T13:30:59.137 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T13:30:59.137 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T13:30:59.138 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T13:30:59.138 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T13:30:59.138 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T13:30:59.138 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T13:30:59.138 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T13:30:59.138 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T13:30:59.138 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T13:30:59.138 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T13:30:59.178 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.3.0-5104.g44178494.el9.x86_64 34/37 2024-09-21T13:30:59.207 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.3.0-5104.g44178494.el9.x86_64 34/37 2024-09-21T13:30:59.208 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:30:59.208 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T13:30:59.208 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T13:30:59.208 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T13:30:59.208 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:59.688 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.3.0-5104.g44178494.el9.x86_64 35/37 2024-09-21T13:30:59.714 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.3.0-5104.g44178494.el9.x86_64 35/37 2024-09-21T13:30:59.714 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:30:59.714 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T13:30:59.714 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T13:30:59.714 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T13:30:59.715 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:30:59.955 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.3.0-5104.g44178494.el9.x86_64 36/37 2024-09-21T13:30:59.980 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.3.0-5104.g44178494.el9.x86_64 36/37 2024-09-21T13:30:59.981 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:30:59.981 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T13:30:59.981 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T13:30:59.981 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T13:30:59.981 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:00.026 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T13:31:00.026 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:00.026 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:00.027 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:00.027 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:00.027 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:00.027 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:00.028 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:00.028 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T13:31:00.028 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T13:31:00.028 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T13:31:00.028 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T13:31:00.028 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T13:31:00.028 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T13:31:00.028 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T13:31:00.028 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T13:31:00.028 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T13:31:00.029 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T13:31:00.030 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T13:31:00.030 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T13:31:00.030 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T13:31:00.030 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T13:31:00.030 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T13:31:00.030 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T13:31:00.030 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T13:31:00.030 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:00.047 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.3.0-5104.g44178494.el9.x86_64 37/37 2024-09-21T13:31:00.415 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-base 2024-09-21T13:31:01.006 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:01.096 INFO:teuthology.orchestra.run.smithi162.stdout:Package ceph-base-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:01.137 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:01.138 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T13:31:01.138 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:01.228 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install cephadm 2024-09-21T13:31:01.674 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-2:19.3.0-5104.g44178494.el9.x86_64 37/37 2024-09-21T13:31:01.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.3.0-5104.g44178494.el9.x86_64 1/37 2024-09-21T13:31:01.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.3.0-5104.g44178494.el9.x86_64 2/37 2024-09-21T13:31:01.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.3.0-5104.g44178494.el9.x86_64 3/37 2024-09-21T13:31:01.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.3.0-5104.g44178494.el9.x86_64 4/37 2024-09-21T13:31:01.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.3.0-5104.g44178494.el9.x86_64 5/37 2024-09-21T13:31:01.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5104.g44178494.el9. 6/37 2024-09-21T13:31:01.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T13:31:01.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T13:31:01.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T13:31:01.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T13:31:01.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T13:31:01.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T13:31:01.677 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T13:31:01.677 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T13:31:01.677 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T13:31:01.677 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T13:31:01.678 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T13:31:01.678 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T13:31:01.678 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T13:31:01.678 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T13:31:01.678 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T13:31:01.678 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T13:31:01.678 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T13:31:01.678 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T13:31:01.809 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:01.940 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:01.941 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T13:31:01.941 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:01.942 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 784 k 2024-09-21T13:31:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:01.942 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:01.942 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:01.942 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T13:31:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:01.942 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 784 k 2024-09-21T13:31:01.942 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 791 k 2024-09-21T13:31:01.942 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:02.205 INFO:teuthology.orchestra.run.smithi162.stdout:cephadm-19.3.0-5104.g44178494.el9.noarch.rpm 2.9 MB/s | 784 kB 00:00 2024-09-21T13:31:02.206 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:02.206 INFO:teuthology.orchestra.run.smithi162.stdout:Total 2.9 MB/s | 784 kB 00:00 2024-09-21T13:31:02.206 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:02.212 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:02.212 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:02.218 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:02.218 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:02.293 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T13:31:02.556 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T13:31:02.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:02.558 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:02.766 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:02.851 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:02.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-base 2024-09-21T13:31:03.235 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:03.486 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:03.486 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:03.487 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:03.487 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:03.487 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:03.487 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:03.583 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:03.675 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-base-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:03.720 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:03.721 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-21T13:31:03.721 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:03.762 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T13:31:03.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install cephadm 2024-09-21T13:31:04.356 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:04.421 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:04.491 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:04.491 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:04.491 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repo Size 2024-09-21T13:31:04.491 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:04.492 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:04.492 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5104.g44178494.el9 ceph 145 k 2024-09-21T13:31:04.492 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:04.492 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:04.492 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:04.492 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T13:31:04.492 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:04.493 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 145 k 2024-09-21T13:31:04.493 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 432 k 2024-09-21T13:31:04.493 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:04.559 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:04.559 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:04.559 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-21T13:31:04.559 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:04.560 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:31:04.560 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 784 k 2024-09-21T13:31:04.560 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:04.560 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:31:04.560 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:04.560 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-21T13:31:04.560 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:04.560 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 784 k 2024-09-21T13:31:04.560 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 791 k 2024-09-21T13:31:04.561 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:31:04.712 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-immutable-object-cache-19.3.0-5104.g441784 661 kB/s | 145 kB 00:00 2024-09-21T13:31:04.713 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:04.713 INFO:teuthology.orchestra.run.smithi162.stdout:Total 656 kB/s | 145 kB 00:00 2024-09-21T13:31:04.713 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:04.720 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:04.720 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:04.777 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:04.778 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:04.814 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm-19.3.0-5104.g44178494.el9.noarch.rpm 3.0 MB/s | 784 kB 00:00 2024-09-21T13:31:04.815 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:04.815 INFO:teuthology.orchestra.run.smithi002.stdout:Total 3.0 MB/s | 784 kB 00:00 2024-09-21T13:31:04.816 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:31:04.821 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:31:04.821 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:31:04.827 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:31:04.828 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:31:04.905 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:31:04.920 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:04.988 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5104.g44178494. 1/1 2024-09-21T13:31:05.013 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5104.g44178494. 1/1 2024-09-21T13:31:05.013 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:31:05.013 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T13:31:05.013 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:05.317 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:05.413 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:05.962 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5104.g44178494. 1/1 2024-09-21T13:31:05.962 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:05.962 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:05.962 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:05.962 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:05.962 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:06.042 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:06.042 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:06.042 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:31:06.042 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:06.042 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:06.042 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:06.173 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-mgr 2024-09-21T13:31:06.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T13:31:06.774 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:06.863 INFO:teuthology.orchestra.run.smithi162.stdout:Package ceph-mgr-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:06.906 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:06.906 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T13:31:06.907 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:06.924 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:06.987 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T13:31:07.063 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5104.g44178494.el9 ceph 145 k 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 145 k 2024-09-21T13:31:07.064 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 432 k 2024-09-21T13:31:07.065 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:31:07.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-immutable-object-cache-19.3.0-5104.g441784 677 kB/s | 145 kB 00:00 2024-09-21T13:31:07.279 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:07.279 INFO:teuthology.orchestra.run.smithi002.stdout:Total 673 kB/s | 145 kB 00:00 2024-09-21T13:31:07.280 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:31:07.288 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:31:07.288 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:31:07.349 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:31:07.350 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:31:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:31:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5104.g44178494. 1/1 2024-09-21T13:31:07.575 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5104.g44178494. 1/1 2024-09-21T13:31:07.589 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:31:07.590 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T13:31:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:07.711 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 14 M 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 34 k 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 16 k 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T13:31:07.712 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T13:31:07.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T13:31:07.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T13:31:07.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T13:31:07.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T13:31:07.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T13:31:07.713 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:07.713 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:07.713 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:07.713 INFO:teuthology.orchestra.run.smithi162.stdout:Install 12 Packages 2024-09-21T13:31:07.713 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:07.714 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 19 M 2024-09-21T13:31:07.714 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 159 M 2024-09-21T13:31:07.714 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:07.967 INFO:teuthology.orchestra.run.smithi162.stdout:(1/12): ceph-grafana-dashboards-19.3.0-5104.g44 226 kB/s | 34 kB 00:00 2024-09-21T13:31:07.984 INFO:teuthology.orchestra.run.smithi162.stdout:(2/12): ceph-prometheus-alerts-19.3.0-5104.g441 98 kB/s | 16 kB 00:00 2024-09-21T13:31:08.126 INFO:teuthology.orchestra.run.smithi162.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-21T13:31:08.185 INFO:teuthology.orchestra.run.smithi162.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-21T13:31:08.235 INFO:teuthology.orchestra.run.smithi162.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-21T13:31:08.260 INFO:teuthology.orchestra.run.smithi162.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-21T13:31:08.327 INFO:teuthology.orchestra.run.smithi162.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-21T13:31:08.352 INFO:teuthology.orchestra.run.smithi162.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-21T13:31:08.377 INFO:teuthology.orchestra.run.smithi162.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T13:31:08.403 INFO:teuthology.orchestra.run.smithi162.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-21T13:31:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5104.g44178494. 1/1 2024-09-21T13:31:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:08.557 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:31:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:08.557 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:08.562 INFO:teuthology.orchestra.run.smithi162.stdout:(11/12): ceph-mgr-dashboard-19.3.0-5104.g441784 19 MB/s | 14 MB 00:00 2024-09-21T13:31:08.728 INFO:teuthology.orchestra.run.smithi162.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.4 MB/s | 863 kB 00:00 2024-09-21T13:31:08.731 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:08.732 INFO:teuthology.orchestra.run.smithi162.stdout:Total 19 MB/s | 19 MB 00:01 2024-09-21T13:31:08.777 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr 2024-09-21T13:31:08.780 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:08.799 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:08.799 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:09.068 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:09.069 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:09.399 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:09.492 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-mgr-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:09.537 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:09.538 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-21T13:31:09.538 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:09.627 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T13:31:09.678 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:09.763 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T13:31:09.798 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T13:31:09.844 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T13:31:09.883 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T13:31:09.979 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T13:31:10.111 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T13:31:10.205 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T13:31:10.235 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:10.273 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T13:31:10.301 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T13:31:10.333 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5104.g44178494.el9 10/12 2024-09-21T13:31:10.374 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:10.375 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:10.375 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-21T13:31:10.375 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:10.375 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:31:10.375 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 14 M 2024-09-21T13:31:10.375 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-21T13:31:10.375 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 34 k 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 16 k 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:31:10.376 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:10.377 INFO:teuthology.orchestra.run.smithi002.stdout:Install 12 Packages 2024-09-21T13:31:10.377 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:10.377 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 19 M 2024-09-21T13:31:10.377 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 159 M 2024-09-21T13:31:10.377 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:31:10.865 INFO:teuthology.orchestra.run.smithi002.stdout:(1/12): ceph-grafana-dashboards-19.3.0-5104.g44 240 kB/s | 34 kB 00:00 2024-09-21T13:31:10.890 INFO:teuthology.orchestra.run.smithi002.stdout:(2/12): ceph-prometheus-alerts-19.3.0-5104.g441 98 kB/s | 16 kB 00:00 2024-09-21T13:31:11.141 INFO:teuthology.orchestra.run.smithi002.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-21T13:31:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:(4/12): ceph-mgr-dashboard-19.3.0-5104.g4417849 22 MB/s | 14 MB 00:00 2024-09-21T13:31:11.425 INFO:teuthology.orchestra.run.smithi002.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-21T13:31:11.450 INFO:teuthology.orchestra.run.smithi002.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-21T13:31:11.517 INFO:teuthology.orchestra.run.smithi002.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-21T13:31:11.559 INFO:teuthology.orchestra.run.smithi002.stdout:(8/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2024-09-21T13:31:11.600 INFO:teuthology.orchestra.run.smithi002.stdout:(9/12): protobuf-compiler-3.14.0-13.el9.x86_64. 1.8 MB/s | 863 kB 00:00 2024-09-21T13:31:11.626 INFO:teuthology.orchestra.run.smithi002.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.3 MB/s | 144 kB 00:00 2024-09-21T13:31:11.651 INFO:teuthology.orchestra.run.smithi002.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 335 kB/s | 31 kB 00:00 2024-09-21T13:31:11.676 INFO:teuthology.orchestra.run.smithi002.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-09-21T13:31:11.680 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:11.680 INFO:teuthology.orchestra.run.smithi002.stdout:Total 15 MB/s | 19 MB 00:01 2024-09-21T13:31:11.731 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:31:11.752 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:31:11.752 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:31:12.034 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:31:12.034 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:31:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:31:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T13:31:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T13:31:12.828 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T13:31:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T13:31:12.968 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T13:31:13.098 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T13:31:13.198 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T13:31:13.246 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T13:31:13.272 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T13:31:13.305 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5104.g44178494.el9 10/12 2024-09-21T13:31:13.588 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5104.g44178494.el 11/12 2024-09-21T13:31:13.646 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5104.g44178494.el9.noa 12/12 2024-09-21T13:31:15.618 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5104.g44178494.el9.noa 12/12 2024-09-21T13:31:15.618 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5104.g44178494.el 1/12 2024-09-21T13:31:15.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5104.g44178494.el9.noa 2/12 2024-09-21T13:31:15.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5104.g44178494.el9 3/12 2024-09-21T13:31:15.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T13:31:15.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T13:31:15.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T13:31:15.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T13:31:15.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T13:31:15.619 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T13:31:15.620 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T13:31:15.620 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T13:31:15.952 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T13:31:15.952 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:15.952 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:15.952 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T13:31:15.952 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:15.953 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:15.953 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:15.953 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T13:31:15.953 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T13:31:15.953 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T13:31:15.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T13:31:15.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T13:31:15.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T13:31:15.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T13:31:15.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T13:31:15.954 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:15.954 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:16.227 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T13:31:16.737 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5104.g44178494.el 11/12 2024-09-21T13:31:16.784 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5104.g44178494.el9.noa 12/12 2024-09-21T13:31:16.812 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:08 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:16.948 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:16.949 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T13:31:16.949 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T13:31:16.949 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T13:31:16.949 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:16.949 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 7.4 M 2024-09-21T13:31:16.949 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T13:31:16.949 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:16.950 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T13:31:16.951 INFO:teuthology.orchestra.run.smithi162.stdout:Install 12 Packages 2024-09-21T13:31:16.951 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:16.951 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 38 M 2024-09-21T13:31:16.951 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 212 M 2024-09-21T13:31:16.951 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:17.303 INFO:teuthology.orchestra.run.smithi162.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 923 kB/s | 191 kB 00:00 2024-09-21T13:31:17.354 INFO:teuthology.orchestra.run.smithi162.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-09-21T13:31:17.579 INFO:teuthology.orchestra.run.smithi162.stdout:(3/12): ceph-mgr-diskprediction-local-19.3.0-51 15 MB/s | 7.4 MB 00:00 2024-09-21T13:31:17.613 INFO:teuthology.orchestra.run.smithi162.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 801 kB 00:00 2024-09-21T13:31:17.664 INFO:teuthology.orchestra.run.smithi162.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 759 kB/s | 38 kB 00:00 2024-09-21T13:31:17.689 INFO:teuthology.orchestra.run.smithi162.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 166 kB/s | 18 kB 00:00 2024-09-21T13:31:17.864 INFO:teuthology.orchestra.run.smithi162.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-21T13:31:18.281 INFO:teuthology.orchestra.run.smithi162.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.2 MB/s | 3.0 MB 00:00 2024-09-21T13:31:18.365 INFO:teuthology.orchestra.run.smithi162.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-21T13:31:18.599 INFO:teuthology.orchestra.run.smithi162.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 5.3 MB/s | 4.9 MB 00:00 2024-09-21T13:31:18.638 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5104.g44178494.el9.noa 12/12 2024-09-21T13:31:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5104.g44178494.el 1/12 2024-09-21T13:31:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5104.g44178494.el9.noa 2/12 2024-09-21T13:31:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5104.g44178494.el9 3/12 2024-09-21T13:31:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T13:31:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T13:31:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T13:31:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T13:31:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T13:31:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T13:31:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T13:31:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T13:31:18.963 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T13:31:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T13:31:18.965 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T13:31:18.965 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:18.965 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:19.016 INFO:teuthology.orchestra.run.smithi162.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-09-21T13:31:19.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T13:31:19.574 INFO:teuthology.orchestra.run.smithi162.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-21T13:31:19.575 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:19.576 INFO:teuthology.orchestra.run.smithi162.stdout:Total 15 MB/s | 38 MB 00:02 2024-09-21T13:31:19.835 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:08 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:19.931 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:19.957 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:19.957 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:19.974 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:19.975 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-21T13:31:19.975 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-21T13:31:19.975 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-21T13:31:19.975 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:31:19.975 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 7.4 M 2024-09-21T13:31:19.975 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-21T13:31:19.976 INFO:teuthology.orchestra.run.smithi002.stdout:Install 12 Packages 2024-09-21T13:31:19.977 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:19.977 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 38 M 2024-09-21T13:31:19.977 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 212 M 2024-09-21T13:31:19.977 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:31:20.396 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:20.397 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:20.599 INFO:teuthology.orchestra.run.smithi002.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 867 kB/s | 191 kB 00:00 2024-09-21T13:31:20.699 INFO:teuthology.orchestra.run.smithi002.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-21T13:31:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:(3/12): ceph-mgr-diskprediction-local-19.3.0-51 16 MB/s | 7.4 MB 00:00 2024-09-21T13:31:21.172 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:21.249 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T13:31:21.274 INFO:teuthology.orchestra.run.smithi002.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 48 kB/s | 33 kB 00:00 2024-09-21T13:31:21.289 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T13:31:21.341 INFO:teuthology.orchestra.run.smithi002.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 37 kB/s | 18 kB 00:00 2024-09-21T13:31:21.392 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T13:31:21.443 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T13:31:21.635 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T13:31:21.664 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T13:31:21.741 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T13:31:21.833 INFO:teuthology.orchestra.run.smithi002.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2024-09-21T13:31:21.858 INFO:teuthology.orchestra.run.smithi002.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 66 kB/s | 38 kB 00:00 2024-09-21T13:31:22.395 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T13:31:22.459 INFO:teuthology.orchestra.run.smithi002.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.4 MB/s | 4.9 MB 00:01 2024-09-21T13:31:22.504 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T13:31:22.593 INFO:teuthology.orchestra.run.smithi002.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 323 kB/s | 245 kB 00:00 2024-09-21T13:31:22.976 INFO:teuthology.orchestra.run.smithi002.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-21T13:31:23.268 INFO:teuthology.orchestra.run.smithi002.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 310 kB/s | 250 kB 00:00 2024-09-21T13:31:23.773 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T13:31:24.135 INFO:teuthology.orchestra.run.smithi002.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T13:31:24.136 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:24.137 INFO:teuthology.orchestra.run.smithi002.stdout:Total 9.2 MB/s | 38 MB 00:04 2024-09-21T13:31:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:31:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:31:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:31:24.803 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T13:31:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5104.g44178 12/12 2024-09-21T13:31:24.979 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:31:24.979 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:31:25.892 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:31:26.009 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T13:31:26.050 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T13:31:26.154 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T13:31:26.193 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T13:31:26.388 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T13:31:26.416 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T13:31:26.495 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T13:31:27.192 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T13:31:27.317 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T13:31:27.426 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5104.g44178 12/12 2024-09-21T13:31:27.426 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5104.g44178 1/12 2024-09-21T13:31:27.426 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T13:31:27.426 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T13:31:27.426 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T13:31:27.426 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T13:31:27.426 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T13:31:27.427 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T13:31:27.427 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T13:31:27.427 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T13:31:27.427 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T13:31:27.427 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T13:31:27.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T13:31:27.829 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:27.829 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:27.829 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:27.830 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:28.238 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-mgr-rook 2024-09-21T13:31:28.653 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T13:31:28.843 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:20 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:28.977 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:28.978 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:28.978 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T13:31:28.978 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:28.978 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:28.978 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 49 k 2024-09-21T13:31:28.978 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T13:31:28.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T13:31:28.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T13:31:28.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T13:31:28.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T13:31:28.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T13:31:28.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T13:31:28.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T13:31:28.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T13:31:28.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T13:31:28.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T13:31:28.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T13:31:28.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T13:31:28.982 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:28.982 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:28.982 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:28.982 INFO:teuthology.orchestra.run.smithi162.stdout:Install 13 Packages 2024-09-21T13:31:28.982 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:28.983 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 2.2 M 2024-09-21T13:31:28.983 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 26 M 2024-09-21T13:31:28.983 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:29.259 INFO:teuthology.orchestra.run.smithi162.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 240 kB/s | 19 kB 00:00 2024-09-21T13:31:29.284 INFO:teuthology.orchestra.run.smithi162.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 243 kB/s | 26 kB 00:00 2024-09-21T13:31:29.376 INFO:teuthology.orchestra.run.smithi162.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-09-21T13:31:29.401 INFO:teuthology.orchestra.run.smithi162.stdout:(4/13): ceph-mgr-rook-19.3.0-5104.g44178494.el9 221 kB/s | 49 kB 00:00 2024-09-21T13:31:29.426 INFO:teuthology.orchestra.run.smithi162.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-21T13:31:29.452 INFO:teuthology.orchestra.run.smithi162.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-21T13:31:29.477 INFO:teuthology.orchestra.run.smithi162.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-21T13:31:29.527 INFO:teuthology.orchestra.run.smithi162.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-21T13:31:29.553 INFO:teuthology.orchestra.run.smithi162.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-21T13:31:29.578 INFO:teuthology.orchestra.run.smithi162.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T13:31:29.603 INFO:teuthology.orchestra.run.smithi162.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-21T13:31:29.628 INFO:teuthology.orchestra.run.smithi162.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-21T13:31:29.670 INFO:teuthology.orchestra.run.smithi162.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-21T13:31:29.673 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:29.673 INFO:teuthology.orchestra.run.smithi162.stdout:Total 3.2 MB/s | 2.2 MB 00:00 2024-09-21T13:31:29.737 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:29.752 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:29.753 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T13:31:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5104.g44178 12/12 2024-09-21T13:31:29.843 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:29.845 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:30.347 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:30.528 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T13:31:30.589 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T13:31:30.653 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T13:31:30.689 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T13:31:30.731 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T13:31:30.835 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T13:31:30.952 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T13:31:31.008 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T13:31:31.738 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T13:31:31.789 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T13:31:31.823 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T13:31:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T13:31:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.3.0-5104.g44178494.el9.noarch 13/13 2024-09-21T13:31:32.393 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5104.g44178 12/12 2024-09-21T13:31:32.393 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5104.g44178 1/12 2024-09-21T13:31:32.393 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T13:31:32.393 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T13:31:32.393 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T13:31:32.393 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T13:31:32.393 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T13:31:32.393 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T13:31:32.393 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T13:31:32.393 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T13:31:32.394 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T13:31:32.394 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T13:31:32.677 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5104.g44178494.el9.noarch 13/13 2024-09-21T13:31:32.677 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5104.g44178494.el9.noarch 1/13 2024-09-21T13:31:32.677 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T13:31:32.678 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T13:31:32.678 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T13:31:32.678 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T13:31:32.678 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T13:31:32.678 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T13:31:32.678 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T13:31:32.678 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T13:31:32.678 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T13:31:32.678 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T13:31:32.678 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T13:31:32.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T13:31:32.803 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:32.803 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:31:32.803 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:32.803 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T13:31:32.803 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T13:31:32.803 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T13:31:32.803 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T13:31:32.803 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T13:31:32.804 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T13:31:32.804 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T13:31:32.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T13:31:32.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T13:31:32.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T13:31:32.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T13:31:32.804 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:32.804 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:33.015 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T13:31:33.015 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:33.015 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:33.015 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:33.015 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T13:31:33.015 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T13:31:33.015 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T13:31:33.015 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T13:31:33.015 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T13:31:33.016 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T13:31:33.016 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T13:31:33.016 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T13:31:33.016 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T13:31:33.016 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T13:31:33.016 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T13:31:33.016 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T13:31:33.016 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:33.016 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:33.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-rook 2024-09-21T13:31:33.284 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T13:31:33.865 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:25 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:33.892 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:22 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:33.999 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:33.999 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:33.999 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 154 k 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:34.000 INFO:teuthology.orchestra.run.smithi162.stdout:Install 6 Packages 2024-09-21T13:31:34.001 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:34.001 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 7.0 M 2024-09-21T13:31:34.001 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 33 M 2024-09-21T13:31:34.001 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:34.032 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 49 k 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T13:31:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T13:31:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T13:31:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T13:31:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T13:31:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T13:31:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T13:31:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T13:31:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:31:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:Install 13 Packages 2024-09-21T13:31:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:34.036 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 2.2 M 2024-09-21T13:31:34.036 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 26 M 2024-09-21T13:31:34.036 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:31:34.341 INFO:teuthology.orchestra.run.smithi162.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.6 MB/s | 248 kB 00:00 2024-09-21T13:31:34.400 INFO:teuthology.orchestra.run.smithi162.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-21T13:31:34.425 INFO:teuthology.orchestra.run.smithi162.stdout:(3/6): ceph-mgr-cephadm-19.3.0-5104.g44178494.e 660 kB/s | 154 kB 00:00 2024-09-21T13:31:34.451 INFO:teuthology.orchestra.run.smithi162.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T13:31:34.493 INFO:teuthology.orchestra.run.smithi162.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-21T13:31:34.568 INFO:teuthology.orchestra.run.smithi162.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-21T13:31:34.570 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:34.570 INFO:teuthology.orchestra.run.smithi162.stdout:Total 12 MB/s | 7.0 MB 00:00 2024-09-21T13:31:34.640 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:34.641 INFO:teuthology.orchestra.run.smithi002.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 158 kB/s | 19 kB 00:00 2024-09-21T13:31:34.651 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:34.651 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:34.666 INFO:teuthology.orchestra.run.smithi002.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 175 kB/s | 26 kB 00:00 2024-09-21T13:31:34.691 INFO:teuthology.orchestra.run.smithi002.stdout:(3/13): ceph-mgr-rook-19.3.0-5104.g44178494.el9 287 kB/s | 49 kB 00:00 2024-09-21T13:31:34.742 INFO:teuthology.orchestra.run.smithi002.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-21T13:31:34.755 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:34.755 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:34.767 INFO:teuthology.orchestra.run.smithi002.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-21T13:31:34.800 INFO:teuthology.orchestra.run.smithi002.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 279 kB 00:00 2024-09-21T13:31:34.834 INFO:teuthology.orchestra.run.smithi002.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 484 kB/s | 32 kB 00:00 2024-09-21T13:31:34.859 INFO:teuthology.orchestra.run.smithi002.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 249 kB/s | 14 kB 00:00 2024-09-21T13:31:34.893 INFO:teuthology.orchestra.run.smithi002.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 3.8 MB/s | 220 kB 00:00 2024-09-21T13:31:34.918 INFO:teuthology.orchestra.run.smithi002.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T13:31:34.944 INFO:teuthology.orchestra.run.smithi002.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-21T13:31:34.977 INFO:teuthology.orchestra.run.smithi002.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.7 MB/s | 1.0 MB 00:00 2024-09-21T13:31:35.075 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:35.152 INFO:teuthology.orchestra.run.smithi002.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 131 kB/s | 54 kB 00:00 2024-09-21T13:31:35.157 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:35.157 INFO:teuthology.orchestra.run.smithi002.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-09-21T13:31:35.225 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:31:35.242 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:31:35.242 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:31:35.248 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T13:31:35.303 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T13:31:35.343 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:31:35.343 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:31:35.830 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T13:31:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T13:31:35.981 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T13:31:36.007 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5104.g44178494.el9.noarch 6/6 2024-09-21T13:31:36.010 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:31:36.183 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T13:31:36.247 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T13:31:36.311 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T13:31:36.347 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T13:31:36.389 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T13:31:36.505 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T13:31:36.615 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T13:31:36.767 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T13:31:37.051 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5104.g44178494.el9.noarch 6/6 2024-09-21T13:31:37.051 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5104.g44178494.el9.noarch 1/6 2024-09-21T13:31:37.051 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T13:31:37.051 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T13:31:37.051 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T13:31:37.051 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T13:31:37.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T13:31:37.330 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:37.330 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:37.330 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:37.331 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T13:31:37.331 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T13:31:37.331 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T13:31:37.331 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T13:31:37.331 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T13:31:37.331 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:37.331 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:37.547 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T13:31:37.595 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T13:31:37.599 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-fuse 2024-09-21T13:31:37.645 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T13:31:37.695 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T13:31:37.723 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.3.0-5104.g44178494.el9.noarch 13/13 2024-09-21T13:31:38.181 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:38.316 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:38.316 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:38.316 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T13:31:38.316 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:38.316 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:38.316 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.3.0-5104.g44178494.el9 ceph 900 k 2024-09-21T13:31:38.316 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T13:31:38.317 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T13:31:38.317 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:38.317 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:38.317 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:38.317 INFO:teuthology.orchestra.run.smithi162.stdout:Install 2 Packages 2024-09-21T13:31:38.317 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:38.317 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 980 k 2024-09-21T13:31:38.318 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 2.9 M 2024-09-21T13:31:38.318 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:38.496 INFO:teuthology.orchestra.run.smithi162.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 633 kB/s | 80 kB 00:00 2024-09-21T13:31:38.509 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5104.g44178494.el9.noarch 13/13 2024-09-21T13:31:38.509 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5104.g44178494.el9.noarch 1/13 2024-09-21T13:31:38.509 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T13:31:38.509 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T13:31:38.509 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T13:31:38.509 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T13:31:38.509 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T13:31:38.509 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T13:31:38.509 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T13:31:38.509 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T13:31:38.509 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T13:31:38.510 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T13:31:38.510 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T13:31:38.621 INFO:teuthology.orchestra.run.smithi162.stdout:(2/2): ceph-fuse-19.3.0-5104.g44178494.el9.x86_ 3.5 MB/s | 900 kB 00:00 2024-09-21T13:31:38.622 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:38.622 INFO:teuthology.orchestra.run.smithi162.stdout:Total 3.1 MB/s | 980 kB 00:00 2024-09-21T13:31:38.633 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:38.656 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:38.656 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:38.738 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:38.738 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T13:31:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:38.845 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:31:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T13:31:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T13:31:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T13:31:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T13:31:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T13:31:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T13:31:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T13:31:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T13:31:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T13:31:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T13:31:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T13:31:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T13:31:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:38.846 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:38.925 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:39.083 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T13:31:39.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T13:31:39.145 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.3.0-5104.g44178494.el9.x86_64 2/2 2024-09-21T13:31:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:28 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:39.793 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5104.g44178494.el9.x86_64 2/2 2024-09-21T13:31:39.793 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.3.0-5104.g44178494.el9.x86_64 1/2 2024-09-21T13:31:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-21T13:31:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:31:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 154 k 2024-09-21T13:31:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-21T13:31:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T13:31:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T13:31:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T13:31:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T13:31:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T13:31:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:31:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:Install 6 Packages 2024-09-21T13:31:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 7.0 M 2024-09-21T13:31:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 33 M 2024-09-21T13:31:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:31:40.090 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T13:31:40.090 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:40.090 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:40.090 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.3.0-5104.g44178494.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T13:31:40.090 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:40.090 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-21T13:31:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-21T13:31:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-21T13:31:40.296 INFO:teuthology.orchestra.run.smithi002.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-21T13:31:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-21T13:31:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:(6/6): ceph-mgr-cephadm-19.3.0-5104.g44178494.e 424 kB/s | 154 kB 00:00 2024-09-21T13:31:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:Total 13 MB/s | 7.0 MB 00:00 2024-09-21T13:31:40.459 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-volume 2024-09-21T13:31:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:31:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:31:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:31:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:31:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:31:40.928 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:31:41.060 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:41.104 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T13:31:41.175 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T13:31:41.197 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:41.198 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:41.198 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T13:31:41.198 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:41.198 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:41.198 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 287 k 2024-09-21T13:31:41.198 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:41.198 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:41.198 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:41.198 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T13:31:41.199 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:41.199 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 287 k 2024-09-21T13:31:41.199 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 1.4 M 2024-09-21T13:31:41.199 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:41.444 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-volume-19.3.0-5104.g44178494.el9.noarch.rp 1.1 MB/s | 287 kB 00:00 2024-09-21T13:31:41.445 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:41.445 INFO:teuthology.orchestra.run.smithi162.stdout:Total 1.1 MB/s | 287 kB 00:00 2024-09-21T13:31:41.445 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:41.453 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:41.454 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:41.478 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:41.479 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:41.703 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:41.745 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T13:31:41.779 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:41.796 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:41.796 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:31:41.796 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T13:31:41.796 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:41.839 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T13:31:41.916 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T13:31:41.946 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5104.g44178494.el9.noarch 6/6 2024-09-21T13:31:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5104.g44178494.el9.noarch 6/6 2024-09-21T13:31:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5104.g44178494.el9.noarch 1/6 2024-09-21T13:31:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T13:31:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T13:31:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T13:31:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T13:31:42.815 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:42.815 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:42.815 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:42.815 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:42.816 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:42.816 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T13:31:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:31:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T13:31:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T13:31:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T13:31:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T13:31:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T13:31:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:43.145 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install librados-devel 2024-09-21T13:31:43.263 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-fuse 2024-09-21T13:31:43.744 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:32 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:43.878 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:43.878 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:43.878 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repo Size 2024-09-21T13:31:43.879 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:43.879 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:43.879 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.3.0-5104.g44178494.el9 ceph 126 k 2024-09-21T13:31:43.879 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:43.879 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:43.879 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:43.879 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T13:31:43.879 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:43.880 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 126 k 2024-09-21T13:31:43.880 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 456 k 2024-09-21T13:31:43.880 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-21T13:31:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:31:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.3.0-5104.g44178494.el9 ceph 900 k 2024-09-21T13:31:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-21T13:31:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T13:31:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:31:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:Install 2 Packages 2024-09-21T13:31:44.015 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 980 k 2024-09-21T13:31:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 2.9 M 2024-09-21T13:31:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:31:44.075 INFO:teuthology.orchestra.run.smithi162.stdout:librados-devel-19.3.0-5104.g44178494.el9.x86_64 648 kB/s | 126 kB 00:00 2024-09-21T13:31:44.075 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:44.076 INFO:teuthology.orchestra.run.smithi162.stdout:Total 644 kB/s | 126 kB 00:00 2024-09-21T13:31:44.076 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:44.081 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:44.081 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:44.145 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:44.145 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 830 kB/s | 80 kB 00:00 2024-09-21T13:31:44.299 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:44.398 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:(2/2): ceph-fuse-19.3.0-5104.g44178494.el9.x86_ 3.1 MB/s | 900 kB 00:00 2024-09-21T13:31:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:Total 2.3 MB/s | 980 kB 00:00 2024-09-21T13:31:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:31:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:31:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:31:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:31:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:31:44.751 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:31:44.846 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:44.890 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T13:31:44.961 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.3.0-5104.g44178494.el9.x86_64 2/2 2024-09-21T13:31:45.111 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:45.112 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:45.112 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:45.112 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:45.402 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install libcephfs2 2024-09-21T13:31:45.672 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5104.g44178494.el9.x86_64 2/2 2024-09-21T13:31:45.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.3.0-5104.g44178494.el9.x86_64 1/2 2024-09-21T13:31:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T13:31:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:45.969 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:31:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.3.0-5104.g44178494.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T13:31:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:45.969 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:45.990 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:46.081 INFO:teuthology.orchestra.run.smithi162.stdout:Package libcephfs2-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:46.126 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:46.128 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T13:31:46.128 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:46.210 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install libcephfs-devel 2024-09-21T13:31:46.246 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-volume 2024-09-21T13:31:46.816 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:46.867 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:46.960 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:46.961 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:46.961 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repo Size 2024-09-21T13:31:46.961 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:46.961 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:46.961 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.3.0-5104.g44178494.el9 ceph 32 k 2024-09-21T13:31:46.961 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:46.961 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:46.961 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:46.961 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T13:31:46.961 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:46.962 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 32 k 2024-09-21T13:31:46.962 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 142 k 2024-09-21T13:31:46.962 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:47.007 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-21T13:31:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:31:47.008 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.3.0-5104.g44178494.el9 ceph-noarch 287 k 2024-09-21T13:31:47.008 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:31:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-21T13:31:47.008 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 287 k 2024-09-21T13:31:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 1.4 M 2024-09-21T13:31:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:31:47.222 INFO:teuthology.orchestra.run.smithi162.stdout:libcephfs-devel-19.3.0-5104.g44178494.el9.x86_6 122 kB/s | 32 kB 00:00 2024-09-21T13:31:47.223 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:47.223 INFO:teuthology.orchestra.run.smithi162.stdout:Total 121 kB/s | 32 kB 00:00 2024-09-21T13:31:47.224 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:47.228 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:47.228 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:47.247 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:47.247 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:47.329 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:47.427 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:47.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-volume-19.3.0-5104.g44178494.el9.noarch.rp 644 kB/s | 287 kB 00:00 2024-09-21T13:31:47.455 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:47.455 INFO:teuthology.orchestra.run.smithi002.stdout:Total 642 kB/s | 287 kB 00:00 2024-09-21T13:31:47.456 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:31:47.465 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:31:47.465 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:31:47.494 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:31:47.495 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:31:47.724 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:31:47.798 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:47.815 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:47.816 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:31:47.816 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T13:31:47.816 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:47.845 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:48.068 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:48.068 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:48.309 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install librados2 2024-09-21T13:31:48.817 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.3.0-5104.g44178494.el9.noarch 1/1 2024-09-21T13:31:48.817 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:48.817 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:31:48.817 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.3.0-5104.g44178494.el9.noarch 2024-09-21T13:31:48.818 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:48.818 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:48.895 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:48.985 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:49.028 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:49.029 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T13:31:49.029 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:49.110 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install librbd1 2024-09-21T13:31:49.130 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados-devel 2024-09-21T13:31:49.698 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:49.741 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:49.785 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:49.829 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:49.830 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T13:31:49.830 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:49.879 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:49.879 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:49.880 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-21T13:31:49.880 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:49.880 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:31:49.880 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.3.0-5104.g44178494.el9 ceph 126 k 2024-09-21T13:31:49.880 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:49.880 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:31:49.880 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:49.880 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-21T13:31:49.880 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:49.881 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 126 k 2024-09-21T13:31:49.881 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 456 k 2024-09-21T13:31:49.881 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:31:49.913 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install python3-rados 2024-09-21T13:31:50.084 INFO:teuthology.orchestra.run.smithi002.stdout:librados-devel-19.3.0-5104.g44178494.el9.x86_64 623 kB/s | 126 kB 00:00 2024-09-21T13:31:50.085 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:50.085 INFO:teuthology.orchestra.run.smithi002.stdout:Total 617 kB/s | 126 kB 00:00 2024-09-21T13:31:50.085 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:31:50.091 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:31:50.091 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:31:50.159 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:31:50.159 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:31:50.316 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:31:50.419 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:50.501 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:50.591 INFO:teuthology.orchestra.run.smithi162.stdout:Package python3-rados-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:50.636 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:50.637 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T13:31:50.637 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:50.722 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install python3-rgw 2024-09-21T13:31:50.860 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:51.109 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:51.109 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:51.109 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:31:51.109 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:51.109 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:51.110 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:51.300 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:51.388 INFO:teuthology.orchestra.run.smithi162.stdout:Package python3-rgw-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:51.403 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs2 2024-09-21T13:31:51.432 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:51.433 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T13:31:51.433 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:51.523 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install python3-cephfs 2024-09-21T13:31:52.012 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:52.100 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:44 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:52.106 INFO:teuthology.orchestra.run.smithi002.stdout:Package libcephfs2-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:52.152 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:52.153 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-21T13:31:52.153 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:52.188 INFO:teuthology.orchestra.run.smithi162.stdout:Package python3-cephfs-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:52.232 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:52.233 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T13:31:52.233 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:52.234 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs-devel 2024-09-21T13:31:52.321 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install python3-rbd 2024-09-21T13:31:52.839 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:52.904 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:44 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:52.977 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:52.977 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:52.978 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-21T13:31:52.978 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:52.978 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:31:52.978 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.3.0-5104.g44178494.el9 ceph 32 k 2024-09-21T13:31:52.978 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:52.978 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:31:52.978 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:52.978 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-21T13:31:52.978 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:52.979 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 32 k 2024-09-21T13:31:52.979 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 142 k 2024-09-21T13:31:52.979 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:31:52.992 INFO:teuthology.orchestra.run.smithi162.stdout:Package python3-rbd-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:53.036 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:53.037 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-09-21T13:31:53.037 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:53.121 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install rbd-fuse 2024-09-21T13:31:53.137 INFO:teuthology.orchestra.run.smithi002.stdout:libcephfs-devel-19.3.0-5104.g44178494.el9.x86_6 200 kB/s | 32 kB 00:00 2024-09-21T13:31:53.138 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:53.138 INFO:teuthology.orchestra.run.smithi002.stdout:Total 198 kB/s | 32 kB 00:00 2024-09-21T13:31:53.138 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:31:53.142 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:31:53.142 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:31:53.153 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:31:53.154 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:31:53.250 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:31:53.388 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:53.712 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:45 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:53.756 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:53.845 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:53.845 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:53.846 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-21T13:31:53.846 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:53.846 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:53.846 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.3.0-5104.g44178494.el9 ceph 85 k 2024-09-21T13:31:53.846 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:53.846 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:53.846 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:53.846 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T13:31:53.846 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:53.847 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 85 k 2024-09-21T13:31:53.847 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 231 k 2024-09-21T13:31:53.847 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:53.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:53.999 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:53.999 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:31:53.999 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:53.999 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:53.999 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:54.034 INFO:teuthology.orchestra.run.smithi162.stdout:rbd-fuse-19.3.0-5104.g44178494.el9.x86_64.rpm 456 kB/s | 85 kB 00:00 2024-09-21T13:31:54.034 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:54.034 INFO:teuthology.orchestra.run.smithi162.stdout:Total 453 kB/s | 85 kB 00:00 2024-09-21T13:31:54.035 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:54.041 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:54.042 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:54.111 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:54.111 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:54.210 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados2 2024-09-21T13:31:54.309 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:54.406 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:54.809 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:54.821 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:54.915 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:54.961 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-21T13:31:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:55.050 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librbd1 2024-09-21T13:31:55.067 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:55.068 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:55.068 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:55.068 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:55.068 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:55.068 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:55.276 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install rbd-mirror 2024-09-21T13:31:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:44 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:55.756 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:55.803 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:55.804 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-21T13:31:55.804 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:55.865 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:47 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:55.890 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rados 2024-09-21T13:31:55.998 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:55.998 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:55.999 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repo Size 2024-09-21T13:31:55.999 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:55.999 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:55.999 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.3.0-5104.g44178494.el9 ceph 3.2 M 2024-09-21T13:31:55.999 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:55.999 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:55.999 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:55.999 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T13:31:55.999 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:56.000 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 3.2 M 2024-09-21T13:31:56.000 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 14 M 2024-09-21T13:31:56.000 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:56.346 INFO:teuthology.orchestra.run.smithi162.stdout:rbd-mirror-19.3.0-5104.g44178494.el9.x86_64.rpm 9.2 MB/s | 3.2 MB 00:00 2024-09-21T13:31:56.347 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:56.347 INFO:teuthology.orchestra.run.smithi162.stdout:Total 9.2 MB/s | 3.2 MB 00:00 2024-09-21T13:31:56.348 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:56.357 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:56.357 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:56.438 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:56.439 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:56.499 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:45 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:56.591 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rados-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-21T13:31:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:56.737 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rgw 2024-09-21T13:31:56.875 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:56.947 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:56.973 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:56.973 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:31:56.974 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T13:31:56.974 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T13:31:56.974 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T13:31:56.974 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:57.346 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:46 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:57.439 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rgw-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:57.485 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:57.486 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-21T13:31:57.486 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:57.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-cephfs 2024-09-21T13:31:58.102 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:58.102 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:58.102 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:31:58.102 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:31:58.102 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:58.102 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:31:58.176 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:47 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:58.268 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-cephfs-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:58.314 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:58.315 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-21T13:31:58.315 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:58.343 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install rbd-nbd 2024-09-21T13:31:58.403 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rbd 2024-09-21T13:31:58.941 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:50 ago on Sat 21 Sep 2024 01:30:08 PM UTC. 2024-09-21T13:31:59.009 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:48 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:59.074 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.3.0-5104.g44178494.el9 ceph 170 k 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout:Install 1 Package 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 170 k 2024-09-21T13:31:59.075 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 490 k 2024-09-21T13:31:59.076 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T13:31:59.102 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rbd-2:19.3.0-5104.g44178494.el9.x86_64 is already installed. 2024-09-21T13:31:59.148 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:59.149 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-21T13:31:59.149 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:31:59.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-fuse 2024-09-21T13:31:59.268 INFO:teuthology.orchestra.run.smithi162.stdout:rbd-nbd-19.3.0-5104.g44178494.el9.x86_64.rpm 888 kB/s | 170 kB 00:00 2024-09-21T13:31:59.268 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:31:59.269 INFO:teuthology.orchestra.run.smithi162.stdout:Total 880 kB/s | 170 kB 00:00 2024-09-21T13:31:59.269 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T13:31:59.277 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T13:31:59.277 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T13:31:59.349 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T13:31:59.349 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T13:31:59.507 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T13:31:59.616 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:31:59.846 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:48 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:31:59.985 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:31:59.985 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:59.985 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-21T13:31:59.986 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:59.986 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:31:59.986 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.3.0-5104.g44178494.el9 ceph 85 k 2024-09-21T13:31:59.986 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:59.986 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:31:59.986 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:31:59.986 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-21T13:31:59.986 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:31:59.987 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 85 k 2024-09-21T13:31:59.987 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 231 k 2024-09-21T13:31:59.987 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:32:00.107 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:32:00.191 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-fuse-19.3.0-5104.g44178494.el9.x86_64.rpm 418 kB/s | 85 kB 00:00 2024-09-21T13:32:00.191 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:32:00.191 INFO:teuthology.orchestra.run.smithi002.stdout:Total 415 kB/s | 85 kB 00:00 2024-09-21T13:32:00.192 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:32:00.199 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:32:00.199 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:32:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:32:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:32:00.400 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:32:00.400 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:32:00.401 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T13:32:00.401 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:32:00.401 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:32:00.401 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T13:32:00.490 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:32:00.592 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:32:00.657 DEBUG:teuthology.parallel:result is None 2024-09-21T13:32:00.971 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:32:01.242 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:32:01.242 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:32:01.242 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:32:01.242 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:32:01.242 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:32:01.242 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:32:01.525 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-mirror 2024-09-21T13:32:02.149 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:51 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:32:02.289 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:32:02.289 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:32:02.289 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-21T13:32:02.289 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:32:02.289 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:32:02.290 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.3.0-5104.g44178494.el9 ceph 3.2 M 2024-09-21T13:32:02.290 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:32:02.290 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:32:02.290 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:32:02.290 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-21T13:32:02.290 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:32:02.290 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 3.2 M 2024-09-21T13:32:02.290 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 14 M 2024-09-21T13:32:02.291 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:32:02.620 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-mirror-19.3.0-5104.g44178494.el9.x86_64.rpm 9.7 MB/s | 3.2 MB 00:00 2024-09-21T13:32:02.620 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:32:02.621 INFO:teuthology.orchestra.run.smithi002.stdout:Total 9.6 MB/s | 3.2 MB 00:00 2024-09-21T13:32:02.621 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:32:02.631 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:32:02.631 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:32:02.717 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:32:02.718 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:32:03.181 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:32:03.254 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:32:03.281 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:32:03.281 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T13:32:03.281 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T13:32:03.281 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T13:32:03.281 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T13:32:03.281 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:32:04.364 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:32:04.364 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:32:04.365 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:32:04.365 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:32:04.365 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:32:04.365 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:32:04.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-nbd 2024-09-21T13:32:05.209 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:54 ago on Sat 21 Sep 2024 01:30:11 PM UTC. 2024-09-21T13:32:05.347 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-21T13:32:05.348 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:32:05.348 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-21T13:32:05.348 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:32:05.348 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-21T13:32:05.348 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.3.0-5104.g44178494.el9 ceph 170 k 2024-09-21T13:32:05.348 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:32:05.348 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-21T13:32:05.348 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-21T13:32:05.348 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-21T13:32:05.348 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:32:05.349 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 170 k 2024-09-21T13:32:05.349 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 490 k 2024-09-21T13:32:05.349 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-21T13:32:05.723 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-nbd-19.3.0-5104.g44178494.el9.x86_64.rpm 456 kB/s | 170 kB 00:00 2024-09-21T13:32:05.724 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:32:05.724 INFO:teuthology.orchestra.run.smithi002.stdout:Total 454 kB/s | 170 kB 00:00 2024-09-21T13:32:05.724 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-21T13:32:05.733 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-21T13:32:05.733 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-21T13:32:05.809 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-21T13:32:05.809 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-21T13:32:05.976 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-21T13:32:06.091 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:32:06.546 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:32:06.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.3.0-5104.g44178494.el9.x86_64 1/1 2024-09-21T13:32:06.840 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:32:06.840 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-21T13:32:06.840 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.3.0-5104.g44178494.el9.x86_64 2024-09-21T13:32:06.840 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:32:06.840 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-21T13:32:07.089 DEBUG:teuthology.parallel:result is None 2024-09-21T13:32:07.089 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T13:32:07.226 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T13:32:07.248 INFO:teuthology.orchestra.run.smithi002.stdout:19.3.0-5104.g44178494.el9 2024-09-21T13:32:07.248 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5104.g44178494.el9 2024-09-21T13:32:07.248 INFO:teuthology.task.install:The correct ceph version 19.3.0-5104.g44178494 is installed. 2024-09-21T13:32:07.250 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T13:32:07.382 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T13:32:07.407 INFO:teuthology.orchestra.run.smithi162.stdout:19.3.0-5104.g44178494.el9 2024-09-21T13:32:07.408 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5104.g44178494.el9 2024-09-21T13:32:07.408 INFO:teuthology.task.install:The correct ceph version 19.3.0-5104.g44178494 is installed. 2024-09-21T13:32:07.409 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T13:32:07.410 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:32:07.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T13:32:07.437 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:32:07.437 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T13:32:07.477 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T13:32:07.478 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:32:07.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T13:32:07.503 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T13:32:07.569 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:32:07.569 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T13:32:07.597 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T13:32:07.664 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T13:32:07.665 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:32:07.665 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T13:32:07.690 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T13:32:07.755 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:32:07.755 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T13:32:07.782 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T13:32:07.849 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T13:32:07.850 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:32:07.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T13:32:07.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T13:32:07.941 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:32:07.941 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T13:32:07.968 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T13:32:08.035 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T13:32:08.124 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', 'CEPHADM_STRAY_DAEMON'], 'log-only-match': ['CEPHADM_'], 'sha1': '441784946648ff53dd310293f9dd752afeeea72a', 'cephadm_mode': 'cephadm-package'} 2024-09-21T13:32:08.124 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T13:32:08.124 INFO:tasks.cephadm:Cluster fsid is e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:32:08.124 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T13:32:08.124 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.2', 'mon.c': '[v2:172.21.15.2:3301,v1:172.21.15.2:6790]', 'mon.b': '172.21.15.162'} 2024-09-21T13:32:08.125 INFO:tasks.cephadm:First mon is mon.a on smithi002 2024-09-21T13:32:08.125 INFO:tasks.cephadm:First mgr is y 2024-09-21T13:32:08.125 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T13:32:08.125 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2024-09-21T13:32:08.151 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2024-09-21T13:32:08.189 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a on all hosts... 2024-09-21T13:32:08.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a pull 2024-09-21T13:32:08.194 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a pull 2024-09-21T13:32:09.778 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a... 2024-09-21T13:32:09.832 INFO:teuthology.orchestra.run.smithi162.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a... 2024-09-21T13:32:43.815 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-21T13:32:43.815 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)", 2024-09-21T13:32:43.815 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85", 2024-09-21T13:32:43.815 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2024-09-21T13:32:43.815 INFO:teuthology.orchestra.run.smithi002.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5" 2024-09-21T13:32:43.815 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-21T13:32:43.815 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-21T13:32:46.418 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T13:32:46.419 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)", 2024-09-21T13:32:46.419 INFO:teuthology.orchestra.run.smithi162.stdout: "image_id": "b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85", 2024-09-21T13:32:46.419 INFO:teuthology.orchestra.run.smithi162.stdout: "repo_digests": [ 2024-09-21T13:32:46.419 INFO:teuthology.orchestra.run.smithi162.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5" 2024-09-21T13:32:46.419 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-21T13:32:46.419 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T13:32:46.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2024-09-21T13:32:46.481 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2024-09-21T13:32:46.512 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2024-09-21T13:32:46.553 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2024-09-21T13:32:46.579 INFO:tasks.cephadm:Writing seed config... 2024-09-21T13:32:46.580 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T13:32:46.580 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [global] ms bind msgr1 = False 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [global] ms bind msgr2 = True 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [global] ms type = async 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-09-21T13:32:46.581 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T13:32:46.582 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:32:46.582 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T13:32:46.612 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e6144070-781d-11ef-baf6-efdc52797490 mon election default strategy = 1 ms bind msgr1 = False ms bind msgr2 = True ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-09-21T13:32:46.612 DEBUG:teuthology.orchestra.run.smithi002:mon.a> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.a.service 2024-09-21T13:32:46.655 DEBUG:teuthology.orchestra.run.smithi002:mgr.y> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@mgr.y.service 2024-09-21T13:32:46.699 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T13:32:46.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a -v bootstrap --fsid e6144070-781d-11ef-baf6-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T13:32:46.915 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-21T13:32:46.915 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a', '-v', 'bootstrap', '--fsid', 'e6144070-781d-11ef-baf6-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2024-09-21T13:32:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T13:32:46.916 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2024-09-21T13:32:46.939 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-21T13:32:46.939 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2024-09-21T13:32:46.939 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2024-09-21T13:32:46.947 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T13:32:46.947 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T13:32:46.954 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T13:32:46.954 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-21T13:32:46.961 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-21T13:32:46.967 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-21T13:32:46.967 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-21T13:32:46.967 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2024-09-21T13:32:46.991 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-21T13:32:46.991 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T13:32:46.991 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2024-09-21T13:32:46.991 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2024-09-21T13:32:46.997 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T13:32:46.997 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T13:32:47.004 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T13:32:47.004 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-21T13:32:47.011 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-21T13:32:47.017 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-21T13:32:47.017 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-21T13:32:47.018 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2024-09-21T13:32:47.018 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:32:47.018 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 140641558989168 on /run/cephadm/e6144070-781d-11ef-baf6-efdc52797490.lock 2024-09-21T13:32:47.018 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 140641558989168 acquired on /run/cephadm/e6144070-781d-11ef-baf6-efdc52797490.lock 2024-09-21T13:32:47.018 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2024-09-21T13:32:47.018 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2024-09-21T13:32:47.018 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-21T13:32:47.022 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2024-09-21T13:32:47.022 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2024-09-21T13:32:47.024 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T13:32:47.024 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T13:32:47.025 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1760sec hoplimit 64 pref medium 2024-09-21T13:32:47.027 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T13:32:47.027 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T13:32:47.027 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T13:32:47.028 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T13:32:47.028 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-21T13:32:47.028 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T13:32:47.028 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-21T13:32:47.028 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-21T13:32:47.028 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T13:32:47.028 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T13:32:47.029 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a... 2024-09-21T13:32:49.754 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 2024-09-21T13:32:49.754 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a... 2024-09-21T13:32:49.755 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T13:32:49.755 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:d3c61a6c378e0e3b0f2d0c744b48039813ea4b374665619799f973b00e21a218 2024-09-21T13:32:49.755 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T13:32:49.755 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 2024-09-21T13:32:49.755 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T13:32:59.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev) 2024-09-21T13:32:59.148 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev) 2024-09-21T13:32:59.148 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T13:33:01.168 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2024-09-21T13:33:01.169 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2024-09-21T13:33:02.082 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQANy+5mSqAEHhAAR55e1SVWda6bq3pzmqJNsA== 2024-09-21T13:33:03.104 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAOy+5msrnkGhAAGXaa7mRvA0OIEJiZ4J5aDA== 2024-09-21T13:33:04.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAPy+5mIoisGxAAtmE6wSTCFB4EP1RTkGXVwA== 2024-09-21T13:33:04.019 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2024-09-21T13:33:05.133 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T13:33:05.133 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T13:33:05.133 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:33:05.133 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T13:33:05.133 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for a [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T13:33:05.133 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-09-21T13:33:05.133 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:33:05.134 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T13:33:05.134 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:33:05.134 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2024-09-21T13:33:06.651 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.a on 2024-09-21T13:33:06.878 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T13:33:07.027 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T13:33:07.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e6144070-781d-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-e6144070-781d-11ef-baf6-efdc52797490.target. 2024-09-21T13:33:07.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e6144070-781d-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-e6144070-781d-11ef-baf6-efdc52797490.target. 2024-09-21T13:33:07.454 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.a 2024-09-21T13:33:07.454 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.a.service: Unit ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.a.service not loaded. 2024-09-21T13:33:07.629 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e6144070-781d-11ef-baf6-efdc52797490.target.wants/ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.a.service → /etc/systemd/system/ceph-e6144070-781d-11ef-baf6-efdc52797490@.service. 2024-09-21T13:33:08.144 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:08 smithi002 ceph-mon[29600]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T13:33:08.158 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T13:33:08.158 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-21T13:33:08.165 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T13:33:08.165 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-21T13:33:08.166 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-21T13:33:08.166 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T13:33:08.166 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2024-09-21T13:33:08.166 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2024-09-21T13:33:08.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:08 smithi002 bash[29563]: 7fba1fcfb9fca7781a9cf728f2b00d06d0230cfcc676cfb3dd4db137e84fdd6f 2024-09-21T13:33:08.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:08 smithi002 systemd[1]: Started Ceph mon.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:33:09.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T13:33:09.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:33:09.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T13:33:09.138 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:09.138 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2024-09-21T13:33:09.138 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.600937s) 2024-09-21T13:33:09.138 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T13:33:09.138 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T13:33:09.138 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:09.139 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2024-09-21T13:33:09.139 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T13:33:09.139 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T13:33:09.139 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T13:33:09.139 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T13:33:09.139 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:09.139 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.612+0000 7f2c086e3640 1 Processor -- start 2024-09-21T13:33:09.140 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.612+0000 7f2c086e3640 1 -- start start 2024-09-21T13:33:09.140 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.612+0000 7f2c086e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c00106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:09.140 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.612+0000 7f2c086e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00107360 con 0x7f2c00106970 2024-09-21T13:33:09.140 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.613+0000 7f2c0647f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c00106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:09.140 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.613+0000 7f2c0647f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c00106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38766/0 (socket says 172.21.15.2:38766) 2024-09-21T13:33:09.140 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.613+0000 7f2c0647f640 1 -- 172.21.15.2:0/2610871926 learned_addr learned my addr 172.21.15.2:0/2610871926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:09.140 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.613+0000 7f2c0647f640 1 -- 172.21.15.2:0/2610871926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c001074e0 con 0x7f2c00106970 2024-09-21T13:33:09.141 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.615+0000 7f2c0647f640 1 --2- 172.21.15.2:0/2610871926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c00106d70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009820 tx=0x7f2bfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5514097e58a7d7ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:09.141 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.615+0000 7f2c0547d640 1 -- 172.21.15.2:0/2610871926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bfc037070 con 0x7f2c00106970 2024-09-21T13:33:09.141 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.615+0000 7f2c0547d640 1 -- 172.21.15.2:0/2610871926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc032440 con 0x7f2c00106970 2024-09-21T13:33:09.141 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.615+0000 7f2c0547d640 1 -- 172.21.15.2:0/2610871926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bfc032740 con 0x7f2c00106970 2024-09-21T13:33:09.141 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.616+0000 7f2c086e3640 1 -- 172.21.15.2:0/2610871926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 msgr2=0x7f2c00106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:09.141 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.616+0000 7f2c086e3640 1 --2- 172.21.15.2:0/2610871926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c00106d70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009820 tx=0x7f2bfc02a270 comp rx=0 tx=0).stop 2024-09-21T13:33:09.141 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.616+0000 7f2c086e3640 1 -- 172.21.15.2:0/2610871926 shutdown_connections 2024-09-21T13:33:09.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.616+0000 7f2c086e3640 1 --2- 172.21.15.2:0/2610871926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c00106d70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:09.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.616+0000 7f2c086e3640 1 -- 172.21.15.2:0/2610871926 >> 172.21.15.2:0/2610871926 conn(0x7f2c00102280 msgr2=0x7f2c001046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:09.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.616+0000 7f2c086e3640 1 -- 172.21.15.2:0/2610871926 shutdown_connections 2024-09-21T13:33:09.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.616+0000 7f2c086e3640 1 -- 172.21.15.2:0/2610871926 wait complete. 2024-09-21T13:33:09.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.616+0000 7f2c086e3640 1 Processor -- start 2024-09-21T13:33:09.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.616+0000 7f2c086e3640 1 -- start start 2024-09-21T13:33:09.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.616+0000 7f2c086e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c0019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:09.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2c086e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00107e80 con 0x7f2c00106970 2024-09-21T13:33:09.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2c0647f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c0019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:09.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2c0647f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c0019a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38776/0 (socket says 172.21.15.2:38776) 2024-09-21T13:33:09.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2c0647f640 1 -- 172.21.15.2:0/1167239843 learned_addr learned my addr 172.21.15.2:0/1167239843 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:09.144 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2c0647f640 1 -- 172.21.15.2:0/1167239843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0019a6e0 con 0x7f2c00106970 2024-09-21T13:33:09.144 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2c0647f640 1 --2- 172.21.15.2:0/1167239843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c0019a180 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0090b0 tx=0x7f2bfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:09.144 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2bf77fe640 1 -- 172.21.15.2:0/1167239843 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bfc041070 con 0x7f2c00106970 2024-09-21T13:33:09.144 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2bf77fe640 1 -- 172.21.15.2:0/1167239843 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc03c7a0 con 0x7f2c00106970 2024-09-21T13:33:09.144 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2c086e3640 1 -- 172.21.15.2:0/1167239843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0019a970 con 0x7f2c00106970 2024-09-21T13:33:09.144 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2bf77fe640 1 -- 172.21.15.2:0/1167239843 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bfc037040 con 0x7f2c00106970 2024-09-21T13:33:09.144 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2c086e3640 1 -- 172.21.15.2:0/1167239843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0019b330 con 0x7f2c00106970 2024-09-21T13:33:09.145 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.617+0000 7f2bf77fe640 1 -- 172.21.15.2:0/1167239843 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2bfc044070 con 0x7f2c00106970 2024-09-21T13:33:09.145 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.618+0000 7f2bf77fe640 1 -- 172.21.15.2:0/1167239843 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2bfc03d3f0 con 0x7f2c00106970 2024-09-21T13:33:09.145 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.618+0000 7f2c086e3640 1 -- 172.21.15.2:0/1167239843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c00108630 con 0x7f2c00106970 2024-09-21T13:33:09.145 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.621+0000 7f2bf77fe640 1 -- 172.21.15.2:0/1167239843 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2bfc046e20 con 0x7f2c00106970 2024-09-21T13:33:09.145 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.687+0000 7f2c086e3640 1 -- 172.21.15.2:0/1167239843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f2c0019c070 con 0x7f2c00106970 2024-09-21T13:33:09.145 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.687+0000 7f2bf77fe640 1 -- 172.21.15.2:0/1167239843 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f2bfc046450 con 0x7f2c00106970 2024-09-21T13:33:09.145 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.688+0000 7f2c086e3640 1 -- 172.21.15.2:0/1167239843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 msgr2=0x7f2c0019a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:09.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.688+0000 7f2c086e3640 1 --2- 172.21.15.2:0/1167239843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c0019a180 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0090b0 tx=0x7f2bfc0046c0 comp rx=0 tx=0).stop 2024-09-21T13:33:09.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.688+0000 7f2c086e3640 1 -- 172.21.15.2:0/1167239843 shutdown_connections 2024-09-21T13:33:09.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.688+0000 7f2c086e3640 1 --2- 172.21.15.2:0/1167239843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c00106970 0x7f2c0019a180 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:09.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.688+0000 7f2c086e3640 1 -- 172.21.15.2:0/1167239843 >> 172.21.15.2:0/1167239843 conn(0x7f2c00102280 msgr2=0x7f2c00190c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:09.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.688+0000 7f2c086e3640 1 -- 172.21.15.2:0/1167239843 shutdown_connections 2024-09-21T13:33:09.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:08.688+0000 7f2c086e3640 1 -- 172.21.15.2:0/1167239843 wait complete. 2024-09-21T13:33:09.147 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2024-09-21T13:33:09.147 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T13:33:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T13:33:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: monmap epoch 1 2024-09-21T13:33:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:33:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: last_changed 2024-09-21T13:33:04.349460+0000 2024-09-21T13:33:09.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: created 2024-09-21T13:33:04.349460+0000 2024-09-21T13:33:09.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: min_mon_release 19 (squid) 2024-09-21T13:33:09.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: election_strategy: 1 2024-09-21T13:33:09.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-21T13:33:09.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: fsmap 2024-09-21T13:33:09.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T13:33:09.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: mgrmap e1: no daemons active 2024-09-21T13:33:09.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:09 smithi002 ceph-mon[29600]: from='client.? 172.21.15.2:0/1167239843' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T13:33:10.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:10 smithi002 ceph-mon[29600]: from='client.? 172.21.15.2:0/3620065251' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T13:33:10.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:10 smithi002 ceph-mon[29600]: from='client.? 172.21.15.2:0/3620065251' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T13:33:10.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:10.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T13:33:10.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:33:10.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T13:33:10.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-21T13:33:10.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T13:33:10.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T13:33:10.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T13:33:10.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.611+0000 7fbc0f93d640 1 Processor -- start 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.611+0000 7fbc0f93d640 1 -- start start 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.611+0000 7fbc0f93d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc081094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.611+0000 7fbc0f93d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbc08109a30 con 0x7fbc0807ac50 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.612+0000 7fbc0d6d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc081094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.612+0000 7fbc0d6d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc081094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38784/0 (socket says 172.21.15.2:38784) 2024-09-21T13:33:10.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.612+0000 7fbc0d6d9640 1 -- 172.21.15.2:0/898830983 learned_addr learned my addr 172.21.15.2:0/898830983 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.612+0000 7fbc0d6d9640 1 -- 172.21.15.2:0/898830983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc08109bb0 con 0x7fbc0807ac50 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.613+0000 7fbc0d6d9640 1 --2- 172.21.15.2:0/898830983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc081094f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009e80 tx=0x7fbc0002a830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a30a38f15e91d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.613+0000 7fbc07fff640 1 -- 172.21.15.2:0/898830983 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc00036070 con 0x7fbc0807ac50 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.613+0000 7fbc07fff640 1 -- 172.21.15.2:0/898830983 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc00031400 con 0x7fbc0807ac50 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.613+0000 7fbc07fff640 1 -- 172.21.15.2:0/898830983 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc00031700 con 0x7fbc0807ac50 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.613+0000 7fbc0f93d640 1 -- 172.21.15.2:0/898830983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 msgr2=0x7fbc081094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.613+0000 7fbc0f93d640 1 --2- 172.21.15.2:0/898830983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc081094f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009e80 tx=0x7fbc0002a830 comp rx=0 tx=0).stop 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.613+0000 7fbc0f93d640 1 -- 172.21.15.2:0/898830983 shutdown_connections 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.613+0000 7fbc0f93d640 1 --2- 172.21.15.2:0/898830983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc081094f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.613+0000 7fbc0f93d640 1 -- 172.21.15.2:0/898830983 >> 172.21.15.2:0/898830983 conn(0x7fbc08101100 msgr2=0x7fbc08103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.613+0000 7fbc0f93d640 1 -- 172.21.15.2:0/898830983 shutdown_connections 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.613+0000 7fbc0f93d640 1 -- 172.21.15.2:0/898830983 wait complete. 2024-09-21T13:33:10.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.614+0000 7fbc0f93d640 1 Processor -- start 2024-09-21T13:33:10.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.614+0000 7fbc0f93d640 1 -- start start 2024-09-21T13:33:10.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.614+0000 7fbc0f93d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc0819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:10.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.614+0000 7fbc0f93d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0810a130 con 0x7fbc0807ac50 2024-09-21T13:33:10.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.614+0000 7fbc0d6d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc0819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:10.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.614+0000 7fbc0d6d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc0819a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38794/0 (socket says 172.21.15.2:38794) 2024-09-21T13:33:10.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.614+0000 7fbc0d6d9640 1 -- 172.21.15.2:0/3620065251 learned_addr learned my addr 172.21.15.2:0/3620065251 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:10.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.614+0000 7fbc0d6d9640 1 -- 172.21.15.2:0/3620065251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0819a790 con 0x7fbc0807ac50 2024-09-21T13:33:10.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.615+0000 7fbc0d6d9640 1 --2- 172.21.15.2:0/3620065251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc0819a230 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbc00034040 tx=0x7fbc00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:10.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.615+0000 7fbc067fc640 1 -- 172.21.15.2:0/3620065251 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc00041070 con 0x7fbc0807ac50 2024-09-21T13:33:10.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.615+0000 7fbc067fc640 1 -- 172.21.15.2:0/3620065251 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0003c650 con 0x7fbc0807ac50 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.615+0000 7fbc0f93d640 1 -- 172.21.15.2:0/3620065251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc0819aa20 con 0x7fbc0807ac50 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.615+0000 7fbc067fc640 1 -- 172.21.15.2:0/3620065251 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc00036040 con 0x7fbc0807ac50 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.615+0000 7fbc0f93d640 1 -- 172.21.15.2:0/3620065251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc0819b460 con 0x7fbc0807ac50 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.615+0000 7fbc067fc640 1 -- 172.21.15.2:0/3620065251 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbc00044070 con 0x7fbc0807ac50 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.615+0000 7fbc067fc640 1 -- 172.21.15.2:0/3620065251 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbc00046bc0 con 0x7fbc0807ac50 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.616+0000 7fbc0f93d640 1 -- 172.21.15.2:0/3620065251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc08107560 con 0x7fbc0807ac50 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.618+0000 7fbc067fc640 1 -- 172.21.15.2:0/3620065251 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbc0003c950 con 0x7fbc0807ac50 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.679+0000 7fbc0f93d640 1 -- 172.21.15.2:0/3620065251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fbc0819c1b0 con 0x7fbc0807ac50 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.682+0000 7fbc067fc640 1 -- 172.21.15.2:0/3620065251 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+372 (secure 0 0 0) 0x7fbc0003cb30 con 0x7fbc0807ac50 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.683+0000 7fbc067fc640 1 -- 172.21.15.2:0/3620065251 <== mon.0 v2:172.21.15.2:3300/0 8 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fbc00031400 con 0x7fbc0807ac50 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.684+0000 7fbc0f93d640 1 -- 172.21.15.2:0/3620065251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 msgr2=0x7fbc0819a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.684+0000 7fbc0f93d640 1 --2- 172.21.15.2:0/3620065251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc0819a230 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbc00034040 tx=0x7fbc00004a40 comp rx=0 tx=0).stop 2024-09-21T13:33:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.684+0000 7fbc0f93d640 1 -- 172.21.15.2:0/3620065251 shutdown_connections 2024-09-21T13:33:10.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.684+0000 7fbc0f93d640 1 --2- 172.21.15.2:0/3620065251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc0807ac50 0x7fbc0819a230 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:10.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.684+0000 7fbc0f93d640 1 -- 172.21.15.2:0/3620065251 >> 172.21.15.2:0/3620065251 conn(0x7fbc08101100 msgr2=0x7fbc08102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:10.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.684+0000 7fbc0f93d640 1 -- 172.21.15.2:0/3620065251 shutdown_connections 2024-09-21T13:33:10.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:09.684+0000 7fbc0f93d640 1 -- 172.21.15.2:0/3620065251 wait complete. 2024-09-21T13:33:10.270 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2024-09-21T13:33:11.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:11 smithi002 ceph-mon[29600]: from='client.? 172.21.15.2:0/631710807' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:33:11.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.716+0000 7f064afc5640 1 Processor -- start 2024-09-21T13:33:11.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.716+0000 7f064afc5640 1 -- start start 2024-09-21T13:33:11.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.716+0000 7f064afc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f0644106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:11.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.716+0000 7f064afc5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0644107360 con 0x7f0644106970 2024-09-21T13:33:11.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.716+0000 7f0648d61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f0644106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:11.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.716+0000 7f0648d61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f0644106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38800/0 (socket says 172.21.15.2:38800) 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.716+0000 7f0648d61640 1 -- 172.21.15.2:0/468491544 learned_addr learned my addr 172.21.15.2:0/468491544 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.716+0000 7f0648d61640 1 -- 172.21.15.2:0/468491544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06441074e0 con 0x7f0644106970 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.717+0000 7f0648d61640 1 --2- 172.21.15.2:0/468491544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f0644106d70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0638009820 tx=0x7f063802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e645f67c5d5e722e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.717+0000 7f06437fe640 1 -- 172.21.15.2:0/468491544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0638037070 con 0x7f0644106970 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.717+0000 7f06437fe640 1 -- 172.21.15.2:0/468491544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f06380328a0 con 0x7f0644106970 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.717+0000 7f06437fe640 1 -- 172.21.15.2:0/468491544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0638030690 con 0x7f0644106970 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.718+0000 7f064afc5640 1 -- 172.21.15.2:0/468491544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 msgr2=0x7f0644106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.718+0000 7f064afc5640 1 --2- 172.21.15.2:0/468491544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f0644106d70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0638009820 tx=0x7f063802a270 comp rx=0 tx=0).stop 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.718+0000 7f064afc5640 1 -- 172.21.15.2:0/468491544 shutdown_connections 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.718+0000 7f064afc5640 1 --2- 172.21.15.2:0/468491544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f0644106d70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.718+0000 7f064afc5640 1 -- 172.21.15.2:0/468491544 >> 172.21.15.2:0/468491544 conn(0x7f0644102280 msgr2=0x7f06441046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.718+0000 7f064afc5640 1 -- 172.21.15.2:0/468491544 shutdown_connections 2024-09-21T13:33:11.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.718+0000 7f064afc5640 1 -- 172.21.15.2:0/468491544 wait complete. 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.719+0000 7f064afc5640 1 Processor -- start 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.719+0000 7f064afc5640 1 -- start start 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.719+0000 7f064afc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f064419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.719+0000 7f064afc5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f064410adf0 con 0x7f0644106970 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.719+0000 7f0648d61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f064419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.719+0000 7f0648d61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f064419a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38812/0 (socket says 172.21.15.2:38812) 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.719+0000 7f0648d61640 1 -- 172.21.15.2:0/631710807 learned_addr learned my addr 172.21.15.2:0/631710807 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.719+0000 7f0648d61640 1 -- 172.21.15.2:0/631710807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064419ae50 con 0x7f0644106970 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.719+0000 7f0648d61640 1 --2- 172.21.15.2:0/631710807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f064419a8f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0638006f10 tx=0x7f0638032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.720+0000 7f0641ffb640 1 -- 172.21.15.2:0/631710807 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0638037040 con 0x7f0644106970 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.720+0000 7f0641ffb640 1 -- 172.21.15.2:0/631710807 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f0638040070 con 0x7f0644106970 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.720+0000 7f0641ffb640 1 -- 172.21.15.2:0/631710807 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063803a390 con 0x7f0644106970 2024-09-21T13:33:11.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.720+0000 7f064afc5640 1 -- 172.21.15.2:0/631710807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064419b0e0 con 0x7f0644106970 2024-09-21T13:33:11.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.720+0000 7f064afc5640 1 -- 172.21.15.2:0/631710807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f064419baa0 con 0x7f0644106970 2024-09-21T13:33:11.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.720+0000 7f0641ffb640 1 -- 172.21.15.2:0/631710807 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f063803a650 con 0x7f0644106970 2024-09-21T13:33:11.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.720+0000 7f0641ffb640 1 -- 172.21.15.2:0/631710807 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f06380457c0 con 0x7f0644106970 2024-09-21T13:33:11.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.721+0000 7f064afc5640 1 -- 172.21.15.2:0/631710807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0644106df0 con 0x7f0644106970 2024-09-21T13:33:11.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.723+0000 7f0641ffb640 1 -- 172.21.15.2:0/631710807 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0638032830 con 0x7f0644106970 2024-09-21T13:33:11.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.784+0000 7f064afc5640 1 -- 172.21.15.2:0/631710807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f064419c050 con 0x7f0644106970 2024-09-21T13:33:11.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.784+0000 7f0641ffb640 1 -- 172.21.15.2:0/631710807 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f063803b430 con 0x7f0644106970 2024-09-21T13:33:11.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.785+0000 7f064afc5640 1 -- 172.21.15.2:0/631710807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 msgr2=0x7f064419a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:11.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.785+0000 7f064afc5640 1 --2- 172.21.15.2:0/631710807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f064419a8f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0638006f10 tx=0x7f0638032670 comp rx=0 tx=0).stop 2024-09-21T13:33:11.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.785+0000 7f064afc5640 1 -- 172.21.15.2:0/631710807 shutdown_connections 2024-09-21T13:33:11.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.785+0000 7f064afc5640 1 --2- 172.21.15.2:0/631710807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0644106970 0x7f064419a8f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:11.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.785+0000 7f064afc5640 1 -- 172.21.15.2:0/631710807 >> 172.21.15.2:0/631710807 conn(0x7f0644102280 msgr2=0x7f0644102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:11.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.786+0000 7f064afc5640 1 -- 172.21.15.2:0/631710807 shutdown_connections 2024-09-21T13:33:11.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:10.786+0000 7f064afc5640 1 -- 172.21.15.2:0/631710807 wait complete. 2024-09-21T13:33:11.356 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2024-09-21T13:33:11.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:11 smithi002 systemd[1]: Stopping Ceph mon.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:33:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:11 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a[29577]: 2024-09-21T13:33:11.674+0000 7f4002243640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:33:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:11 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a[29577]: 2024-09-21T13:33:11.674+0000 7f4002243640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T13:33:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:11 smithi002 podman[29919]: 2024-09-21 13:33:11.870170244 +0000 UTC m=+0.327131993 container died 7fba1fcfb9fca7781a9cf728f2b00d06d0230cfcc676cfb3dd4db137e84fdd6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T13:33:12.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:12 smithi002 podman[29919]: 2024-09-21 13:33:12.356623467 +0000 UTC m=+0.813585212 container cleanup 7fba1fcfb9fca7781a9cf728f2b00d06d0230cfcc676cfb3dd4db137e84fdd6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T13:33:12.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:12 smithi002 bash[29919]: ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a 2024-09-21T13:33:12.952 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:12 smithi002 podman[29935]: 2024-09-21 13:33:12.59936916 +0000 UTC m=+0.727904401 container remove 7fba1fcfb9fca7781a9cf728f2b00d06d0230cfcc676cfb3dd4db137e84fdd6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T13:33:12.952 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:12 smithi002 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T13:33:12.952 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:12 smithi002 systemd[1]: Stopped Ceph mon.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:33:12.953 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:12 smithi002 systemd[1]: Starting Ceph mon.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:33:13.205 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:12 smithi002 podman[30038]: 2024-09-21 13:33:12.854903179 +0000 UTC m=+0.016238749 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T13:33:13.205 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:12 smithi002 podman[30038]: 2024-09-21 13:33:12.958572529 +0000 UTC m=+0.119908130 container create cd34e73343396fe7019ccefc093fb190257e3587cdef7789e84935193f6da204 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True) 2024-09-21T13:33:13.205 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 podman[30038]: 2024-09-21 13:33:13.177561425 +0000 UTC m=+0.338896996 container init cd34e73343396fe7019ccefc093fb190257e3587cdef7789e84935193f6da204 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:33:13.205 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 podman[30038]: 2024-09-21 13:33:13.18248153 +0000 UTC m=+0.343817092 container start cd34e73343396fe7019ccefc093fb190257e3587cdef7789e84935193f6da204 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T13:33:13.266 INFO:teuthology.orchestra.run.smithi002.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T13:33:13.514 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T13:33:13.514 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev), process ceph-mon, pid 7 2024-09-21T13:33:13.514 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: pidfile_write: ignore empty --pid-file 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: load: jerasure load: lrc 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: RocksDB version: 7.9.2 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Git sha 0 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Compile date 2024-09-21 09:24:23 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: DB SUMMARY 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: DB Session ID: G07KRD8XKOAZ3XSLX5Z3 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: CURRENT file: CURRENT 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 91860 ; 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.error_if_exists: 0 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.create_if_missing: 0 2024-09-21T13:33:13.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.paranoid_checks: 1 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.env: 0x56029a8bf120 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.info_log: 0x56029b1b7700 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.statistics: (nil) 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.use_fsync: 0 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_log_file_size: 0 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T13:33:13.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.allow_fallocate: 1 2024-09-21T13:33:13.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T13:33:13.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T13:33:13.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.use_direct_reads: 0 2024-09-21T13:33:13.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T13:33:13.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T13:33:13.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.db_log_dir: 2024-09-21T13:33:13.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.wal_dir: 2024-09-21T13:33:13.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T13:33:13.518 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T13:33:13.518 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T13:33:13.518 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T13:33:13.518 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T13:33:13.518 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T13:33:13.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T13:33:13.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T13:33:13.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.write_buffer_manager: 0x56029b1bbb80 2024-09-21T13:33:13.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T13:33:13.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T13:33:13.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T13:33:13.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T13:33:13.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T13:33:13.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T13:33:13.520 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T13:33:13.520 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T13:33:13.520 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.unordered_write: 0 2024-09-21T13:33:13.520 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T13:33:13.520 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T13:33:13.520 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T13:33:13.520 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.row_cache: None 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.wal_filter: None 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.two_write_queues: 0 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.wal_compression: 0 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.atomic_flush: 0 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.log_readahead_size: 0 2024-09-21T13:33:13.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_background_jobs: 2 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_background_compactions: -1 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_subcompactions: 1 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T13:33:13.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_open_files: -1 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_background_flushes: -1 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Compression algorithms supported: 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: kZSTD supported: 0 2024-09-21T13:33:13.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: kXpressCompression supported: 0 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: kBZip2Compression supported: 0 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: kLZ4Compression supported: 1 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: kZlibCompression supported: 1 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: kSnappyCompression supported: 1 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.merge_operator: 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_filter: None 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T13:33:13.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56029b1b7320) 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_type: 0 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_index_type: 0 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_shortening: 1 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: checksum: 4 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: no_block_cache: 0 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache: 0x56029b1ab610 2024-09-21T13:33:13.525 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_options: 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: capacity : 536870912 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_shard_bits : 4 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: strict_capacity_limit : 0 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_compressed: (nil) 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: persistent_cache: (nil) 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size: 4096 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size_deviation: 10 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_restart_interval: 16 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_block_restart_interval: 1 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: metadata_block_size: 4096 2024-09-21T13:33:13.526 INFO:journalctl@ceph.mon.a.smithi002.stdout: partition_filters: 0 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: use_delta_encoding: 1 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: filter_policy: bloomfilter 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: whole_key_filtering: 1 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: verify_compression: 0 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: format_version: 5 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_index_compression: 1 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_align: 0 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: max_auto_readahead_size: 262144 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: prepopulate_block_cache: 0 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: initial_auto_readahead_size: 8192 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T13:33:13.527 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compression: NoCompression 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.num_levels: 7 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T13:33:13.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T13:33:13.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T13:33:13.530 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T13:33:13.530 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T13:33:13.530 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T13:33:13.530 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T13:33:13.530 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T13:33:13.530 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T13:33:13.530 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T13:33:13.530 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T13:33:13.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.inplace_update_support: 0 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.bloom_locality: 0 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.max_successive_merges: 0 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T13:33:13.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.ttl: 2592000 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.enable_blob_files: false 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.min_blob_size: 0 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T13:33:13.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bb123bab-b86c-45db-bffd-d67a923d02a1 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726925593209845, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726925593210798, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 88289, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 273, "table_properties": {"data_size": 86357, "index_size": 252, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 10932, "raw_average_key_size": 47, "raw_value_size": 80175, "raw_average_value_size": 345, "num_data_blocks": 11, "num_entries": 232, "num_filter_entries": 232, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726925593, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bb123bab-b86c-45db-bffd-d67a923d02a1", "db_session_id": "G07KRD8XKOAZ3XSLX5Z3", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726925593210898, "job": 1, "event": "recovery_finished"} 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56029b1dae00 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: DB pointer 0x56029b2dc000 2024-09-21T13:33:13.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** DB Stats ** 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: L0 2/0 88.08 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 143.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T13:33:13.535 INFO:journalctl@ceph.mon.a.smithi002.stdout: Sum 2/0 88.08 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 143.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 143.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 143.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T13:33:13.536 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative compaction: 0.00 GB write, 26.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval compaction: 0.00 GB write, 26.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache BinnedLRUCache@0x56029b1ab610#7 capacity: 512.00 MB usage: 1.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: starting mon.a rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: mon.a@-1(???) e1 preinit fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: mon.a@-1(???).mds e1 new map 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: mon.a@-1(???).mds e1 print_map 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout: e1 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout: btime 2024-09-21T13:33:08:087660+0000 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:33:13.537 INFO:journalctl@ceph.mon.a.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:33:13.538 INFO:journalctl@ceph.mon.a.smithi002.stdout: legacy client fscid: -1 2024-09-21T13:33:13.538 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-21T13:33:13.538 INFO:journalctl@ceph.mon.a.smithi002.stdout: No filesystems configured 2024-09-21T13:33:13.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T13:33:13.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T13:33:13.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T13:33:13.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T13:33:13.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T13:33:13.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 bash[30038]: cd34e73343396fe7019ccefc093fb190257e3587cdef7789e84935193f6da204 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 systemd[1]: Started Ceph mon.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: monmap epoch 1 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: last_changed 2024-09-21T13:33:04.349460+0000 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: created 2024-09-21T13:33:04.349460+0000 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: min_mon_release 19 (squid) 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: election_strategy: 1 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: fsmap 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T13:33:13.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:13 smithi002 ceph-mon[30076]: mgrmap e1: no daemons active 2024-09-21T13:33:14.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.723+0000 7fe9bb968640 1 Processor -- start 2024-09-21T13:33:14.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.723+0000 7fe9bb968640 1 -- start start 2024-09-21T13:33:14.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.723+0000 7fe9bb968640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b4105c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:14.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.723+0000 7fe9bb968640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b4106260 con 0x7fe9b4105870 2024-09-21T13:33:14.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.723+0000 7fe9b9704640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b4105c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:14.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.723+0000 7fe9b9704640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b4105c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38816/0 (socket says 172.21.15.2:38816) 2024-09-21T13:33:14.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.723+0000 7fe9b9704640 1 -- 172.21.15.2:0/3134196368 learned_addr learned my addr 172.21.15.2:0/3134196368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:14.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.724+0000 7fe9b9704640 1 -- 172.21.15.2:0/3134196368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b41063e0 con 0x7fe9b4105870 2024-09-21T13:33:14.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.725+0000 7fe9b9704640 1 --2- 172.21.15.2:0/3134196368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b4105c70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009820 tx=0x7fe9b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4472b1667dc259 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:14.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.726+0000 7fe9abfff640 1 -- 172.21.15.2:0/3134196368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9b0037070 con 0x7fe9b4105870 2024-09-21T13:33:14.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.726+0000 7fe9abfff640 1 -- 172.21.15.2:0/3134196368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fe9b00328a0 con 0x7fe9b4105870 2024-09-21T13:33:14.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.726+0000 7fe9abfff640 1 -- 172.21.15.2:0/3134196368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9b0030690 con 0x7fe9b4105870 2024-09-21T13:33:14.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.726+0000 7fe9bb968640 1 -- 172.21.15.2:0/3134196368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 msgr2=0x7fe9b4105c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:14.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.726+0000 7fe9bb968640 1 --2- 172.21.15.2:0/3134196368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b4105c70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009820 tx=0x7fe9b002a270 comp rx=0 tx=0).stop 2024-09-21T13:33:14.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.726+0000 7fe9bb968640 1 -- 172.21.15.2:0/3134196368 shutdown_connections 2024-09-21T13:33:14.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.726+0000 7fe9bb968640 1 --2- 172.21.15.2:0/3134196368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b4105c70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:14.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.726+0000 7fe9bb968640 1 -- 172.21.15.2:0/3134196368 >> 172.21.15.2:0/3134196368 conn(0x7fe9b4101140 msgr2=0x7fe9b4103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:14.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.726+0000 7fe9bb968640 1 -- 172.21.15.2:0/3134196368 shutdown_connections 2024-09-21T13:33:14.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.726+0000 7fe9bb968640 1 -- 172.21.15.2:0/3134196368 wait complete. 2024-09-21T13:33:14.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.727+0000 7fe9bb968640 1 Processor -- start 2024-09-21T13:33:14.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.727+0000 7fe9bb968640 1 -- start start 2024-09-21T13:33:14.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.727+0000 7fe9bb968640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:14.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.727+0000 7fe9bb968640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b4109cf0 con 0x7fe9b4105870 2024-09-21T13:33:14.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.727+0000 7fe9b9704640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:14.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.727+0000 7fe9b9704640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b419a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38832/0 (socket says 172.21.15.2:38832) 2024-09-21T13:33:14.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.727+0000 7fe9b9704640 1 -- 172.21.15.2:0/2525238205 learned_addr learned my addr 172.21.15.2:0/2525238205 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:14.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.728+0000 7fe9b9704640 1 -- 172.21.15.2:0/2525238205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b419ae10 con 0x7fe9b4105870 2024-09-21T13:33:14.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.728+0000 7fe9b9704640 1 --2- 172.21.15.2:0/2525238205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b419a8b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006f10 tx=0x7fe9b0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:14.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.728+0000 7fe9aa7fc640 1 -- 172.21.15.2:0/2525238205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9b0037040 con 0x7fe9b4105870 2024-09-21T13:33:14.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.728+0000 7fe9aa7fc640 1 -- 172.21.15.2:0/2525238205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fe9b0040070 con 0x7fe9b4105870 2024-09-21T13:33:14.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.728+0000 7fe9bb968640 1 -- 172.21.15.2:0/2525238205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b419b0a0 con 0x7fe9b4105870 2024-09-21T13:33:14.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.728+0000 7fe9aa7fc640 1 -- 172.21.15.2:0/2525238205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9b003a390 con 0x7fe9b4105870 2024-09-21T13:33:14.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.728+0000 7fe9bb968640 1 -- 172.21.15.2:0/2525238205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b419ba60 con 0x7fe9b4105870 2024-09-21T13:33:14.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.728+0000 7fe9aa7fc640 1 -- 172.21.15.2:0/2525238205 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe9b003a650 con 0x7fe9b4105870 2024-09-21T13:33:14.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.728+0000 7fe9aa7fc640 1 -- 172.21.15.2:0/2525238205 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe9b0045ae0 con 0x7fe9b4105870 2024-09-21T13:33:14.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.729+0000 7fe9bb968640 1 -- 172.21.15.2:0/2525238205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b4105cf0 con 0x7fe9b4105870 2024-09-21T13:33:14.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.731+0000 7fe9aa7fc640 1 -- 172.21.15.2:0/2525238205 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe9b0032830 con 0x7fe9b4105870 2024-09-21T13:33:14.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.792+0000 7fe9bb968640 1 -- 172.21.15.2:0/2525238205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fe9b419c080 con 0x7fe9b4105870 2024-09-21T13:33:14.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.794+0000 7fe9aa7fc640 1 -- 172.21.15.2:0/2525238205 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fe9b0045460 con 0x7fe9b4105870 2024-09-21T13:33:14.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.795+0000 7fe9bb968640 1 -- 172.21.15.2:0/2525238205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 msgr2=0x7fe9b419a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:14.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.795+0000 7fe9bb968640 1 --2- 172.21.15.2:0/2525238205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b419a8b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006f10 tx=0x7fe9b0032670 comp rx=0 tx=0).stop 2024-09-21T13:33:14.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.795+0000 7fe9bb968640 1 -- 172.21.15.2:0/2525238205 shutdown_connections 2024-09-21T13:33:14.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.795+0000 7fe9bb968640 1 --2- 172.21.15.2:0/2525238205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9b4105870 0x7fe9b419a8b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:14.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.795+0000 7fe9bb968640 1 -- 172.21.15.2:0/2525238205 >> 172.21.15.2:0/2525238205 conn(0x7fe9b4101140 msgr2=0x7fe9b407a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:14.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.795+0000 7fe9bb968640 1 -- 172.21.15.2:0/2525238205 shutdown_connections 2024-09-21T13:33:14.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:13.795+0000 7fe9bb968640 1 -- 172.21.15.2:0/2525238205 wait complete. 2024-09-21T13:33:14.366 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T13:33:14.385 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T13:33:14.385 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2024-09-21T13:33:14.386 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T13:33:14.386 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T13:33:14.897 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e6144070-781d-11ef-baf6-efdc52797490@mgr.y 2024-09-21T13:33:14.897 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e6144070-781d-11ef-baf6-efdc52797490@mgr.y.service: Unit ceph-e6144070-781d-11ef-baf6-efdc52797490@mgr.y.service not loaded. 2024-09-21T13:33:15.065 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e6144070-781d-11ef-baf6-efdc52797490.target.wants/ceph-e6144070-781d-11ef-baf6-efdc52797490@mgr.y.service → /etc/systemd/system/ceph-e6144070-781d-11ef-baf6-efdc52797490@.service. 2024-09-21T13:33:15.080 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2525238205' entity='client.admin' 2024-09-21T13:33:15.351 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:15 smithi002 podman[30312]: 2024-09-21 13:33:15.321005552 +0000 UTC m=+0.138968907 container create e26b0d1e4d277786a6114031c4967061cb8a678efe8f4f0f26666232dc69a2d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:33:15.635 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:15 smithi002 podman[30312]: 2024-09-21 13:33:15.523286001 +0000 UTC m=+0.341249369 container init e26b0d1e4d277786a6114031c4967061cb8a678efe8f4f0f26666232dc69a2d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:33:15.635 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:15 smithi002 podman[30312]: 2024-09-21 13:33:15.528585517 +0000 UTC m=+0.346548878 container start e26b0d1e4d277786a6114031c4967061cb8a678efe8f4f0f26666232dc69a2d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T13:33:15.635 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:15 smithi002 bash[30312]: e26b0d1e4d277786a6114031c4967061cb8a678efe8f4f0f26666232dc69a2d8 2024-09-21T13:33:15.647 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T13:33:15.647 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-21T13:33:15.655 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T13:33:15.656 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-21T13:33:15.656 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-21T13:33:15.656 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T13:33:15.665 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T13:33:15.665 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-21T13:33:15.674 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T13:33:15.674 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-21T13:33:15.675 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-21T13:33:15.675 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T13:33:15.675 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2024-09-21T13:33:15.675 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2024-09-21T13:33:15.914 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:15 smithi002 systemd[1]: Started Ceph mgr.y for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:33:16.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/281446315' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T13:33:16.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:16.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "e6144070-781d-11ef-baf6-efdc52797490", 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T13:33:16.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-21T13:33:16.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-21T13:33:16.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T13:33:16.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:16.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T13:33:16.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T13:33:16.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:16.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T13:33:16.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:16.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T13:33:16.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T13:33:16.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T13:33:16.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T13:33:16.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T13:33:16.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T13:33:16.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:16.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T13:33:08:087660+0000", 2024-09-21T13:33:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:16.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T13:33:08.088342+0000", 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.308+0000 7f061826e640 1 Processor -- start 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.308+0000 7f061826e640 1 -- start start 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.308+0000 7f061826e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610105c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.308+0000 7f061826e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0610106260 con 0x7f0610105870 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.309+0000 7f061600a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610105c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.309+0000 7f061600a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610105c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60828/0 (socket says 172.21.15.2:60828) 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.309+0000 7f061600a640 1 -- 172.21.15.2:0/2525588756 learned_addr learned my addr 172.21.15.2:0/2525588756 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.309+0000 7f061600a640 1 -- 172.21.15.2:0/2525588756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06101063e0 con 0x7f0610105870 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.310+0000 7f061600a640 1 --2- 172.21.15.2:0/2525588756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610105c70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f060c009820 tx=0x7f060c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c8e7370e6651b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:16.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.310+0000 7f0615008640 1 -- 172.21.15.2:0/2525588756 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f060c037070 con 0x7f0610105870 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.310+0000 7f0615008640 1 -- 172.21.15.2:0/2525588756 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f060c0328a0 con 0x7f0610105870 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.310+0000 7f0615008640 1 -- 172.21.15.2:0/2525588756 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f060c030690 con 0x7f0610105870 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.310+0000 7f061826e640 1 -- 172.21.15.2:0/2525588756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 msgr2=0x7f0610105c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.310+0000 7f061826e640 1 --2- 172.21.15.2:0/2525588756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610105c70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f060c009820 tx=0x7f060c02a270 comp rx=0 tx=0).stop 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061826e640 1 -- 172.21.15.2:0/2525588756 shutdown_connections 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061826e640 1 --2- 172.21.15.2:0/2525588756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610105c70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061826e640 1 -- 172.21.15.2:0/2525588756 >> 172.21.15.2:0/2525588756 conn(0x7f06101011c0 msgr2=0x7f06101035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061826e640 1 -- 172.21.15.2:0/2525588756 shutdown_connections 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061826e640 1 -- 172.21.15.2:0/2525588756 wait complete. 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061826e640 1 Processor -- start 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061826e640 1 -- start start 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061826e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610079fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061826e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0610109cf0 con 0x7f0610105870 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061600a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610079fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061600a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610079fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60832/0 (socket says 172.21.15.2:60832) 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.311+0000 7f061600a640 1 -- 172.21.15.2:0/281446315 learned_addr learned my addr 172.21.15.2:0/281446315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.312+0000 7f061600a640 1 -- 172.21.15.2:0/281446315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f061007a4e0 con 0x7f0610105870 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.312+0000 7f061600a640 1 --2- 172.21.15.2:0/281446315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610079fa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f060c000c00 tx=0x7f060c032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.312+0000 7f06077fe640 1 -- 172.21.15.2:0/281446315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f060c037040 con 0x7f0610105870 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.312+0000 7f06077fe640 1 -- 172.21.15.2:0/281446315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f060c040070 con 0x7f0610105870 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.312+0000 7f061826e640 1 -- 172.21.15.2:0/281446315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f061019f9d0 con 0x7f0610105870 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.312+0000 7f06077fe640 1 -- 172.21.15.2:0/281446315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f060c03be40 con 0x7f0610105870 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.312+0000 7f061826e640 1 -- 172.21.15.2:0/281446315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f061019fd70 con 0x7f0610105870 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.312+0000 7f06077fe640 1 -- 172.21.15.2:0/281446315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f060c045460 con 0x7f0610105870 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.312+0000 7f06077fe640 1 -- 172.21.15.2:0/281446315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f060c044780 con 0x7f0610105870 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.313+0000 7f061826e640 1 -- 172.21.15.2:0/281446315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0610105cf0 con 0x7f0610105870 2024-09-21T13:33:16.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.315+0000 7f06077fe640 1 -- 172.21.15.2:0/281446315 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f060c03b430 con 0x7f0610105870 2024-09-21T13:33:16.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.379+0000 7f061826e640 1 -- 172.21.15.2:0/281446315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f061019ffa0 con 0x7f0610105870 2024-09-21T13:33:16.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.380+0000 7f06077fe640 1 -- 172.21.15.2:0/281446315 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f060c03b680 con 0x7f0610105870 2024-09-21T13:33:16.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.380+0000 7f061826e640 1 -- 172.21.15.2:0/281446315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 msgr2=0x7f0610079fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:16.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.380+0000 7f061826e640 1 --2- 172.21.15.2:0/281446315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610079fa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f060c000c00 tx=0x7f060c032740 comp rx=0 tx=0).stop 2024-09-21T13:33:16.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.380+0000 7f061826e640 1 -- 172.21.15.2:0/281446315 shutdown_connections 2024-09-21T13:33:16.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.380+0000 7f061826e640 1 --2- 172.21.15.2:0/281446315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0610105870 0x7f0610079fa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:16.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.381+0000 7f061826e640 1 -- 172.21.15.2:0/281446315 >> 172.21.15.2:0/281446315 conn(0x7f06101011c0 msgr2=0x7f0610101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:16.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.381+0000 7f061826e640 1 -- 172.21.15.2:0/281446315 shutdown_connections 2024-09-21T13:33:16.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:16.381+0000 7f061826e640 1 -- 172.21.15.2:0/281446315 wait complete. 2024-09-21T13:33:16.975 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2024-09-21T13:33:19.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2007770753' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T13:33:20.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:20.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-21T13:33:20.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "e6144070-781d-11ef-baf6-efdc52797490", 2024-09-21T13:33:20.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T13:33:20.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T13:33:20.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T13:33:20.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T13:33:20.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:20.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T13:33:20.151 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T13:33:08:087660+0000", 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T13:33:20.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T13:33:08.088342+0000", 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-21T13:33:20.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.443+0000 7fa81dd93640 1 Processor -- start 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.443+0000 7fa81dd93640 1 -- start start 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.443+0000 7fa81dd93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa818109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.443+0000 7fa81dd93640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa818109a70 con 0x7fa81807a430 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.443+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa818109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.443+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa818109530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60834/0 (socket says 172.21.15.2:60834) 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.443+0000 7fa8177fe640 1 -- 172.21.15.2:0/2914377364 learned_addr learned my addr 172.21.15.2:0/2914377364 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.443+0000 7fa8177fe640 1 -- 172.21.15.2:0/2914377364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa818109bf0 con 0x7fa81807a430 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.444+0000 7fa8177fe640 1 --2- 172.21.15.2:0/2914377364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa818109530 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa808009820 tx=0x7fa80802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98bc1ab06833788 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.444+0000 7fa8167fc640 1 -- 172.21.15.2:0/2914377364 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa808037070 con 0x7fa81807a430 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.444+0000 7fa8167fc640 1 -- 172.21.15.2:0/2914377364 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fa8080328a0 con 0x7fa81807a430 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.444+0000 7fa8167fc640 1 -- 172.21.15.2:0/2914377364 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa808030710 con 0x7fa81807a430 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.445+0000 7fa81dd93640 1 -- 172.21.15.2:0/2914377364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 msgr2=0x7fa818109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:20.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.445+0000 7fa81dd93640 1 --2- 172.21.15.2:0/2914377364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa818109530 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa808009820 tx=0x7fa80802a300 comp rx=0 tx=0).stop 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.445+0000 7fa81dd93640 1 -- 172.21.15.2:0/2914377364 shutdown_connections 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.445+0000 7fa81dd93640 1 --2- 172.21.15.2:0/2914377364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa818109530 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.445+0000 7fa81dd93640 1 -- 172.21.15.2:0/2914377364 >> 172.21.15.2:0/2914377364 conn(0x7fa8181011c0 msgr2=0x7fa8181035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.445+0000 7fa81dd93640 1 -- 172.21.15.2:0/2914377364 shutdown_connections 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.445+0000 7fa81dd93640 1 -- 172.21.15.2:0/2914377364 wait complete. 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.446+0000 7fa81dd93640 1 Processor -- start 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.446+0000 7fa81dd93640 1 -- start start 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.446+0000 7fa81dd93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa81819a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.446+0000 7fa81dd93640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa81810acb0 con 0x7fa81807a430 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.446+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa81819a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.446+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa81819a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60838/0 (socket says 172.21.15.2:60838) 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.446+0000 7fa8177fe640 1 -- 172.21.15.2:0/2007770753 learned_addr learned my addr 172.21.15.2:0/2007770753 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.446+0000 7fa8177fe640 1 -- 172.21.15.2:0/2007770753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81819ae30 con 0x7fa81807a430 2024-09-21T13:33:20.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.447+0000 7fa8177fe640 1 --2- 172.21.15.2:0/2007770753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa81819a8d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa808000c00 tx=0x7fa808030800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.447+0000 7fa814ff9640 1 -- 172.21.15.2:0/2007770753 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa808037040 con 0x7fa81807a430 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.447+0000 7fa814ff9640 1 -- 172.21.15.2:0/2007770753 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fa808040070 con 0x7fa81807a430 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.447+0000 7fa81dd93640 1 -- 172.21.15.2:0/2007770753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa81819b0c0 con 0x7fa81807a430 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.447+0000 7fa814ff9640 1 -- 172.21.15.2:0/2007770753 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa80803bdf0 con 0x7fa81807a430 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.447+0000 7fa81dd93640 1 -- 172.21.15.2:0/2007770753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa81819ba80 con 0x7fa81807a430 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.447+0000 7fa814ff9640 1 -- 172.21.15.2:0/2007770753 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa808045460 con 0x7fa81807a430 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.447+0000 7fa814ff9640 1 -- 172.21.15.2:0/2007770753 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa808044730 con 0x7fa81807a430 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.448+0000 7fa81dd93640 1 -- 172.21.15.2:0/2007770753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8181075a0 con 0x7fa81807a430 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.450+0000 7fa814ff9640 1 -- 172.21.15.2:0/2007770753 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa80803b630 con 0x7fa81807a430 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.514+0000 7fa81dd93640 1 -- 172.21.15.2:0/2007770753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa81819c000 con 0x7fa81807a430 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.515+0000 7fa814ff9640 1 -- 172.21.15.2:0/2007770753 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fa80803b810 con 0x7fa81807a430 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.516+0000 7fa81dd93640 1 -- 172.21.15.2:0/2007770753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 msgr2=0x7fa81819a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.516+0000 7fa81dd93640 1 --2- 172.21.15.2:0/2007770753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa81819a8d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa808000c00 tx=0x7fa808030800 comp rx=0 tx=0).stop 2024-09-21T13:33:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.516+0000 7fa81dd93640 1 -- 172.21.15.2:0/2007770753 shutdown_connections 2024-09-21T13:33:20.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.516+0000 7fa81dd93640 1 --2- 172.21.15.2:0/2007770753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa81807a430 0x7fa81819a8d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:20.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.516+0000 7fa81dd93640 1 -- 172.21.15.2:0/2007770753 >> 172.21.15.2:0/2007770753 conn(0x7fa8181011c0 msgr2=0x7fa818101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:20.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.516+0000 7fa81dd93640 1 -- 172.21.15.2:0/2007770753 shutdown_connections 2024-09-21T13:33:20.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:19.516+0000 7fa81dd93640 1 -- 172.21.15.2:0/2007770753 wait complete. 2024-09-21T13:33:20.157 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2024-09-21T13:33:21.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: Activating manager daemon y 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: mgrmap e2: y(active, starting, since 0.00335065s) 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: from='mgr.14100 172.21.15.2:0/667243429' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: from='mgr.14100 172.21.15.2:0/667243429' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: from='mgr.14100 172.21.15.2:0/667243429' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: from='mgr.14100 172.21.15.2:0/667243429' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: from='mgr.14100 172.21.15.2:0/667243429' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: Manager daemon y is now available 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: from='mgr.14100 172.21.15.2:0/667243429' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: from='mgr.14100 172.21.15.2:0/667243429' entity='mgr.y' 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: from='mgr.14100 172.21.15.2:0/667243429' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: from='mgr.14100 172.21.15.2:0/667243429' entity='mgr.y' 2024-09-21T13:33:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:20 smithi002 ceph-mon[30076]: from='mgr.14100 172.21.15.2:0/667243429' entity='mgr.y' 2024-09-21T13:33:23.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:22 smithi002 ceph-mon[30076]: mgrmap e3: y(active, since 1.00825s) 2024-09-21T13:33:23.532 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:23.532 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-21T13:33:23.533 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "e6144070-781d-11ef-baf6-efdc52797490", 2024-09-21T13:33:23.533 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T13:33:23.533 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T13:33:23.533 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T13:33:23.533 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T13:33:23.533 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:23.533 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T13:33:23.533 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T13:33:23.533 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-21T13:33:23.533 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-21T13:33:23.533 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T13:33:23.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T13:33:23.535 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T13:33:23.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T13:33:23.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T13:33:23.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T13:33:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T13:33:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T13:33:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T13:33:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T13:33:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T13:33:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T13:33:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T13:33:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T13:33:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T13:33:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T13:33:08:087660+0000", 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T13:33:23.548 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T13:33:23.549 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T13:33:23.549 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-21T13:33:23.549 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T13:33:23.549 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:23.549 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T13:33:23.549 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T13:33:23.549 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T13:33:08.088342+0000", 2024-09-21T13:33:23.549 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T13:33:23.549 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-21T13:33:23.549 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T13:33:23.549 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-21T13:33:23.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.599+0000 7f99fe71f640 1 Processor -- start 2024-09-21T13:33:23.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.600+0000 7f99fe71f640 1 -- start start 2024-09-21T13:33:23.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.600+0000 7f99fe71f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f81095b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:23.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.600+0000 7f99fe71f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f99f8109af0 con 0x7f99f807a3b0 2024-09-21T13:33:23.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.600+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f81095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:23.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.600+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f81095b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60908/0 (socket says 172.21.15.2:60908) 2024-09-21T13:33:23.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.600+0000 7f99f7fff640 1 -- 172.21.15.2:0/3046852224 learned_addr learned my addr 172.21.15.2:0/3046852224 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:23.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.600+0000 7f99f7fff640 1 -- 172.21.15.2:0/3046852224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f8109c70 con 0x7f99f807a3b0 2024-09-21T13:33:23.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.601+0000 7f99f7fff640 1 --2- 172.21.15.2:0/3046852224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f81095b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009820 tx=0x7f99e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4505151b904a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:23.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.601+0000 7f99f77fe640 1 -- 172.21.15.2:0/3046852224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99e8037070 con 0x7f99f807a3b0 2024-09-21T13:33:23.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.601+0000 7f99f77fe640 1 -- 172.21.15.2:0/3046852224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f99e80328a0 con 0x7f99f807a3b0 2024-09-21T13:33:23.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.601+0000 7f99f77fe640 1 -- 172.21.15.2:0/3046852224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99e8030690 con 0x7f99f807a3b0 2024-09-21T13:33:23.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.602+0000 7f99fe71f640 1 -- 172.21.15.2:0/3046852224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 msgr2=0x7f99f81095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:23.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.602+0000 7f99fe71f640 1 --2- 172.21.15.2:0/3046852224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f81095b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009820 tx=0x7f99e802a270 comp rx=0 tx=0).stop 2024-09-21T13:33:23.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.602+0000 7f99fe71f640 1 -- 172.21.15.2:0/3046852224 shutdown_connections 2024-09-21T13:33:23.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.602+0000 7f99fe71f640 1 --2- 172.21.15.2:0/3046852224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f81095b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:23.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.602+0000 7f99fe71f640 1 -- 172.21.15.2:0/3046852224 >> 172.21.15.2:0/3046852224 conn(0x7f99f81011c0 msgr2=0x7f99f81035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:23.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.602+0000 7f99fe71f640 1 -- 172.21.15.2:0/3046852224 shutdown_connections 2024-09-21T13:33:23.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.602+0000 7f99fe71f640 1 -- 172.21.15.2:0/3046852224 wait complete. 2024-09-21T13:33:23.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.602+0000 7f99fe71f640 1 Processor -- start 2024-09-21T13:33:23.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.602+0000 7f99fe71f640 1 -- start start 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99fe71f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f819caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99fe71f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f99f810acd0 con 0x7f99f807a3b0 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f819caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f819caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60918/0 (socket says 172.21.15.2:60918) 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99f7fff640 1 -- 172.21.15.2:0/2901961168 learned_addr learned my addr 172.21.15.2:0/2901961168 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99f7fff640 1 -- 172.21.15.2:0/2901961168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f819d000 con 0x7f99f807a3b0 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99f7fff640 1 --2- 172.21.15.2:0/2901961168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f819caa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f99e8000c00 tx=0x7f99e8032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99f5ffb640 1 -- 172.21.15.2:0/2901961168 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99e8037040 con 0x7f99f807a3b0 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99f5ffb640 1 -- 172.21.15.2:0/2901961168 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f99e8040070 con 0x7f99f807a3b0 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99f5ffb640 1 -- 172.21.15.2:0/2901961168 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99e803be40 con 0x7f99f807a3b0 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99fe71f640 1 -- 172.21.15.2:0/2901961168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f819d290 con 0x7f99f807a3b0 2024-09-21T13:33:23.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.603+0000 7f99fe71f640 1 -- 172.21.15.2:0/2901961168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f819dc50 con 0x7f99f807a3b0 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.604+0000 7f99f5ffb640 1 -- 172.21.15.2:0/2901961168 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 3) ==== 51690+0+0 (secure 0 0 0) 0x7f99e803b680 con 0x7f99f807a3b0 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.604+0000 7f99fe71f640 1 -- 172.21.15.2:0/2901961168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f8107620 con 0x7f99f807a3b0 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.605+0000 7f99f5ffb640 1 --2- 172.21.15.2:0/2901961168 >> v2:172.21.15.2:6800/3091351943 conn(0x7f99e403f760 0x7f99e4041c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.605+0000 7f99f5ffb640 1 -- 172.21.15.2:0/2901961168 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f99e8073b90 con 0x7f99f807a3b0 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.605+0000 7f99effff640 1 --2- 172.21.15.2:0/2901961168 >> v2:172.21.15.2:6800/3091351943 conn(0x7f99e403f760 0x7f99e4041c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.605+0000 7f99effff640 1 --2- 172.21.15.2:0/2901961168 >> v2:172.21.15.2:6800/3091351943 conn(0x7f99e403f760 0x7f99e4041c20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f99e00098c0 tx=0x7f99e0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.610+0000 7f99f5ffb640 1 -- 172.21.15.2:0/2901961168 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99e8036170 con 0x7f99f807a3b0 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.797+0000 7f99f5ffb640 1 -- 172.21.15.2:0/2901961168 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 4) ==== 51796+0+0 (secure 0 0 0) 0x7f99e8045460 con 0x7f99f807a3b0 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.871+0000 7f99fe71f640 1 -- 172.21.15.2:0/2901961168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f99f819e370 con 0x7f99f807a3b0 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.872+0000 7f99f5ffb640 1 -- 172.21.15.2:0/2901961168 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f99e8072e80 con 0x7f99f807a3b0 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.874+0000 7f99fe71f640 1 -- 172.21.15.2:0/2901961168 >> v2:172.21.15.2:6800/3091351943 conn(0x7f99e403f760 msgr2=0x7f99e4041c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:23.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.874+0000 7f99fe71f640 1 --2- 172.21.15.2:0/2901961168 >> v2:172.21.15.2:6800/3091351943 conn(0x7f99e403f760 0x7f99e4041c20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f99e00098c0 tx=0x7f99e0006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:23.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.874+0000 7f99fe71f640 1 -- 172.21.15.2:0/2901961168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 msgr2=0x7f99f819caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:23.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.874+0000 7f99fe71f640 1 --2- 172.21.15.2:0/2901961168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f819caa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f99e8000c00 tx=0x7f99e8032740 comp rx=0 tx=0).stop 2024-09-21T13:33:23.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.874+0000 7f99fe71f640 1 -- 172.21.15.2:0/2901961168 shutdown_connections 2024-09-21T13:33:23.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.874+0000 7f99fe71f640 1 --2- 172.21.15.2:0/2901961168 >> v2:172.21.15.2:6800/3091351943 conn(0x7f99e403f760 0x7f99e4041c20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:23.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.874+0000 7f99fe71f640 1 --2- 172.21.15.2:0/2901961168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f807a3b0 0x7f99f819caa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:23.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.874+0000 7f99fe71f640 1 -- 172.21.15.2:0/2901961168 >> 172.21.15.2:0/2901961168 conn(0x7f99f81011c0 msgr2=0x7f99f8101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:23.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.874+0000 7f99fe71f640 1 -- 172.21.15.2:0/2901961168 shutdown_connections 2024-09-21T13:33:23.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:22.874+0000 7f99fe71f640 1 -- 172.21.15.2:0/2901961168 wait complete. 2024-09-21T13:33:23.554 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2024-09-21T13:33:24.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:23 smithi002 ceph-mon[30076]: mgrmap e4: y(active, since 2s) 2024-09-21T13:33:24.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2901961168' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T13:33:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.996+0000 7fbb8129b640 1 Processor -- start 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.996+0000 7fbb8129b640 1 -- start start 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.997+0000 7fbb8129b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.997+0000 7fbb8129b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c109a70 con 0x7fbb7c07a430 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.997+0000 7fbb7affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.997+0000 7fbb7affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c109530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60924/0 (socket says 172.21.15.2:60924) 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.997+0000 7fbb7affd640 1 -- 172.21.15.2:0/1032962974 learned_addr learned my addr 172.21.15.2:0/1032962974 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.997+0000 7fbb7affd640 1 -- 172.21.15.2:0/1032962974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7c109bf0 con 0x7fbb7c07a430 2024-09-21T13:33:24.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.998+0000 7fbb7affd640 1 --2- 172.21.15.2:0/1032962974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c109530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009820 tx=0x7fbb6c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec69bb55f170ed7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.998+0000 7fbb79ffb640 1 -- 172.21.15.2:0/1032962974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb6c037070 con 0x7fbb7c07a430 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.998+0000 7fbb79ffb640 1 -- 172.21.15.2:0/1032962974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fbb6c0328a0 con 0x7fbb7c07a430 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.998+0000 7fbb79ffb640 1 -- 172.21.15.2:0/1032962974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb6c030710 con 0x7fbb7c07a430 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.998+0000 7fbb8129b640 1 -- 172.21.15.2:0/1032962974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 msgr2=0x7fbb7c109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.998+0000 7fbb8129b640 1 --2- 172.21.15.2:0/1032962974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c109530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009820 tx=0x7fbb6c02a300 comp rx=0 tx=0).stop 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.998+0000 7fbb8129b640 1 -- 172.21.15.2:0/1032962974 shutdown_connections 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.998+0000 7fbb8129b640 1 --2- 172.21.15.2:0/1032962974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c109530 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.999+0000 7fbb8129b640 1 -- 172.21.15.2:0/1032962974 >> 172.21.15.2:0/1032962974 conn(0x7fbb7c1011c0 msgr2=0x7fbb7c1035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.999+0000 7fbb8129b640 1 -- 172.21.15.2:0/1032962974 shutdown_connections 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.999+0000 7fbb8129b640 1 -- 172.21.15.2:0/1032962974 wait complete. 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.999+0000 7fbb8129b640 1 Processor -- start 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.999+0000 7fbb8129b640 1 -- start start 2024-09-21T13:33:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:23.999+0000 7fbb8129b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c106b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.000+0000 7fbb8129b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c10acb0 con 0x7fbb7c07a430 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.000+0000 7fbb7affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.000+0000 7fbb7affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60930/0 (socket says 172.21.15.2:60930) 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.000+0000 7fbb7affd640 1 -- 172.21.15.2:0/3324942615 learned_addr learned my addr 172.21.15.2:0/3324942615 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.000+0000 7fbb7affd640 1 -- 172.21.15.2:0/3324942615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7c1070e0 con 0x7fbb7c07a430 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.000+0000 7fbb7affd640 1 --2- 172.21.15.2:0/3324942615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c106b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c000c00 tx=0x7fbb6c030800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.000+0000 7fbb63fff640 1 -- 172.21.15.2:0/3324942615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb6c037040 con 0x7fbb7c07a430 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.000+0000 7fbb63fff640 1 -- 172.21.15.2:0/3324942615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fbb6c040070 con 0x7fbb7c07a430 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.000+0000 7fbb8129b640 1 -- 172.21.15.2:0/3324942615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7c1054d0 con 0x7fbb7c07a430 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.000+0000 7fbb63fff640 1 -- 172.21.15.2:0/3324942615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb6c03bdf0 con 0x7fbb7c07a430 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.000+0000 7fbb8129b640 1 -- 172.21.15.2:0/3324942615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7c105a50 con 0x7fbb7c07a430 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.001+0000 7fbb63fff640 1 -- 172.21.15.2:0/3324942615 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 51796+0+0 (secure 0 0 0) 0x7fbb6c030af0 con 0x7fbb7c07a430 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.001+0000 7fbb8129b640 1 -- 172.21.15.2:0/3324942615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7c1075a0 con 0x7fbb7c07a430 2024-09-21T13:33:24.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.002+0000 7fbb63fff640 1 --2- 172.21.15.2:0/3324942615 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbb6403f870 0x7fbb64041d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.002+0000 7fbb63fff640 1 -- 172.21.15.2:0/3324942615 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbb6c073d90 con 0x7fbb7c07a430 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.002+0000 7fbb7a7fc640 1 --2- 172.21.15.2:0/3324942615 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbb6403f870 0x7fbb64041d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.002+0000 7fbb7a7fc640 1 --2- 172.21.15.2:0/3324942615 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbb6403f870 0x7fbb64041d30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbb700098c0 tx=0x7fbb70006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.007+0000 7fbb63fff640 1 -- 172.21.15.2:0/3324942615 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb6c079020 con 0x7fbb7c07a430 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.196+0000 7fbb8129b640 1 -- 172.21.15.2:0/3324942615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fbb7c106010 con 0x7fbb7c07a430 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.197+0000 7fbb63fff640 1 -- 172.21.15.2:0/3324942615 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+372 (secure 0 0 0) 0x7fbb6c030de0 con 0x7fbb7c07a430 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.200+0000 7fbb8129b640 1 -- 172.21.15.2:0/3324942615 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbb6403f870 msgr2=0x7fbb64041d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.200+0000 7fbb8129b640 1 --2- 172.21.15.2:0/3324942615 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbb6403f870 0x7fbb64041d30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbb700098c0 tx=0x7fbb70006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.200+0000 7fbb8129b640 1 -- 172.21.15.2:0/3324942615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 msgr2=0x7fbb7c106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.200+0000 7fbb8129b640 1 --2- 172.21.15.2:0/3324942615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c106b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c000c00 tx=0x7fbb6c030800 comp rx=0 tx=0).stop 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.200+0000 7fbb8129b640 1 -- 172.21.15.2:0/3324942615 shutdown_connections 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.200+0000 7fbb8129b640 1 --2- 172.21.15.2:0/3324942615 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbb6403f870 0x7fbb64041d30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:24.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.200+0000 7fbb8129b640 1 --2- 172.21.15.2:0/3324942615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb7c07a430 0x7fbb7c106b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:24.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.200+0000 7fbb8129b640 1 -- 172.21.15.2:0/3324942615 >> 172.21.15.2:0/3324942615 conn(0x7fbb7c1011c0 msgr2=0x7fbb7c101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:24.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.200+0000 7fbb8129b640 1 -- 172.21.15.2:0/3324942615 shutdown_connections 2024-09-21T13:33:24.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:24.200+0000 7fbb8129b640 1 -- 172.21.15.2:0/3324942615 wait complete. 2024-09-21T13:33:24.822 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2024-09-21T13:33:25.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3324942615' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T13:33:26.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/877357479' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T13:33:26.089 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:25 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ignoring --setuser ceph since I am not root 2024-09-21T13:33:26.089 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:25 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ignoring --setgroup ceph since I am not root 2024-09-21T13:33:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.275+0000 7fbeb6f56640 1 Processor -- start 2024-09-21T13:33:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.275+0000 7fbeb6f56640 1 -- start start 2024-09-21T13:33:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.275+0000 7fbeb6f56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb0106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.275+0000 7fbeb6f56640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb0107360 con 0x7fbeb0106970 2024-09-21T13:33:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.275+0000 7fbeb4cf2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb0106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.275+0000 7fbeb4cf2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb0106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60932/0 (socket says 172.21.15.2:60932) 2024-09-21T13:33:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.275+0000 7fbeb4cf2640 1 -- 172.21.15.2:0/3399518446 learned_addr learned my addr 172.21.15.2:0/3399518446 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.275+0000 7fbeb4cf2640 1 -- 172.21.15.2:0/3399518446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb01074e0 con 0x7fbeb0106970 2024-09-21T13:33:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.276+0000 7fbeb4cf2640 1 --2- 172.21.15.2:0/3399518446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb0106d70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009820 tx=0x7fbea402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50525aa35c68dc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.276+0000 7fbeaf7fe640 1 -- 172.21.15.2:0/3399518446 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbea4037070 con 0x7fbeb0106970 2024-09-21T13:33:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.276+0000 7fbeaf7fe640 1 -- 172.21.15.2:0/3399518446 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fbea40328a0 con 0x7fbeb0106970 2024-09-21T13:33:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.276+0000 7fbeaf7fe640 1 -- 172.21.15.2:0/3399518446 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbea4030690 con 0x7fbeb0106970 2024-09-21T13:33:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.277+0000 7fbeb6f56640 1 -- 172.21.15.2:0/3399518446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 msgr2=0x7fbeb0106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.277+0000 7fbeb6f56640 1 --2- 172.21.15.2:0/3399518446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb0106d70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009820 tx=0x7fbea402a270 comp rx=0 tx=0).stop 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.277+0000 7fbeb6f56640 1 -- 172.21.15.2:0/3399518446 shutdown_connections 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.277+0000 7fbeb6f56640 1 --2- 172.21.15.2:0/3399518446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb0106d70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.277+0000 7fbeb6f56640 1 -- 172.21.15.2:0/3399518446 >> 172.21.15.2:0/3399518446 conn(0x7fbeb0102280 msgr2=0x7fbeb01046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.277+0000 7fbeb6f56640 1 -- 172.21.15.2:0/3399518446 shutdown_connections 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.277+0000 7fbeb6f56640 1 -- 172.21.15.2:0/3399518446 wait complete. 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.278+0000 7fbeb6f56640 1 Processor -- start 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.278+0000 7fbeb6f56640 1 -- start start 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.278+0000 7fbeb6f56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb007c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.278+0000 7fbeb6f56640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb010adf0 con 0x7fbeb0106970 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.278+0000 7fbeb4cf2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb007c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.278+0000 7fbeb4cf2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb007c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60936/0 (socket says 172.21.15.2:60936) 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.278+0000 7fbeb4cf2640 1 -- 172.21.15.2:0/877357479 learned_addr learned my addr 172.21.15.2:0/877357479 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.278+0000 7fbeb4cf2640 1 -- 172.21.15.2:0/877357479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb007cee0 con 0x7fbeb0106970 2024-09-21T13:33:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.278+0000 7fbeb4cf2640 1 --2- 172.21.15.2:0/877357479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb007c980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbea4006f10 tx=0x7fbea4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.279+0000 7fbeadffb640 1 -- 172.21.15.2:0/877357479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbea4037040 con 0x7fbeb0106970 2024-09-21T13:33:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.279+0000 7fbeadffb640 1 -- 172.21.15.2:0/877357479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fbea4040070 con 0x7fbeb0106970 2024-09-21T13:33:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.279+0000 7fbeb6f56640 1 -- 172.21.15.2:0/877357479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb007b2d0 con 0x7fbeb0106970 2024-09-21T13:33:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.279+0000 7fbeadffb640 1 -- 172.21.15.2:0/877357479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbea403a390 con 0x7fbeb0106970 2024-09-21T13:33:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.279+0000 7fbeb6f56640 1 -- 172.21.15.2:0/877357479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb007b850 con 0x7fbeb0106970 2024-09-21T13:33:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.280+0000 7fbeadffb640 1 -- 172.21.15.2:0/877357479 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 51796+0+0 (secure 0 0 0) 0x7fbea403b430 con 0x7fbeb0106970 2024-09-21T13:33:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.280+0000 7fbeb6f56640 1 -- 172.21.15.2:0/877357479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb0106df0 con 0x7fbeb0106970 2024-09-21T13:33:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.280+0000 7fbeadffb640 1 --2- 172.21.15.2:0/877357479 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbea003f820 0x7fbea0041ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.280+0000 7fbeadffb640 1 -- 172.21.15.2:0/877357479 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbea4073fd0 con 0x7fbeb0106970 2024-09-21T13:33:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.280+0000 7fbeaffff640 1 --2- 172.21.15.2:0/877357479 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbea003f820 0x7fbea0041ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.281+0000 7fbeaffff640 1 --2- 172.21.15.2:0/877357479 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbea003f820 0x7fbea0041ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0098c0 tx=0x7fbe9c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.285+0000 7fbeadffb640 1 -- 172.21.15.2:0/877357479 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbea4032830 con 0x7fbeb0106970 2024-09-21T13:33:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.522+0000 7fbeb6f56640 1 -- 172.21.15.2:0/877357479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fbeb007be10 con 0x7fbeb0106970 2024-09-21T13:33:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.799+0000 7fbeadffb640 1 -- 172.21.15.2:0/877357479 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fbea4073d30 con 0x7fbeb0106970 2024-09-21T13:33:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.801+0000 7fbeadffb640 1 -- 172.21.15.2:0/877357479 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 5) ==== 51807+0+0 (secure 0 0 0) 0x7fbea403ad60 con 0x7fbeb0106970 2024-09-21T13:33:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.802+0000 7fbeb6f56640 1 -- 172.21.15.2:0/877357479 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbea003f820 msgr2=0x7fbea0041ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.802+0000 7fbeb6f56640 1 --2- 172.21.15.2:0/877357479 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbea003f820 0x7fbea0041ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0098c0 tx=0x7fbe9c006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:26.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.802+0000 7fbeb6f56640 1 -- 172.21.15.2:0/877357479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 msgr2=0x7fbeb007c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:26.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.802+0000 7fbeb6f56640 1 --2- 172.21.15.2:0/877357479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb007c980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbea4006f10 tx=0x7fbea4032670 comp rx=0 tx=0).stop 2024-09-21T13:33:26.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.802+0000 7fbeb6f56640 1 -- 172.21.15.2:0/877357479 shutdown_connections 2024-09-21T13:33:26.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.802+0000 7fbeb6f56640 1 --2- 172.21.15.2:0/877357479 >> v2:172.21.15.2:6800/3091351943 conn(0x7fbea003f820 0x7fbea0041ce0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:26.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.802+0000 7fbeb6f56640 1 --2- 172.21.15.2:0/877357479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbeb0106970 0x7fbeb007c980 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:26.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.802+0000 7fbeb6f56640 1 -- 172.21.15.2:0/877357479 >> 172.21.15.2:0/877357479 conn(0x7fbeb0102280 msgr2=0x7fbeb0102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:26.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.803+0000 7fbeb6f56640 1 -- 172.21.15.2:0/877357479 shutdown_connections 2024-09-21T13:33:26.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:25.803+0000 7fbeb6f56640 1 -- 172.21.15.2:0/877357479 wait complete. 2024-09-21T13:33:27.072 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/877357479' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T13:33:27.073 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:26 smithi002 ceph-mon[30076]: mgrmap e5: y(active, since 5s) 2024-09-21T13:33:27.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-21T13:33:27.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T13:33:27.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T13:33:27.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-21T13:33:27.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T13:33:27.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-21T13:33:27.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.864+0000 7f176cde3640 1 Processor -- start 2024-09-21T13:33:27.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.865+0000 7f176cde3640 1 -- start start 2024-09-21T13:33:27.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.865+0000 7f176cde3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176810b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:27.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.865+0000 7f176cde3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f176807a6a0 con 0x7f176807a2a0 2024-09-21T13:33:27.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.865+0000 7f176659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176810b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.865+0000 7f176659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176810b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48472/0 (socket says 172.21.15.2:48472) 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.865+0000 7f176659c640 1 -- 172.21.15.2:0/1044536917 learned_addr learned my addr 172.21.15.2:0/1044536917 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.865+0000 7f176659c640 1 -- 172.21.15.2:0/1044536917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176810bef0 con 0x7f176807a2a0 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.866+0000 7f176659c640 1 --2- 172.21.15.2:0/1044536917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176810b9b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1758009820 tx=0x7f175802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6388f38fda6492b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.866+0000 7f176559a640 1 -- 172.21.15.2:0/1044536917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1758037070 con 0x7f176807a2a0 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.866+0000 7f176559a640 1 -- 172.21.15.2:0/1044536917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f17580328a0 con 0x7f176807a2a0 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.866+0000 7f176559a640 1 -- 172.21.15.2:0/1044536917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1758030690 con 0x7f176807a2a0 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.867+0000 7f176cde3640 1 -- 172.21.15.2:0/1044536917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 msgr2=0x7f176810b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.867+0000 7f176cde3640 1 --2- 172.21.15.2:0/1044536917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176810b9b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1758009820 tx=0x7f175802a270 comp rx=0 tx=0).stop 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.867+0000 7f176cde3640 1 -- 172.21.15.2:0/1044536917 shutdown_connections 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.867+0000 7f176cde3640 1 --2- 172.21.15.2:0/1044536917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176810b9b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.867+0000 7f176cde3640 1 -- 172.21.15.2:0/1044536917 >> 172.21.15.2:0/1044536917 conn(0x7f17681011c0 msgr2=0x7f17681035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.867+0000 7f176cde3640 1 -- 172.21.15.2:0/1044536917 shutdown_connections 2024-09-21T13:33:27.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.867+0000 7f176cde3640 1 -- 172.21.15.2:0/1044536917 wait complete. 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.868+0000 7f176cde3640 1 Processor -- start 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.868+0000 7f176cde3640 1 -- start start 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.868+0000 7f176cde3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.868+0000 7f176cde3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f176810ce80 con 0x7f176807a2a0 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.868+0000 7f176659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.868+0000 7f176659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176819ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48482/0 (socket says 172.21.15.2:48482) 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.868+0000 7f176659c640 1 -- 172.21.15.2:0/1244638197 learned_addr learned my addr 172.21.15.2:0/1244638197 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.869+0000 7f176659c640 1 -- 172.21.15.2:0/1244638197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176819cfa0 con 0x7f176807a2a0 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.869+0000 7f176659c640 1 --2- 172.21.15.2:0/1244638197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176819ca40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1758000c00 tx=0x7f1758032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.869+0000 7f17577fe640 1 -- 172.21.15.2:0/1244638197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1758037040 con 0x7f176807a2a0 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.869+0000 7f17577fe640 1 -- 172.21.15.2:0/1244638197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f1758040070 con 0x7f176807a2a0 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.869+0000 7f176cde3640 1 -- 172.21.15.2:0/1244638197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176819d230 con 0x7f176807a2a0 2024-09-21T13:33:27.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.869+0000 7f17577fe640 1 -- 172.21.15.2:0/1244638197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f175803be40 con 0x7f176807a2a0 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.869+0000 7f176cde3640 1 -- 172.21.15.2:0/1244638197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f176819dc70 con 0x7f176807a2a0 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.870+0000 7f17577fe640 1 -- 172.21.15.2:0/1244638197 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 51807+0+0 (secure 0 0 0) 0x7f1758045460 con 0x7f176807a2a0 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.870+0000 7f176cde3640 1 -- 172.21.15.2:0/1244638197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f176810ba30 con 0x7f176807a2a0 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.870+0000 7f17577fe640 1 --2- 172.21.15.2:0/1244638197 >> v2:172.21.15.2:6800/3091351943 conn(0x7f175003f8c0 0x7f1750041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.870+0000 7f17577fe640 1 -- 172.21.15.2:0/1244638197 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1758073e00 con 0x7f176807a2a0 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.870+0000 7f1765d9b640 1 -- 172.21.15.2:0/1244638197 >> v2:172.21.15.2:6800/3091351943 conn(0x7f175003f8c0 msgr2=0x7f1750041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3091351943 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.870+0000 7f1765d9b640 1 --2- 172.21.15.2:0/1244638197 >> v2:172.21.15.2:6800/3091351943 conn(0x7f175003f8c0 0x7f1750041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:26.875+0000 7f17577fe640 1 -- 172.21.15.2:0/1244638197 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f175803b430 con 0x7f176807a2a0 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.071+0000 7f1765d9b640 1 -- 172.21.15.2:0/1244638197 >> v2:172.21.15.2:6800/3091351943 conn(0x7f175003f8c0 msgr2=0x7f1750041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3091351943 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.071+0000 7f1765d9b640 1 --2- 172.21.15.2:0/1244638197 >> v2:172.21.15.2:6800/3091351943 conn(0x7f175003f8c0 0x7f1750041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.119+0000 7f176cde3640 1 -- 172.21.15.2:0/1244638197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f176819e3e0 con 0x7f176807a2a0 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.119+0000 7f17577fe640 1 -- 172.21.15.2:0/1244638197 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f1758037d20 con 0x7f176807a2a0 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.123+0000 7f176cde3640 1 -- 172.21.15.2:0/1244638197 >> v2:172.21.15.2:6800/3091351943 conn(0x7f175003f8c0 msgr2=0x7f1750041d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:33:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.123+0000 7f176cde3640 1 --2- 172.21.15.2:0/1244638197 >> v2:172.21.15.2:6800/3091351943 conn(0x7f175003f8c0 0x7f1750041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:27.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.123+0000 7f176cde3640 1 -- 172.21.15.2:0/1244638197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 msgr2=0x7f176819ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:27.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.123+0000 7f176cde3640 1 --2- 172.21.15.2:0/1244638197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176819ca40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1758000c00 tx=0x7f1758032740 comp rx=0 tx=0).stop 2024-09-21T13:33:27.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.123+0000 7f176cde3640 1 -- 172.21.15.2:0/1244638197 shutdown_connections 2024-09-21T13:33:27.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.123+0000 7f176cde3640 1 --2- 172.21.15.2:0/1244638197 >> v2:172.21.15.2:6800/3091351943 conn(0x7f175003f8c0 0x7f1750041d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:27.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.123+0000 7f176cde3640 1 --2- 172.21.15.2:0/1244638197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176807a2a0 0x7f176819ca40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:27.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.123+0000 7f176cde3640 1 -- 172.21.15.2:0/1244638197 >> 172.21.15.2:0/1244638197 conn(0x7f17681011c0 msgr2=0x7f1768101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:27.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.123+0000 7f176cde3640 1 -- 172.21.15.2:0/1244638197 shutdown_connections 2024-09-21T13:33:27.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:27.123+0000 7f176cde3640 1 -- 172.21.15.2:0/1244638197 wait complete. 2024-09-21T13:33:27.708 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-21T13:33:27.708 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2024-09-21T13:33:28.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1244638197' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T13:33:31.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:31 smithi002 ceph-mon[30076]: Active manager daemon y restarted 2024-09-21T13:33:31.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:31 smithi002 ceph-mon[30076]: Activating manager daemon y 2024-09-21T13:33:31.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:31 smithi002 ceph-mon[30076]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T13:33:31.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:31 smithi002 ceph-mon[30076]: mgrmap e6: y(active, starting, since 0.00332331s) 2024-09-21T13:33:31.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:31 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:33:31.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:31 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T13:33:31.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:31 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T13:33:31.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:31 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T13:33:31.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:31 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T13:33:31.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:31 smithi002 ceph-mon[30076]: Manager daemon y is now available 2024-09-21T13:33:32.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-21T13:33:32.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T13:33:32.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T13:33:32.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-21T13:33:32.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.146+0000 7fa234739640 1 Processor -- start 2024-09-21T13:33:32.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.146+0000 7fa234739640 1 -- start start 2024-09-21T13:33:32.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.146+0000 7fa234739640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c109560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.146+0000 7fa234739640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c109aa0 con 0x7fa22c07a3f0 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.146+0000 7fa2324d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.146+0000 7fa2324d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c109560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48494/0 (socket says 172.21.15.2:48494) 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.146+0000 7fa2324d5640 1 -- 172.21.15.2:0/2782347265 learned_addr learned my addr 172.21.15.2:0/2782347265 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.147+0000 7fa2324d5640 1 -- 172.21.15.2:0/2782347265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c109c20 con 0x7fa22c07a3f0 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.147+0000 7fa2324d5640 1 --2- 172.21.15.2:0/2782347265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c109560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa228009820 tx=0x7fa22802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81d296d64a7428 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.147+0000 7fa2314d3640 1 -- 172.21.15.2:0/2782347265 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa228037070 con 0x7fa22c07a3f0 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.148+0000 7fa2314d3640 1 -- 172.21.15.2:0/2782347265 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fa2280328a0 con 0x7fa22c07a3f0 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.148+0000 7fa2314d3640 1 -- 172.21.15.2:0/2782347265 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa228030690 con 0x7fa22c07a3f0 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.148+0000 7fa234739640 1 -- 172.21.15.2:0/2782347265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 msgr2=0x7fa22c109560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.148+0000 7fa234739640 1 --2- 172.21.15.2:0/2782347265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c109560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa228009820 tx=0x7fa22802a270 comp rx=0 tx=0).stop 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.148+0000 7fa234739640 1 -- 172.21.15.2:0/2782347265 shutdown_connections 2024-09-21T13:33:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.148+0000 7fa234739640 1 --2- 172.21.15.2:0/2782347265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c109560 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.148+0000 7fa234739640 1 -- 172.21.15.2:0/2782347265 >> 172.21.15.2:0/2782347265 conn(0x7fa22c101150 msgr2=0x7fa22c103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.148+0000 7fa234739640 1 -- 172.21.15.2:0/2782347265 shutdown_connections 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.148+0000 7fa234739640 1 -- 172.21.15.2:0/2782347265 wait complete. 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.149+0000 7fa234739640 1 Processor -- start 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.149+0000 7fa234739640 1 -- start start 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.149+0000 7fa234739640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.149+0000 7fa234739640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c10ac90 con 0x7fa22c07a3f0 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.149+0000 7fa2324d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.149+0000 7fa2324d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c19a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48510/0 (socket says 172.21.15.2:48510) 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.149+0000 7fa2324d5640 1 -- 172.21.15.2:0/3305212156 learned_addr learned my addr 172.21.15.2:0/3305212156 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.150+0000 7fa2324d5640 1 -- 172.21.15.2:0/3305212156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c19ae60 con 0x7fa22c07a3f0 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.150+0000 7fa2324d5640 1 --2- 172.21.15.2:0/3305212156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c19a900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa228000c00 tx=0x7fa228030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.150+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa228042070 con 0x7fa22c07a3f0 2024-09-21T13:33:32.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.150+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fa228030e00 con 0x7fa22c07a3f0 2024-09-21T13:33:32.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.150+0000 7fa234739640 1 -- 172.21.15.2:0/3305212156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22c19b0f0 con 0x7fa22c07a3f0 2024-09-21T13:33:32.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.150+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa228037040 con 0x7fa22c07a3f0 2024-09-21T13:33:32.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.150+0000 7fa234739640 1 -- 172.21.15.2:0/3305212156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22c19bab0 con 0x7fa22c07a3f0 2024-09-21T13:33:32.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.151+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 51807+0+0 (secure 0 0 0) 0x7fa228045070 con 0x7fa22c07a3f0 2024-09-21T13:33:32.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.151+0000 7fa2237fe640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 0x7fa218041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:32.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.151+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 --> v2:172.21.15.2:6800/3091351943 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa218042450 con 0x7fa21803f8c0 2024-09-21T13:33:32.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.151+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa228073ff0 con 0x7fa22c07a3f0 2024-09-21T13:33:32.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.151+0000 7fa231cd4640 1 -- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 msgr2=0x7fa218041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3091351943 2024-09-21T13:33:32.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.151+0000 7fa231cd4640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 0x7fa218041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.352+0000 7fa231cd4640 1 -- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 msgr2=0x7fa218041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3091351943 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.352+0000 7fa231cd4640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 0x7fa218041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.753+0000 7fa231cd4640 1 -- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 msgr2=0x7fa218041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3091351943 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:28.753+0000 7fa231cd4640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 0x7fa218041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:29.554+0000 7fa231cd4640 1 -- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 msgr2=0x7fa218041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3091351943 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:29.554+0000 7fa231cd4640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 0x7fa218041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:31.066+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 6) ==== 51609+0+0 (secure 0 0 0) 0x7fa228072ab0 con 0x7fa22c07a3f0 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:31.066+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 msgr2=0x7fa218041d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:31.066+0000 7fa2237fe640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 0x7fa218041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.068+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) ==== 51701+0+0 (secure 0 0 0) 0x7fa22803bd40 con 0x7fa22c07a3f0 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.068+0000 7fa2237fe640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa218042fb0 0x7fa2180453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.068+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 --> v2:172.21.15.2:6800/2044640733 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa228041ec0 con 0x7fa218042fb0 2024-09-21T13:33:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.068+0000 7fa231cd4640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa218042fb0 0x7fa2180453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.069+0000 7fa231cd4640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa218042fb0 0x7fa2180453a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa21c003980 tx=0x7fa21c0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.070+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 <== mgr.14118 v2:172.21.15.2:6800/2044640733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fa228041ec0 con 0x7fa218042fb0 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 -- 172.21.15.2:0/3305212156 --> v2:172.21.15.2:6800/2044640733 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fa22c1075d0 con 0x7fa218042fb0 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa2237fe640 1 -- 172.21.15.2:0/3305212156 <== mgr.14118 v2:172.21.15.2:6800/2044640733 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fa22c1075d0 con 0x7fa218042fb0 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 -- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa218042fb0 msgr2=0x7fa2180453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa218042fb0 0x7fa2180453a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa21c003980 tx=0x7fa21c0092b0 comp rx=0 tx=0).stop 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 -- 172.21.15.2:0/3305212156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 msgr2=0x7fa22c19a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 --2- 172.21.15.2:0/3305212156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c19a900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa228000c00 tx=0x7fa228030bc0 comp rx=0 tx=0).stop 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 -- 172.21.15.2:0/3305212156 shutdown_connections 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa218042fb0 0x7fa2180453a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 --2- 172.21.15.2:0/3305212156 >> v2:172.21.15.2:6800/3091351943 conn(0x7fa21803f8c0 0x7fa218041d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 --2- 172.21.15.2:0/3305212156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa22c07a3f0 0x7fa22c19a900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 -- 172.21.15.2:0/3305212156 >> 172.21.15.2:0/3305212156 conn(0x7fa22c101150 msgr2=0x7fa22c101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 -- 172.21.15.2:0/3305212156 shutdown_connections 2024-09-21T13:33:32.657 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:32.077+0000 7fa234739640 1 -- 172.21.15.2:0/3305212156 wait complete. 2024-09-21T13:33:32.658 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2024-09-21T13:33:32.658 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying orchestrator module is enabled... 2024-09-21T13:33:32.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:32 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:32.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:32 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:32.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:32 smithi002 ceph-mon[30076]: Found migration_current of "None". Setting to last migration. 2024-09-21T13:33:32.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:32 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:32.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:32 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:32.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:32 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:33:32.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:32 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:33:32.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:32 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T13:33:32.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:32 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T13:33:32.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:32 smithi002 ceph-mon[30076]: mgrmap e7: y(active, since 1.00629s) 2024-09-21T13:33:33.328 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: 2024-09-21T13:33:33.028+0000 7f2236545640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:13:33:33] ENGINE Error in HTTPServer.serve 2024-09-21T13:33:33.328 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: Traceback (most recent call last): 2024-09-21T13:33:33.328 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T13:33:33.328 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self._connections.run(self.expiration_interval) 2024-09-21T13:33:33.328 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self._run(expiration_interval) 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: s = self.context.wrap_socket( 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: return self.sslsocket_class._create( 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self.do_handshake() 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self._sslobj.do_handshake() 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T13:33:33.329 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: 2024-09-21T13:33:34.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-mon[30076]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T13:33:34.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-mon[30076]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T13:33:34.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:33:34.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1625562575' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T13:33:34.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.077+0000 7f84ed2b8640 1 Processor -- start 2024-09-21T13:33:34.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.077+0000 7f84ed2b8640 1 -- start start 2024-09-21T13:33:34.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.077+0000 7f84ed2b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e8105c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:34.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.077+0000 7f84ed2b8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8106260 con 0x7f84e8105870 2024-09-21T13:33:34.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.078+0000 7f84e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e8105c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:34.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.078+0000 7f84e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e8105c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48582/0 (socket says 172.21.15.2:48582) 2024-09-21T13:33:34.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.078+0000 7f84e6ffd640 1 -- 172.21.15.2:0/2013231066 learned_addr learned my addr 172.21.15.2:0/2013231066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:34.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.078+0000 7f84e6ffd640 1 -- 172.21.15.2:0/2013231066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e81063e0 con 0x7f84e8105870 2024-09-21T13:33:34.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.079+0000 7f84e6ffd640 1 --2- 172.21.15.2:0/2013231066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e8105c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009820 tx=0x7f84d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3052328607dae9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:34.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.079+0000 7f84e5ffb640 1 -- 172.21.15.2:0/2013231066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d0037070 con 0x7f84e8105870 2024-09-21T13:33:34.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.079+0000 7f84e5ffb640 1 -- 172.21.15.2:0/2013231066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f84d00328a0 con 0x7f84e8105870 2024-09-21T13:33:34.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.079+0000 7f84e5ffb640 1 -- 172.21.15.2:0/2013231066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d0030690 con 0x7f84e8105870 2024-09-21T13:33:34.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.079+0000 7f84ed2b8640 1 -- 172.21.15.2:0/2013231066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 msgr2=0x7f84e8105c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:34.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.079+0000 7f84ed2b8640 1 --2- 172.21.15.2:0/2013231066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e8105c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009820 tx=0x7f84d002a270 comp rx=0 tx=0).stop 2024-09-21T13:33:34.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.079+0000 7f84ed2b8640 1 -- 172.21.15.2:0/2013231066 shutdown_connections 2024-09-21T13:33:34.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.079+0000 7f84ed2b8640 1 --2- 172.21.15.2:0/2013231066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e8105c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:34.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.079+0000 7f84ed2b8640 1 -- 172.21.15.2:0/2013231066 >> 172.21.15.2:0/2013231066 conn(0x7f84e81011c0 msgr2=0x7f84e81035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:34.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.079+0000 7f84ed2b8640 1 -- 172.21.15.2:0/2013231066 shutdown_connections 2024-09-21T13:33:34.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.079+0000 7f84ed2b8640 1 -- 172.21.15.2:0/2013231066 wait complete. 2024-09-21T13:33:34.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.080+0000 7f84ed2b8640 1 Processor -- start 2024-09-21T13:33:34.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.080+0000 7f84ed2b8640 1 -- start start 2024-09-21T13:33:34.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.080+0000 7f84ed2b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:34.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.080+0000 7f84ed2b8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8109cf0 con 0x7f84e8105870 2024-09-21T13:33:34.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.081+0000 7f84e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:34.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.081+0000 7f84e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e819a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48586/0 (socket says 172.21.15.2:48586) 2024-09-21T13:33:34.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.081+0000 7f84e6ffd640 1 -- 172.21.15.2:0/1625562575 learned_addr learned my addr 172.21.15.2:0/1625562575 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:34.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.081+0000 7f84e6ffd640 1 -- 172.21.15.2:0/1625562575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e819ae20 con 0x7f84e8105870 2024-09-21T13:33:34.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.081+0000 7f84e6ffd640 1 --2- 172.21.15.2:0/1625562575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e819a8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f84d0000c00 tx=0x7f84d0032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:34.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.081+0000 7f84dffff640 1 -- 172.21.15.2:0/1625562575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d0037040 con 0x7f84e8105870 2024-09-21T13:33:34.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.081+0000 7f84dffff640 1 -- 172.21.15.2:0/1625562575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f84d0040070 con 0x7f84e8105870 2024-09-21T13:33:34.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.081+0000 7f84ed2b8640 1 -- 172.21.15.2:0/1625562575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e819b0b0 con 0x7f84e8105870 2024-09-21T13:33:34.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.081+0000 7f84dffff640 1 -- 172.21.15.2:0/1625562575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d003be40 con 0x7f84e8105870 2024-09-21T13:33:34.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.081+0000 7f84ed2b8640 1 -- 172.21.15.2:0/1625562575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e819ba70 con 0x7f84e8105870 2024-09-21T13:33:34.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.082+0000 7f84dffff640 1 -- 172.21.15.2:0/1625562575 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) ==== 51701+0+0 (secure 0 0 0) 0x7f84d003b680 con 0x7f84e8105870 2024-09-21T13:33:34.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.082+0000 7f84ed2b8640 1 -- 172.21.15.2:0/1625562575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e8105cf0 con 0x7f84e8105870 2024-09-21T13:33:34.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.082+0000 7f84dffff640 1 --2- 172.21.15.2:0/1625562575 >> v2:172.21.15.2:6800/2044640733 conn(0x7f84d403f740 0x7f84d4041c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:34.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.082+0000 7f84dffff640 1 -- 172.21.15.2:0/1625562575 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f84d0073bd0 con 0x7f84e8105870 2024-09-21T13:33:34.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.083+0000 7f84e67fc640 1 --2- 172.21.15.2:0/1625562575 >> v2:172.21.15.2:6800/2044640733 conn(0x7f84d403f740 0x7f84d4041c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:34.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.083+0000 7f84e67fc640 1 --2- 172.21.15.2:0/1625562575 >> v2:172.21.15.2:6800/2044640733 conn(0x7f84d403f740 0x7f84d4041c00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84d80098c0 tx=0x7f84d8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:34.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.087+0000 7f84dffff640 1 -- 172.21.15.2:0/1625562575 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84d002e200 con 0x7f84e8105870 2024-09-21T13:33:34.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.326+0000 7f84ed2b8640 1 -- 172.21.15.2:0/1625562575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "orchestrator"} v 0) -- 0x7f84e819c190 con 0x7f84e8105870 2024-09-21T13:33:34.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.823+0000 7f84dffff640 1 -- 172.21.15.2:0/1625562575 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "orchestrator"}]=0 module 'orchestrator' is already enabled (always-on) v8) ==== 143+0+0 (secure 0 0 0) 0x7f84d0036dd0 con 0x7f84e8105870 2024-09-21T13:33:34.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T13:33:34.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.825+0000 7f84dffff640 1 -- 172.21.15.2:0/1625562575 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 8) ==== 51807+0+0 (secure 0 0 0) 0x7f84d0040d10 con 0x7f84e8105870 2024-09-21T13:33:34.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.826+0000 7f84ed2b8640 1 -- 172.21.15.2:0/1625562575 >> v2:172.21.15.2:6800/2044640733 conn(0x7f84d403f740 msgr2=0x7f84d4041c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:34.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.826+0000 7f84ed2b8640 1 --2- 172.21.15.2:0/1625562575 >> v2:172.21.15.2:6800/2044640733 conn(0x7f84d403f740 0x7f84d4041c00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84d80098c0 tx=0x7f84d8006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:34.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.826+0000 7f84ed2b8640 1 -- 172.21.15.2:0/1625562575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 msgr2=0x7f84e819a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:34.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.826+0000 7f84ed2b8640 1 --2- 172.21.15.2:0/1625562575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e819a8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f84d0000c00 tx=0x7f84d0032740 comp rx=0 tx=0).stop 2024-09-21T13:33:34.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.826+0000 7f84ed2b8640 1 -- 172.21.15.2:0/1625562575 shutdown_connections 2024-09-21T13:33:34.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.826+0000 7f84ed2b8640 1 --2- 172.21.15.2:0/1625562575 >> v2:172.21.15.2:6800/2044640733 conn(0x7f84d403f740 0x7f84d4041c00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:34.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.826+0000 7f84ed2b8640 1 --2- 172.21.15.2:0/1625562575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e8105870 0x7f84e819a8c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:34.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.826+0000 7f84ed2b8640 1 -- 172.21.15.2:0/1625562575 >> 172.21.15.2:0/1625562575 conn(0x7f84e81011c0 msgr2=0x7f84e8079850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:34.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.827+0000 7f84ed2b8640 1 -- 172.21.15.2:0/1625562575 shutdown_connections 2024-09-21T13:33:34.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:33.827+0000 7f84ed2b8640 1 -- 172.21.15.2:0/1625562575 wait complete. 2024-09-21T13:33:34.374 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2024-09-21T13:33:35.021 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:34 smithi002 ceph-mon[30076]: [21/Sep/2024:13:33:32] ENGINE Bus STARTING 2024-09-21T13:33:35.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:34 smithi002 ceph-mon[30076]: [21/Sep/2024:13:33:33] ENGINE Serving on https://172.21.15.2:7150 2024-09-21T13:33:35.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:34 smithi002 ceph-mon[30076]: [21/Sep/2024:13:33:33] ENGINE Error in HTTPServer.serve 2024-09-21T13:33:35.022 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-21T13:33:35.022 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T13:33:35.022 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-21T13:33:35.022 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T13:33:35.023 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-21T13:33:35.023 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T13:33:35.023 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T13:33:35.023 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T13:33:35.025 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T13:33:35.026 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T13:33:35.026 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-21T13:33:35.026 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T13:33:35.026 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-21T13:33:35.026 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T13:33:35.026 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-21T13:33:35.026 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T13:33:35.027 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-21T13:33:35.027 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T13:33:35.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:34 smithi002 ceph-mon[30076]: [21/Sep/2024:13:33:33] ENGINE Serving on http://172.21.15.2:8765 2024-09-21T13:33:35.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:34 smithi002 ceph-mon[30076]: [21/Sep/2024:13:33:33] ENGINE Bus STARTED 2024-09-21T13:33:35.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1625562575' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T13:33:35.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:34 smithi002 ceph-mon[30076]: mgrmap e8: y(active, since 2s) 2024-09-21T13:33:35.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.804+0000 7f46a58fb640 1 Processor -- start 2024-09-21T13:33:35.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.804+0000 7f46a58fb640 1 -- start start 2024-09-21T13:33:35.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.804+0000 7f46a58fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a0106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:35.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.804+0000 7f46a58fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0107360 con 0x7f46a0106970 2024-09-21T13:33:35.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.804+0000 7f469effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a0106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:35.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.804+0000 7f469effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a0106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48600/0 (socket says 172.21.15.2:48600) 2024-09-21T13:33:35.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.805+0000 7f469effd640 1 -- 172.21.15.2:0/3086421687 learned_addr learned my addr 172.21.15.2:0/3086421687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:35.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.805+0000 7f469effd640 1 -- 172.21.15.2:0/3086421687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a01074e0 con 0x7f46a0106970 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.805+0000 7f469effd640 1 --2- 172.21.15.2:0/3086421687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a0106d70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4690009e80 tx=0x7f469002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48656c4d53be061d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.806+0000 7f469dffb640 1 -- 172.21.15.2:0/3086421687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4690036070 con 0x7f46a0106970 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.806+0000 7f469dffb640 1 -- 172.21.15.2:0/3086421687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f4690031860 con 0x7f46a0106970 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.806+0000 7f469dffb640 1 -- 172.21.15.2:0/3086421687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4690007880 con 0x7f46a0106970 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.806+0000 7f46a58fb640 1 -- 172.21.15.2:0/3086421687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 msgr2=0x7f46a0106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.806+0000 7f46a58fb640 1 --2- 172.21.15.2:0/3086421687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a0106d70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4690009e80 tx=0x7f469002a7a0 comp rx=0 tx=0).stop 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.806+0000 7f46a58fb640 1 -- 172.21.15.2:0/3086421687 shutdown_connections 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.806+0000 7f46a58fb640 1 --2- 172.21.15.2:0/3086421687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a0106d70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.806+0000 7f46a58fb640 1 -- 172.21.15.2:0/3086421687 >> 172.21.15.2:0/3086421687 conn(0x7f46a0102280 msgr2=0x7f46a01046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.806+0000 7f46a58fb640 1 -- 172.21.15.2:0/3086421687 shutdown_connections 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.806+0000 7f46a58fb640 1 -- 172.21.15.2:0/3086421687 wait complete. 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.807+0000 7f46a58fb640 1 Processor -- start 2024-09-21T13:33:35.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.807+0000 7f46a58fb640 1 -- start start 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.807+0000 7f46a58fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.807+0000 7f46a58fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f46a010adf0 con 0x7f46a0106970 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.807+0000 7f469effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.807+0000 7f469effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a019a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48612/0 (socket says 172.21.15.2:48612) 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.807+0000 7f469effd640 1 -- 172.21.15.2:0/1742805888 learned_addr learned my addr 172.21.15.2:0/1742805888 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.808+0000 7f469effd640 1 -- 172.21.15.2:0/1742805888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a019ae30 con 0x7f46a0106970 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.808+0000 7f469effd640 1 --2- 172.21.15.2:0/1742805888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a019a8d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4690008dc0 tx=0x7f4690008df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.808+0000 7f46a48f9640 1 -- 172.21.15.2:0/1742805888 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4690041020 con 0x7f46a0106970 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.808+0000 7f46a48f9640 1 -- 172.21.15.2:0/1742805888 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f4690031a10 con 0x7f46a0106970 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.808+0000 7f46a58fb640 1 -- 172.21.15.2:0/1742805888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a019b0c0 con 0x7f46a0106970 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.808+0000 7f46a48f9640 1 -- 172.21.15.2:0/1742805888 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4690036040 con 0x7f46a0106970 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.808+0000 7f46a58fb640 1 -- 172.21.15.2:0/1742805888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a019bb00 con 0x7f46a0106970 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.809+0000 7f46a48f9640 1 -- 172.21.15.2:0/1742805888 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 51807+0+0 (secure 0 0 0) 0x7f4690044020 con 0x7f46a0106970 2024-09-21T13:33:35.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.809+0000 7f46a58fb640 1 -- 172.21.15.2:0/1742805888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a0106df0 con 0x7f46a0106970 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.810+0000 7f46a48f9640 1 --2- 172.21.15.2:0/1742805888 >> v2:172.21.15.2:6800/2044640733 conn(0x7f468c03f8c0 0x7f468c041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.810+0000 7f46a48f9640 1 -- 172.21.15.2:0/1742805888 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f46900756b0 con 0x7f46a0106970 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.810+0000 7f469e7fc640 1 --2- 172.21.15.2:0/1742805888 >> v2:172.21.15.2:6800/2044640733 conn(0x7f468c03f8c0 0x7f468c041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.810+0000 7f469e7fc640 1 --2- 172.21.15.2:0/1742805888 >> v2:172.21.15.2:6800/2044640733 conn(0x7f468c03f8c0 0x7f468c041d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46880098c0 tx=0x7f4688006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:34.814+0000 7f46a48f9640 1 -- 172.21.15.2:0/1742805888 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f469004b020 con 0x7f46a0106970 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.019+0000 7f46a58fb640 1 -- 172.21.15.2:0/1742805888 --> v2:172.21.15.2:6800/2044640733 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f46a0103430 con 0x7f468c03f8c0 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.024+0000 7f46a48f9640 1 -- 172.21.15.2:0/1742805888 <== mgr.14118 v2:172.21.15.2:6800/2044640733 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f46a0103430 con 0x7f468c03f8c0 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.026+0000 7f46a58fb640 1 -- 172.21.15.2:0/1742805888 >> v2:172.21.15.2:6800/2044640733 conn(0x7f468c03f8c0 msgr2=0x7f468c041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.027+0000 7f46a58fb640 1 --2- 172.21.15.2:0/1742805888 >> v2:172.21.15.2:6800/2044640733 conn(0x7f468c03f8c0 0x7f468c041d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46880098c0 tx=0x7f4688006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.027+0000 7f46a58fb640 1 -- 172.21.15.2:0/1742805888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 msgr2=0x7f46a019a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.027+0000 7f46a58fb640 1 --2- 172.21.15.2:0/1742805888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a019a8d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4690008dc0 tx=0x7f4690008df0 comp rx=0 tx=0).stop 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.027+0000 7f46a58fb640 1 -- 172.21.15.2:0/1742805888 shutdown_connections 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.027+0000 7f46a58fb640 1 --2- 172.21.15.2:0/1742805888 >> v2:172.21.15.2:6800/2044640733 conn(0x7f468c03f8c0 0x7f468c041d80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:35.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.027+0000 7f46a58fb640 1 --2- 172.21.15.2:0/1742805888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a0106970 0x7f46a019a8d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:35.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.027+0000 7f46a58fb640 1 -- 172.21.15.2:0/1742805888 >> 172.21.15.2:0/1742805888 conn(0x7f46a0102280 msgr2=0x7f46a0102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:35.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.027+0000 7f46a58fb640 1 -- 172.21.15.2:0/1742805888 shutdown_connections 2024-09-21T13:33:35.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:35.027+0000 7f46a58fb640 1 -- 172.21.15.2:0/1742805888 wait complete. 2024-09-21T13:33:36.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:36 smithi002 ceph-mon[30076]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:33:36.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:36 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:36.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:36 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:33:36.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T13:33:36.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.117+0000 7f440063a640 1 Processor -- start 2024-09-21T13:33:36.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.117+0000 7f440063a640 1 -- start start 2024-09-21T13:33:36.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.117+0000 7f440063a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f8106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:36.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.117+0000 7f440063a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43f8107360 con 0x7f43f8106970 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.118+0000 7f43fe3d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f8106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.118+0000 7f43fe3d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f8106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52660/0 (socket says 172.21.15.2:52660) 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.118+0000 7f43fe3d6640 1 -- 172.21.15.2:0/3922552378 learned_addr learned my addr 172.21.15.2:0/3922552378 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.118+0000 7f43fe3d6640 1 -- 172.21.15.2:0/3922552378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f81074e0 con 0x7f43f8106970 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.119+0000 7f43fe3d6640 1 --2- 172.21.15.2:0/3922552378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f8106d70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009e80 tx=0x7f43e802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae5a6792a95edf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.119+0000 7f43fd3d4640 1 -- 172.21.15.2:0/3922552378 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e8036070 con 0x7f43f8106970 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.119+0000 7f43fd3d4640 1 -- 172.21.15.2:0/3922552378 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f43e8031860 con 0x7f43f8106970 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.119+0000 7f43fd3d4640 1 -- 172.21.15.2:0/3922552378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e8007880 con 0x7f43f8106970 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.120+0000 7f440063a640 1 -- 172.21.15.2:0/3922552378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 msgr2=0x7f43f8106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.120+0000 7f440063a640 1 --2- 172.21.15.2:0/3922552378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f8106d70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009e80 tx=0x7f43e802a7a0 comp rx=0 tx=0).stop 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.120+0000 7f440063a640 1 -- 172.21.15.2:0/3922552378 shutdown_connections 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.120+0000 7f440063a640 1 --2- 172.21.15.2:0/3922552378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f8106d70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:36.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.120+0000 7f440063a640 1 -- 172.21.15.2:0/3922552378 >> 172.21.15.2:0/3922552378 conn(0x7f43f8102280 msgr2=0x7f43f81046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.120+0000 7f440063a640 1 -- 172.21.15.2:0/3922552378 shutdown_connections 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.120+0000 7f440063a640 1 -- 172.21.15.2:0/3922552378 wait complete. 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.120+0000 7f440063a640 1 Processor -- start 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.120+0000 7f440063a640 1 -- start start 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.121+0000 7f440063a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f819a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.121+0000 7f440063a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43f810adf0 con 0x7f43f8106970 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.121+0000 7f43fe3d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f819a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.121+0000 7f43fe3d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f819a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52676/0 (socket says 172.21.15.2:52676) 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.121+0000 7f43fe3d6640 1 -- 172.21.15.2:0/2397335880 learned_addr learned my addr 172.21.15.2:0/2397335880 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.121+0000 7f43fe3d6640 1 -- 172.21.15.2:0/2397335880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f819ae50 con 0x7f43f8106970 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.121+0000 7f43fe3d6640 1 --2- 172.21.15.2:0/2397335880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f819a8f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43e8008dc0 tx=0x7f43e8008df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.121+0000 7f43f77fe640 1 -- 172.21.15.2:0/2397335880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e8041020 con 0x7f43f8106970 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.121+0000 7f43f77fe640 1 -- 172.21.15.2:0/2397335880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f43e8031a10 con 0x7f43f8106970 2024-09-21T13:33:36.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.121+0000 7f440063a640 1 -- 172.21.15.2:0/2397335880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f819b0e0 con 0x7f43f8106970 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.121+0000 7f43f77fe640 1 -- 172.21.15.2:0/2397335880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e8036040 con 0x7f43f8106970 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.122+0000 7f440063a640 1 -- 172.21.15.2:0/2397335880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f819bb20 con 0x7f43f8106970 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.122+0000 7f43f77fe640 1 -- 172.21.15.2:0/2397335880 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 51807+0+0 (secure 0 0 0) 0x7f43e8044020 con 0x7f43f8106970 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.123+0000 7f440063a640 1 -- 172.21.15.2:0/2397335880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f8106df0 con 0x7f43f8106970 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.123+0000 7f43f77fe640 1 --2- 172.21.15.2:0/2397335880 >> v2:172.21.15.2:6800/2044640733 conn(0x7f43e003f870 0x7f43e0041d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.123+0000 7f43f77fe640 1 -- 172.21.15.2:0/2397335880 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f43e8075600 con 0x7f43f8106970 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.123+0000 7f43fdbd5640 1 --2- 172.21.15.2:0/2397335880 >> v2:172.21.15.2:6800/2044640733 conn(0x7f43e003f870 0x7f43e0041d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.123+0000 7f43fdbd5640 1 --2- 172.21.15.2:0/2397335880 >> v2:172.21.15.2:6800/2044640733 conn(0x7f43e003f870 0x7f43e0041d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0098c0 tx=0x7f43ec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.128+0000 7f43f77fe640 1 -- 172.21.15.2:0/2397335880 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43e804b020 con 0x7f43f8106970 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.316+0000 7f440063a640 1 -- 172.21.15.2:0/2397335880 --> v2:172.21.15.2:6800/2044640733 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f43f819c3c0 con 0x7f43e003f870 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.317+0000 7f43f77fe640 1 -- 172.21.15.2:0/2397335880 <== mgr.14118 v2:172.21.15.2:6800/2044640733 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f43f819c3c0 con 0x7f43e003f870 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.319+0000 7f440063a640 1 -- 172.21.15.2:0/2397335880 >> v2:172.21.15.2:6800/2044640733 conn(0x7f43e003f870 msgr2=0x7f43e0041d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.319+0000 7f440063a640 1 --2- 172.21.15.2:0/2397335880 >> v2:172.21.15.2:6800/2044640733 conn(0x7f43e003f870 0x7f43e0041d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0098c0 tx=0x7f43ec006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:36.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.319+0000 7f440063a640 1 -- 172.21.15.2:0/2397335880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 msgr2=0x7f43f819a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:36.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.319+0000 7f440063a640 1 --2- 172.21.15.2:0/2397335880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f819a8f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43e8008dc0 tx=0x7f43e8008df0 comp rx=0 tx=0).stop 2024-09-21T13:33:36.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.319+0000 7f440063a640 1 -- 172.21.15.2:0/2397335880 shutdown_connections 2024-09-21T13:33:36.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.319+0000 7f440063a640 1 --2- 172.21.15.2:0/2397335880 >> v2:172.21.15.2:6800/2044640733 conn(0x7f43e003f870 0x7f43e0041d30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:36.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.319+0000 7f440063a640 1 --2- 172.21.15.2:0/2397335880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f8106970 0x7f43f819a8f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:36.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.319+0000 7f440063a640 1 -- 172.21.15.2:0/2397335880 >> 172.21.15.2:0/2397335880 conn(0x7f43f8102280 msgr2=0x7f43f8102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:36.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.319+0000 7f440063a640 1 -- 172.21.15.2:0/2397335880 shutdown_connections 2024-09-21T13:33:36.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:36.319+0000 7f440063a640 1 -- 172.21.15.2:0/2397335880 wait complete. 2024-09-21T13:33:36.906 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2024-09-21T13:33:37.154 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-mon[30076]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:33:38.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:38 smithi002 ceph-mon[30076]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:33:38.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:38 smithi002 ceph-mon[30076]: Generating ssh key... 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:38 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:38 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: Generating public/private rsa key pair. 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: Your identification has been saved in /tmp/tmp44d4b8x1/key 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: Your public key has been saved in /tmp/tmp44d4b8x1/key.pub 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: The key fingerprint is: 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: SHA256:btP855PiynNjMaFjq7jE0aGZ8kGYQLJquPEnyvHUGwY ceph-e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: The key's randomart image is: 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: +---[RSA 3072]----+ 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: |..o | 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: | o . o | 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: |. o . . | 2024-09-21T13:33:38.260 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: |o . = . . | 2024-09-21T13:33:38.261 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: |+. E. * S . . | 2024-09-21T13:33:38.261 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: |.+ o+ + o+ o | 2024-09-21T13:33:38.261 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: |..o..++ +.oo o . | 2024-09-21T13:33:38.261 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: |..+o..oo oo.= + | 2024-09-21T13:33:38.261 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: |.. . .o...o*o=.. | 2024-09-21T13:33:38.261 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: +----[SHA256]-----+ 2024-09-21T13:33:38.559 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.336+0000 7faf9fbb2640 1 Processor -- start 2024-09-21T13:33:38.559 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.336+0000 7faf9fbb2640 1 -- start start 2024-09-21T13:33:38.559 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.336+0000 7faf9fbb2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf98106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:38.559 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.336+0000 7faf9fbb2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf98107360 con 0x7faf98106970 2024-09-21T13:33:38.559 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.336+0000 7faf9d94e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf98106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:38.559 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.336+0000 7faf9d94e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf98106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52680/0 (socket says 172.21.15.2:52680) 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.336+0000 7faf9d94e640 1 -- 172.21.15.2:0/429290552 learned_addr learned my addr 172.21.15.2:0/429290552 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.336+0000 7faf9d94e640 1 -- 172.21.15.2:0/429290552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf981074e0 con 0x7faf98106970 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.337+0000 7faf9d94e640 1 --2- 172.21.15.2:0/429290552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf98106d70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faf94009820 tx=0x7faf9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e090694ccfa44e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.337+0000 7faf9c94c640 1 -- 172.21.15.2:0/429290552 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf94037070 con 0x7faf98106970 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.337+0000 7faf9c94c640 1 -- 172.21.15.2:0/429290552 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7faf940328a0 con 0x7faf98106970 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.337+0000 7faf9c94c640 1 -- 172.21.15.2:0/429290552 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf94030690 con 0x7faf98106970 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.338+0000 7faf9fbb2640 1 -- 172.21.15.2:0/429290552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 msgr2=0x7faf98106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.338+0000 7faf9fbb2640 1 --2- 172.21.15.2:0/429290552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf98106d70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faf94009820 tx=0x7faf9402a270 comp rx=0 tx=0).stop 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.338+0000 7faf9fbb2640 1 -- 172.21.15.2:0/429290552 shutdown_connections 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.338+0000 7faf9fbb2640 1 --2- 172.21.15.2:0/429290552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf98106d70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.338+0000 7faf9fbb2640 1 -- 172.21.15.2:0/429290552 >> 172.21.15.2:0/429290552 conn(0x7faf98102280 msgr2=0x7faf981046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.338+0000 7faf9fbb2640 1 -- 172.21.15.2:0/429290552 shutdown_connections 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.338+0000 7faf9fbb2640 1 -- 172.21.15.2:0/429290552 wait complete. 2024-09-21T13:33:38.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf9fbb2640 1 Processor -- start 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf9fbb2640 1 -- start start 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf9fbb2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf9819a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf9fbb2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf9810adf0 con 0x7faf98106970 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf9d94e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf9819a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf9d94e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf9819a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52694/0 (socket says 172.21.15.2:52694) 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf9d94e640 1 -- 172.21.15.2:0/2750430828 learned_addr learned my addr 172.21.15.2:0/2750430828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf9d94e640 1 -- 172.21.15.2:0/2750430828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9819ae50 con 0x7faf98106970 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf9d94e640 1 --2- 172.21.15.2:0/2750430828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf9819a8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faf94006f10 tx=0x7faf94032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf8effd640 1 -- 172.21.15.2:0/2750430828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf94037040 con 0x7faf98106970 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf8effd640 1 -- 172.21.15.2:0/2750430828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7faf94040070 con 0x7faf98106970 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf9fbb2640 1 -- 172.21.15.2:0/2750430828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9819b0e0 con 0x7faf98106970 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.339+0000 7faf8effd640 1 -- 172.21.15.2:0/2750430828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9403a390 con 0x7faf98106970 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.340+0000 7faf9fbb2640 1 -- 172.21.15.2:0/2750430828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9819baa0 con 0x7faf98106970 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.340+0000 7faf8effd640 1 -- 172.21.15.2:0/2750430828 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 51807+0+0 (secure 0 0 0) 0x7faf9403b430 con 0x7faf98106970 2024-09-21T13:33:38.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.340+0000 7faf9fbb2640 1 -- 172.21.15.2:0/2750430828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf98106df0 con 0x7faf98106970 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.341+0000 7faf8effd640 1 --2- 172.21.15.2:0/2750430828 >> v2:172.21.15.2:6800/2044640733 conn(0x7faf8403f8c0 0x7faf84041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.341+0000 7faf8effd640 1 -- 172.21.15.2:0/2750430828 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7faf94073ec0 con 0x7faf98106970 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.341+0000 7faf9d14d640 1 --2- 172.21.15.2:0/2750430828 >> v2:172.21.15.2:6800/2044640733 conn(0x7faf8403f8c0 0x7faf84041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.341+0000 7faf9d14d640 1 --2- 172.21.15.2:0/2750430828 >> v2:172.21.15.2:6800/2044640733 conn(0x7faf8403f8c0 0x7faf84041d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faf880098c0 tx=0x7faf88006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.345+0000 7faf8effd640 1 -- 172.21.15.2:0/2750430828 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf94043360 con 0x7faf98106970 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.534+0000 7faf9fbb2640 1 -- 172.21.15.2:0/2750430828 --> v2:172.21.15.2:6800/2044640733 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7faf981033e0 con 0x7faf8403f8c0 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.900+0000 7faf8effd640 1 -- 172.21.15.2:0/2750430828 <== mgr.14118 v2:172.21.15.2:6800/2044640733 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faf981033e0 con 0x7faf8403f8c0 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.902+0000 7faf9fbb2640 1 -- 172.21.15.2:0/2750430828 >> v2:172.21.15.2:6800/2044640733 conn(0x7faf8403f8c0 msgr2=0x7faf84041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.902+0000 7faf9fbb2640 1 --2- 172.21.15.2:0/2750430828 >> v2:172.21.15.2:6800/2044640733 conn(0x7faf8403f8c0 0x7faf84041d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faf880098c0 tx=0x7faf88006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.902+0000 7faf9fbb2640 1 -- 172.21.15.2:0/2750430828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 msgr2=0x7faf9819a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.902+0000 7faf9fbb2640 1 --2- 172.21.15.2:0/2750430828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf9819a8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faf94006f10 tx=0x7faf94032670 comp rx=0 tx=0).stop 2024-09-21T13:33:38.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.902+0000 7faf9fbb2640 1 -- 172.21.15.2:0/2750430828 shutdown_connections 2024-09-21T13:33:38.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.902+0000 7faf9fbb2640 1 --2- 172.21.15.2:0/2750430828 >> v2:172.21.15.2:6800/2044640733 conn(0x7faf8403f8c0 0x7faf84041d80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:38.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.902+0000 7faf9fbb2640 1 --2- 172.21.15.2:0/2750430828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf98106970 0x7faf9819a8f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:38.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.902+0000 7faf9fbb2640 1 -- 172.21.15.2:0/2750430828 >> 172.21.15.2:0/2750430828 conn(0x7faf98102280 msgr2=0x7faf98102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:38.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.902+0000 7faf9fbb2640 1 -- 172.21.15.2:0/2750430828 shutdown_connections 2024-09-21T13:33:38.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:37.902+0000 7faf9fbb2640 1 -- 172.21.15.2:0/2750430828 wait complete. 2024-09-21T13:33:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zMyC5P7LNjaLyLtf3jtF9mXkLf9WuKWyW0Rm0bO1qPK0qmLs3FESiEEBFYrEm/6eR3GF0k6yP0C1kywxg/cmszkvq6paKPblGVOKLmm+NsISkLkhLC04xTxnjsImdnUHnKYpNkt47eFDoVD1Oj1+8iaV50uLIKyVEgOCjhI0aYyYdIiZTUJp/UQbn/IpPf7UWbMocJWg+esWQBIGWJY4sBYgWGzdZRYg8RhEnrlEzFzOshubHgveWDxrNqq7GxuMGTlNdS+A+nkBIUpqa83+8PE5KdOyma5c5SwnOWQ5j/Qnp7AY9iiB3Zt3bTvhoc9K3dDXXn7mgBJSOmPsMjI8lyh6UefZW+7lHolGKe/pg/BG0WZu66A3VcMe7LqS+r3ucdZsYoyCHSzzgtnNiyGc0QrP85T66/PIA5ToyqMTV7u6YLCptgWSoLrFnfy7rGeBzaLj7cxZwts1sEaOOvIo4VZVkRUyap6naSaWVa5TFYdTg3C0LeNZxSXTlmyXC8s= ceph-e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.009+0000 7fe30191f640 1 Processor -- start 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.009+0000 7fe30191f640 1 -- start start 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.009+0000 7fe30191f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.009+0000 7fe30191f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2fc107360 con 0x7fe2fc106970 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.009+0000 7fe2faffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.009+0000 7fe2faffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52710/0 (socket says 172.21.15.2:52710) 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.010+0000 7fe2faffd640 1 -- 172.21.15.2:0/1760551721 learned_addr learned my addr 172.21.15.2:0/1760551721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.010+0000 7fe2faffd640 1 -- 172.21.15.2:0/1760551721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2fc1074e0 con 0x7fe2fc106970 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.010+0000 7fe2faffd640 1 --2- 172.21.15.2:0/1760551721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc106d70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009820 tx=0x7fe2ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7b5e95331045f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.011+0000 7fe2f9ffb640 1 -- 172.21.15.2:0/1760551721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2ec037070 con 0x7fe2fc106970 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.011+0000 7fe2f9ffb640 1 -- 172.21.15.2:0/1760551721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fe2ec0328a0 con 0x7fe2fc106970 2024-09-21T13:33:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.011+0000 7fe2f9ffb640 1 -- 172.21.15.2:0/1760551721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2ec030690 con 0x7fe2fc106970 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.011+0000 7fe30191f640 1 -- 172.21.15.2:0/1760551721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 msgr2=0x7fe2fc106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.011+0000 7fe30191f640 1 --2- 172.21.15.2:0/1760551721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc106d70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009820 tx=0x7fe2ec02a270 comp rx=0 tx=0).stop 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.011+0000 7fe30191f640 1 -- 172.21.15.2:0/1760551721 shutdown_connections 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.011+0000 7fe30191f640 1 --2- 172.21.15.2:0/1760551721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc106d70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.011+0000 7fe30191f640 1 -- 172.21.15.2:0/1760551721 >> 172.21.15.2:0/1760551721 conn(0x7fe2fc102280 msgr2=0x7fe2fc1046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.011+0000 7fe30191f640 1 -- 172.21.15.2:0/1760551721 shutdown_connections 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.011+0000 7fe30191f640 1 -- 172.21.15.2:0/1760551721 wait complete. 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.012+0000 7fe30191f640 1 Processor -- start 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.012+0000 7fe30191f640 1 -- start start 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.012+0000 7fe30191f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.012+0000 7fe30191f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2fc10adf0 con 0x7fe2fc106970 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.013+0000 7fe2faffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.013+0000 7fe2faffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc19a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52718/0 (socket says 172.21.15.2:52718) 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.013+0000 7fe2faffd640 1 -- 172.21.15.2:0/2357911269 learned_addr learned my addr 172.21.15.2:0/2357911269 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.013+0000 7fe2faffd640 1 -- 172.21.15.2:0/2357911269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2fc19ae50 con 0x7fe2fc106970 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.013+0000 7fe2faffd640 1 --2- 172.21.15.2:0/2357911269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc19a8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec006f10 tx=0x7fe2ec032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.013+0000 7fe30091d640 1 -- 172.21.15.2:0/2357911269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2ec037040 con 0x7fe2fc106970 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.013+0000 7fe30091d640 1 -- 172.21.15.2:0/2357911269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fe2ec040070 con 0x7fe2fc106970 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.013+0000 7fe30191f640 1 -- 172.21.15.2:0/2357911269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2fc19b0e0 con 0x7fe2fc106970 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.013+0000 7fe30091d640 1 -- 172.21.15.2:0/2357911269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2ec03a390 con 0x7fe2fc106970 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.013+0000 7fe30191f640 1 -- 172.21.15.2:0/2357911269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2fc19baa0 con 0x7fe2fc106970 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.014+0000 7fe30091d640 1 -- 172.21.15.2:0/2357911269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 51807+0+0 (secure 0 0 0) 0x7fe2ec03a600 con 0x7fe2fc106970 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.014+0000 7fe30191f640 1 -- 172.21.15.2:0/2357911269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2fc106df0 con 0x7fe2fc106970 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.014+0000 7fe30091d640 1 --2- 172.21.15.2:0/2357911269 >> v2:172.21.15.2:6800/2044640733 conn(0x7fe2e403f8c0 0x7fe2e4041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.014+0000 7fe30091d640 1 -- 172.21.15.2:0/2357911269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fe2ec073fe0 con 0x7fe2fc106970 2024-09-21T13:33:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.014+0000 7fe2fa7fc640 1 --2- 172.21.15.2:0/2357911269 >> v2:172.21.15.2:6800/2044640733 conn(0x7fe2e403f8c0 0x7fe2e4041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.015+0000 7fe2fa7fc640 1 --2- 172.21.15.2:0/2357911269 >> v2:172.21.15.2:6800/2044640733 conn(0x7fe2e403f8c0 0x7fe2e4041d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00098c0 tx=0x7fe2f0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.019+0000 7fe30091d640 1 -- 172.21.15.2:0/2357911269 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2ec03a8f0 con 0x7fe2fc106970 2024-09-21T13:33:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.209+0000 7fe30191f640 1 -- 172.21.15.2:0/2357911269 --> v2:172.21.15.2:6800/2044640733 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fe2fc1033e0 con 0x7fe2e403f8c0 2024-09-21T13:33:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.210+0000 7fe30091d640 1 -- 172.21.15.2:0/2357911269 <== mgr.14118 v2:172.21.15.2:6800/2044640733 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fe2fc1033e0 con 0x7fe2e403f8c0 2024-09-21T13:33:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.212+0000 7fe30191f640 1 -- 172.21.15.2:0/2357911269 >> v2:172.21.15.2:6800/2044640733 conn(0x7fe2e403f8c0 msgr2=0x7fe2e4041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.212+0000 7fe30191f640 1 --2- 172.21.15.2:0/2357911269 >> v2:172.21.15.2:6800/2044640733 conn(0x7fe2e403f8c0 0x7fe2e4041d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00098c0 tx=0x7fe2f0006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.212+0000 7fe30191f640 1 -- 172.21.15.2:0/2357911269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 msgr2=0x7fe2fc19a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.212+0000 7fe30191f640 1 --2- 172.21.15.2:0/2357911269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc19a8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec006f10 tx=0x7fe2ec032670 comp rx=0 tx=0).stop 2024-09-21T13:33:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.212+0000 7fe30191f640 1 -- 172.21.15.2:0/2357911269 shutdown_connections 2024-09-21T13:33:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.212+0000 7fe30191f640 1 --2- 172.21.15.2:0/2357911269 >> v2:172.21.15.2:6800/2044640733 conn(0x7fe2e403f8c0 0x7fe2e4041d80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.212+0000 7fe30191f640 1 --2- 172.21.15.2:0/2357911269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2fc106970 0x7fe2fc19a8f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.212+0000 7fe30191f640 1 -- 172.21.15.2:0/2357911269 >> 172.21.15.2:0/2357911269 conn(0x7fe2fc102280 msgr2=0x7fe2fc102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.212+0000 7fe30191f640 1 -- 172.21.15.2:0/2357911269 shutdown_connections 2024-09-21T13:33:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:39.213+0000 7fe30191f640 1 -- 172.21.15.2:0/2357911269 wait complete. 2024-09-21T13:33:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T13:33:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T13:33:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2024-09-21T13:33:40.080 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:39 smithi002 ceph-mon[30076]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:33:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:40 smithi002 ceph-mon[30076]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:33:42.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:41 smithi002 ceph-mon[30076]: Deploying cephadm binary to smithi002 2024-09-21T13:33:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2024-09-21T13:33:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.284+0000 7ff8c0e0e640 1 Processor -- start 2024-09-21T13:33:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.284+0000 7ff8c0e0e640 1 -- start start 2024-09-21T13:33:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.285+0000 7ff8c0e0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.285+0000 7ff8c0e0e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc107360 con 0x7ff8bc106970 2024-09-21T13:33:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.285+0000 7ff8ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.285+0000 7ff8ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52734/0 (socket says 172.21.15.2:52734) 2024-09-21T13:33:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.285+0000 7ff8ba59c640 1 -- 172.21.15.2:0/2041511199 learned_addr learned my addr 172.21.15.2:0/2041511199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.285+0000 7ff8ba59c640 1 -- 172.21.15.2:0/2041511199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc1074e0 con 0x7ff8bc106970 2024-09-21T13:33:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.286+0000 7ff8ba59c640 1 --2- 172.21.15.2:0/2041511199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc106d70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009820 tx=0x7ff8ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ac8ac718e5b47f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.286+0000 7ff8b959a640 1 -- 172.21.15.2:0/2041511199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac037070 con 0x7ff8bc106970 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.286+0000 7ff8b959a640 1 -- 172.21.15.2:0/2041511199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7ff8ac0328a0 con 0x7ff8bc106970 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.286+0000 7ff8b959a640 1 -- 172.21.15.2:0/2041511199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac030690 con 0x7ff8bc106970 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.287+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/2041511199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 msgr2=0x7ff8bc106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.287+0000 7ff8c0e0e640 1 --2- 172.21.15.2:0/2041511199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc106d70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009820 tx=0x7ff8ac02a270 comp rx=0 tx=0).stop 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.287+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/2041511199 shutdown_connections 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.287+0000 7ff8c0e0e640 1 --2- 172.21.15.2:0/2041511199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc106d70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.287+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/2041511199 >> 172.21.15.2:0/2041511199 conn(0x7ff8bc102280 msgr2=0x7ff8bc1046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.287+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/2041511199 shutdown_connections 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.287+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/2041511199 wait complete. 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.288+0000 7ff8c0e0e640 1 Processor -- start 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.288+0000 7ff8c0e0e640 1 -- start start 2024-09-21T13:33:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.288+0000 7ff8c0e0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.288+0000 7ff8c0e0e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc10adf0 con 0x7ff8bc106970 2024-09-21T13:33:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.288+0000 7ff8ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.288+0000 7ff8ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc19a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52750/0 (socket says 172.21.15.2:52750) 2024-09-21T13:33:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.288+0000 7ff8ba59c640 1 -- 172.21.15.2:0/1613901961 learned_addr learned my addr 172.21.15.2:0/1613901961 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.288+0000 7ff8ba59c640 1 -- 172.21.15.2:0/1613901961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc19ae50 con 0x7ff8bc106970 2024-09-21T13:33:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.288+0000 7ff8ba59c640 1 --2- 172.21.15.2:0/1613901961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc19a8f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac006f10 tx=0x7ff8ac032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.289+0000 7ff8ab7fe640 1 -- 172.21.15.2:0/1613901961 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac037040 con 0x7ff8bc106970 2024-09-21T13:33:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.289+0000 7ff8ab7fe640 1 -- 172.21.15.2:0/1613901961 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7ff8ac040070 con 0x7ff8bc106970 2024-09-21T13:33:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.289+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/1613901961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8bc19b0e0 con 0x7ff8bc106970 2024-09-21T13:33:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.289+0000 7ff8ab7fe640 1 -- 172.21.15.2:0/1613901961 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac03a390 con 0x7ff8bc106970 2024-09-21T13:33:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.289+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/1613901961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8bc19baa0 con 0x7ff8bc106970 2024-09-21T13:33:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.290+0000 7ff8ab7fe640 1 -- 172.21.15.2:0/1613901961 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 51807+0+0 (secure 0 0 0) 0x7ff8ac03b430 con 0x7ff8bc106970 2024-09-21T13:33:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.290+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/1613901961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8bc106df0 con 0x7ff8bc106970 2024-09-21T13:33:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.290+0000 7ff8ab7fe640 1 --2- 172.21.15.2:0/1613901961 >> v2:172.21.15.2:6800/2044640733 conn(0x7ff8a403f8c0 0x7ff8a4041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.290+0000 7ff8ab7fe640 1 -- 172.21.15.2:0/1613901961 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7ff8ac073ec0 con 0x7ff8bc106970 2024-09-21T13:33:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.290+0000 7ff8b9d9b640 1 --2- 172.21.15.2:0/1613901961 >> v2:172.21.15.2:6800/2044640733 conn(0x7ff8a403f8c0 0x7ff8a4041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.291+0000 7ff8b9d9b640 1 --2- 172.21.15.2:0/1613901961 >> v2:172.21.15.2:6800/2044640733 conn(0x7ff8a403f8c0 0x7ff8a4041d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00098c0 tx=0x7ff8b0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.295+0000 7ff8ab7fe640 1 -- 172.21.15.2:0/1613901961 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff8ac032830 con 0x7ff8bc106970 2024-09-21T13:33:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:40.494+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/1613901961 --> v2:172.21.15.2:6800/2044640733 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}) -- 0x7ff8bc19c2f0 con 0x7ff8a403f8c0 2024-09-21T13:33:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:44.317+0000 7ff8ab7fe640 1 -- 172.21.15.2:0/1613901961 <== mgr.14118 v2:172.21.15.2:6800/2044640733 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7ff8bc19c2f0 con 0x7ff8a403f8c0 2024-09-21T13:33:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:44.320+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/1613901961 >> v2:172.21.15.2:6800/2044640733 conn(0x7ff8a403f8c0 msgr2=0x7ff8a4041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:44.320+0000 7ff8c0e0e640 1 --2- 172.21.15.2:0/1613901961 >> v2:172.21.15.2:6800/2044640733 conn(0x7ff8a403f8c0 0x7ff8a4041d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00098c0 tx=0x7ff8b0006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:44.320+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/1613901961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 msgr2=0x7ff8bc19a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:44.320+0000 7ff8c0e0e640 1 --2- 172.21.15.2:0/1613901961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc19a8f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac006f10 tx=0x7ff8ac032670 comp rx=0 tx=0).stop 2024-09-21T13:33:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:44.320+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/1613901961 shutdown_connections 2024-09-21T13:33:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:44.320+0000 7ff8c0e0e640 1 --2- 172.21.15.2:0/1613901961 >> v2:172.21.15.2:6800/2044640733 conn(0x7ff8a403f8c0 0x7ff8a4041d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:44.320+0000 7ff8c0e0e640 1 --2- 172.21.15.2:0/1613901961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc106970 0x7ff8bc19a8f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:44.320+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/1613901961 >> 172.21.15.2:0/1613901961 conn(0x7ff8bc102280 msgr2=0x7ff8bc102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:44.320+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/1613901961 shutdown_connections 2024-09-21T13:33:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:44.320+0000 7ff8c0e0e640 1 -- 172.21.15.2:0/1613901961 wait complete. 2024-09-21T13:33:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mon service... 2024-09-21T13:33:45.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:45 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:45.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:45 smithi002 ceph-mon[30076]: Added host smithi002 2024-09-21T13:33:45.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:45 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:33:46.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T13:33:46.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.411+0000 7f3bc929d640 1 Processor -- start 2024-09-21T13:33:46.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.411+0000 7f3bc929d640 1 -- start start 2024-09-21T13:33:46.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.411+0000 7f3bc929d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc4109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:46.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.412+0000 7f3bc929d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc4109a70 con 0x7f3bc407abf0 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.412+0000 7f3bc2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc4109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.412+0000 7f3bc2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc4109530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52756/0 (socket says 172.21.15.2:52756) 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.412+0000 7f3bc2ffd640 1 -- 172.21.15.2:0/1491428341 learned_addr learned my addr 172.21.15.2:0/1491428341 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.412+0000 7f3bc2ffd640 1 -- 172.21.15.2:0/1491428341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc4109bf0 con 0x7f3bc407abf0 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.413+0000 7f3bc2ffd640 1 --2- 172.21.15.2:0/1491428341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc4109530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009820 tx=0x7f3bbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cd6e297ac16762 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.413+0000 7f3bc1ffb640 1 -- 172.21.15.2:0/1491428341 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc037070 con 0x7f3bc407abf0 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.413+0000 7f3bc1ffb640 1 -- 172.21.15.2:0/1491428341 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f3bbc0328a0 con 0x7f3bc407abf0 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.413+0000 7f3bc1ffb640 1 -- 172.21.15.2:0/1491428341 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc030690 con 0x7f3bc407abf0 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.413+0000 7f3bc929d640 1 -- 172.21.15.2:0/1491428341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 msgr2=0x7f3bc4109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.413+0000 7f3bc929d640 1 --2- 172.21.15.2:0/1491428341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc4109530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009820 tx=0x7f3bbc02a270 comp rx=0 tx=0).stop 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.413+0000 7f3bc929d640 1 -- 172.21.15.2:0/1491428341 shutdown_connections 2024-09-21T13:33:46.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.413+0000 7f3bc929d640 1 --2- 172.21.15.2:0/1491428341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc4109530 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.413+0000 7f3bc929d640 1 -- 172.21.15.2:0/1491428341 >> 172.21.15.2:0/1491428341 conn(0x7f3bc41010e0 msgr2=0x7f3bc4103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.413+0000 7f3bc929d640 1 -- 172.21.15.2:0/1491428341 shutdown_connections 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.414+0000 7f3bc929d640 1 -- 172.21.15.2:0/1491428341 wait complete. 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.414+0000 7f3bc929d640 1 Processor -- start 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.414+0000 7f3bc929d640 1 -- start start 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.414+0000 7f3bc929d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.414+0000 7f3bc929d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc410abe0 con 0x7f3bc407abf0 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.414+0000 7f3bc2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.415+0000 7f3bc2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc419a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52762/0 (socket says 172.21.15.2:52762) 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.415+0000 7f3bc2ffd640 1 -- 172.21.15.2:0/3909387348 learned_addr learned my addr 172.21.15.2:0/3909387348 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.415+0000 7f3bc2ffd640 1 -- 172.21.15.2:0/3909387348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc419ad70 con 0x7f3bc407abf0 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.415+0000 7f3bc2ffd640 1 --2- 172.21.15.2:0/3909387348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc419a810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc006f10 tx=0x7f3bbc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.415+0000 7f3bbbfff640 1 -- 172.21.15.2:0/3909387348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc037040 con 0x7f3bc407abf0 2024-09-21T13:33:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.415+0000 7f3bc929d640 1 -- 172.21.15.2:0/3909387348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc419b000 con 0x7f3bc407abf0 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.415+0000 7f3bbbfff640 1 -- 172.21.15.2:0/3909387348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f3bbc040070 con 0x7f3bc407abf0 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.415+0000 7f3bbbfff640 1 -- 172.21.15.2:0/3909387348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc03a390 con 0x7f3bc407abf0 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.415+0000 7f3bc929d640 1 -- 172.21.15.2:0/3909387348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc419ba40 con 0x7f3bc407abf0 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.416+0000 7f3bbbfff640 1 -- 172.21.15.2:0/3909387348 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 51807+0+0 (secure 0 0 0) 0x7f3bbc03b430 con 0x7f3bc407abf0 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.416+0000 7f3bc929d640 1 -- 172.21.15.2:0/3909387348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc41075a0 con 0x7f3bc407abf0 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.416+0000 7f3bbbfff640 1 --2- 172.21.15.2:0/3909387348 >> v2:172.21.15.2:6800/2044640733 conn(0x7f3bb003f870 0x7f3bb0041d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.416+0000 7f3bbbfff640 1 -- 172.21.15.2:0/3909387348 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f3bbc073fb0 con 0x7f3bc407abf0 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.416+0000 7f3bc27fc640 1 --2- 172.21.15.2:0/3909387348 >> v2:172.21.15.2:6800/2044640733 conn(0x7f3bb003f870 0x7f3bb0041d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.417+0000 7f3bc27fc640 1 --2- 172.21.15.2:0/3909387348 >> v2:172.21.15.2:6800/2044640733 conn(0x7f3bb003f870 0x7f3bb0041d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0098c0 tx=0x7f3bac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.421+0000 7f3bbbfff640 1 -- 172.21.15.2:0/3909387348 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3bbc041270 con 0x7f3bc407abf0 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.625+0000 7f3bc929d640 1 -- 172.21.15.2:0/3909387348 --> v2:172.21.15.2:6800/2044640733 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f3bc419c220 con 0x7f3bb003f870 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.629+0000 7f3bbbfff640 1 -- 172.21.15.2:0/3909387348 <== mgr.14118 v2:172.21.15.2:6800/2044640733 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3bc419c220 con 0x7f3bb003f870 2024-09-21T13:33:46.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.632+0000 7f3bc929d640 1 -- 172.21.15.2:0/3909387348 >> v2:172.21.15.2:6800/2044640733 conn(0x7f3bb003f870 msgr2=0x7f3bb0041d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:46.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.632+0000 7f3bc929d640 1 --2- 172.21.15.2:0/3909387348 >> v2:172.21.15.2:6800/2044640733 conn(0x7f3bb003f870 0x7f3bb0041d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0098c0 tx=0x7f3bac006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:46.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.632+0000 7f3bc929d640 1 -- 172.21.15.2:0/3909387348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 msgr2=0x7f3bc419a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:46.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.632+0000 7f3bc929d640 1 --2- 172.21.15.2:0/3909387348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc419a810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc006f10 tx=0x7f3bbc032670 comp rx=0 tx=0).stop 2024-09-21T13:33:46.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.632+0000 7f3bc929d640 1 -- 172.21.15.2:0/3909387348 shutdown_connections 2024-09-21T13:33:46.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.632+0000 7f3bc929d640 1 --2- 172.21.15.2:0/3909387348 >> v2:172.21.15.2:6800/2044640733 conn(0x7f3bb003f870 0x7f3bb0041d30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:46.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.632+0000 7f3bc929d640 1 --2- 172.21.15.2:0/3909387348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc407abf0 0x7f3bc419a810 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:46.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.632+0000 7f3bc929d640 1 -- 172.21.15.2:0/3909387348 >> 172.21.15.2:0/3909387348 conn(0x7f3bc41010e0 msgr2=0x7f3bc4101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:46.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.632+0000 7f3bc929d640 1 -- 172.21.15.2:0/3909387348 shutdown_connections 2024-09-21T13:33:46.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:45.632+0000 7f3bc929d640 1 -- 172.21.15.2:0/3909387348 wait complete. 2024-09-21T13:33:46.487 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mgr service... 2024-09-21T13:33:46.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:46 smithi002 ceph-mon[30076]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:33:46.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:46 smithi002 ceph-mon[30076]: Saving service mon spec with placement count:5 2024-09-21T13:33:46.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:46 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T13:33:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.913+0000 7fa8efa20640 1 Processor -- start 2024-09-21T13:33:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.913+0000 7fa8efa20640 1 -- start start 2024-09-21T13:33:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.913+0000 7fa8efa20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e8106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.913+0000 7fa8efa20640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e8107350 con 0x7fa8e8106960 2024-09-21T13:33:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.913+0000 7fa8ed7bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e8106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.913+0000 7fa8ed7bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e8106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49564/0 (socket says 172.21.15.2:49564) 2024-09-21T13:33:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.913+0000 7fa8ed7bc640 1 -- 172.21.15.2:0/2624106450 learned_addr learned my addr 172.21.15.2:0/2624106450 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.914+0000 7fa8ed7bc640 1 -- 172.21.15.2:0/2624106450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e81074d0 con 0x7fa8e8106960 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.914+0000 7fa8ed7bc640 1 --2- 172.21.15.2:0/2624106450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e8106d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009820 tx=0x7fa8e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8c089686e5648 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.914+0000 7fa8dffff640 1 -- 172.21.15.2:0/2624106450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e4037070 con 0x7fa8e8106960 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.914+0000 7fa8dffff640 1 -- 172.21.15.2:0/2624106450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fa8e40328a0 con 0x7fa8e8106960 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.914+0000 7fa8dffff640 1 -- 172.21.15.2:0/2624106450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e4030690 con 0x7fa8e8106960 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.915+0000 7fa8efa20640 1 -- 172.21.15.2:0/2624106450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 msgr2=0x7fa8e8106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.915+0000 7fa8efa20640 1 --2- 172.21.15.2:0/2624106450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e8106d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009820 tx=0x7fa8e402a270 comp rx=0 tx=0).stop 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.915+0000 7fa8efa20640 1 -- 172.21.15.2:0/2624106450 shutdown_connections 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.915+0000 7fa8efa20640 1 --2- 172.21.15.2:0/2624106450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e8106d60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.915+0000 7fa8efa20640 1 -- 172.21.15.2:0/2624106450 >> 172.21.15.2:0/2624106450 conn(0x7fa8e8102250 msgr2=0x7fa8e8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.915+0000 7fa8efa20640 1 -- 172.21.15.2:0/2624106450 shutdown_connections 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.915+0000 7fa8efa20640 1 -- 172.21.15.2:0/2624106450 wait complete. 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.916+0000 7fa8efa20640 1 Processor -- start 2024-09-21T13:33:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.916+0000 7fa8efa20640 1 -- start start 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.916+0000 7fa8efa20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e807c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.916+0000 7fa8efa20640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e810ade0 con 0x7fa8e8106960 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.916+0000 7fa8ed7bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e807c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.916+0000 7fa8ed7bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e807c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49578/0 (socket says 172.21.15.2:49578) 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.916+0000 7fa8ed7bc640 1 -- 172.21.15.2:0/2346518697 learned_addr learned my addr 172.21.15.2:0/2346518697 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.916+0000 7fa8ed7bc640 1 -- 172.21.15.2:0/2346518697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e807cee0 con 0x7fa8e8106960 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.916+0000 7fa8ed7bc640 1 --2- 172.21.15.2:0/2346518697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e807c980 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4006f10 tx=0x7fa8e4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.917+0000 7fa8de7fc640 1 -- 172.21.15.2:0/2346518697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e4037040 con 0x7fa8e8106960 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.917+0000 7fa8de7fc640 1 -- 172.21.15.2:0/2346518697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fa8e4040070 con 0x7fa8e8106960 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.917+0000 7fa8efa20640 1 -- 172.21.15.2:0/2346518697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e807b2d0 con 0x7fa8e8106960 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.917+0000 7fa8de7fc640 1 -- 172.21.15.2:0/2346518697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e403a390 con 0x7fa8e8106960 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.917+0000 7fa8efa20640 1 -- 172.21.15.2:0/2346518697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e807b850 con 0x7fa8e8106960 2024-09-21T13:33:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.918+0000 7fa8de7fc640 1 -- 172.21.15.2:0/2346518697 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 51807+0+0 (secure 0 0 0) 0x7fa8e403a600 con 0x7fa8e8106960 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.918+0000 7fa8efa20640 1 -- 172.21.15.2:0/2346518697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e8106de0 con 0x7fa8e8106960 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.918+0000 7fa8de7fc640 1 --2- 172.21.15.2:0/2346518697 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa8d403f8c0 0x7fa8d4041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.918+0000 7fa8de7fc640 1 -- 172.21.15.2:0/2346518697 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fa8e4073f40 con 0x7fa8e8106960 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.918+0000 7fa8ecfbb640 1 --2- 172.21.15.2:0/2346518697 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa8d403f8c0 0x7fa8d4041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.918+0000 7fa8ecfbb640 1 --2- 172.21.15.2:0/2346518697 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa8d403f8c0 0x7fa8d4041d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80098c0 tx=0x7fa8d8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:46.923+0000 7fa8de7fc640 1 -- 172.21.15.2:0/2346518697 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8e4073ca0 con 0x7fa8e8106960 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.125+0000 7fa8efa20640 1 -- 172.21.15.2:0/2346518697 --> v2:172.21.15.2:6800/2044640733 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fa8e807bf00 con 0x7fa8d403f8c0 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.131+0000 7fa8de7fc640 1 -- 172.21.15.2:0/2346518697 <== mgr.14118 v2:172.21.15.2:6800/2044640733 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa8e807bf00 con 0x7fa8d403f8c0 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.133+0000 7fa8efa20640 1 -- 172.21.15.2:0/2346518697 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa8d403f8c0 msgr2=0x7fa8d4041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.133+0000 7fa8efa20640 1 --2- 172.21.15.2:0/2346518697 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa8d403f8c0 0x7fa8d4041d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80098c0 tx=0x7fa8d8006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.133+0000 7fa8efa20640 1 -- 172.21.15.2:0/2346518697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 msgr2=0x7fa8e807c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.133+0000 7fa8efa20640 1 --2- 172.21.15.2:0/2346518697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e807c980 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4006f10 tx=0x7fa8e4032670 comp rx=0 tx=0).stop 2024-09-21T13:33:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.133+0000 7fa8efa20640 1 -- 172.21.15.2:0/2346518697 shutdown_connections 2024-09-21T13:33:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.133+0000 7fa8efa20640 1 --2- 172.21.15.2:0/2346518697 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa8d403f8c0 0x7fa8d4041d80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.133+0000 7fa8efa20640 1 --2- 172.21.15.2:0/2346518697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e8106960 0x7fa8e807c980 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.133+0000 7fa8efa20640 1 -- 172.21.15.2:0/2346518697 >> 172.21.15.2:0/2346518697 conn(0x7fa8e8102250 msgr2=0x7fa8e8102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.134+0000 7fa8efa20640 1 -- 172.21.15.2:0/2346518697 shutdown_connections 2024-09-21T13:33:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:47.134+0000 7fa8efa20640 1 -- 172.21.15.2:0/2346518697 wait complete. 2024-09-21T13:33:48.191 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:48 smithi002 ceph-mon[30076]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:33:48.191 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:48 smithi002 ceph-mon[30076]: Saving service mgr spec with placement count:2 2024-09-21T13:33:48.192 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:48 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:49.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:49 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:49.626 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:49 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:49.626 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/696011710' entity='client.admin' 2024-09-21T13:33:49.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.834+0000 7f31a6b07640 1 Processor -- start 2024-09-21T13:33:49.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.834+0000 7f31a6b07640 1 -- start start 2024-09-21T13:33:49.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.834+0000 7f31a6b07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a0109570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:49.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.834+0000 7f31a6b07640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31a0109ab0 con 0x7f31a007a3f0 2024-09-21T13:33:49.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.834+0000 7f31a48a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a0109570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:49.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.834+0000 7f31a48a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a0109570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49594/0 (socket says 172.21.15.2:49594) 2024-09-21T13:33:49.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.834+0000 7f31a48a3640 1 -- 172.21.15.2:0/2791430236 learned_addr learned my addr 172.21.15.2:0/2791430236 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:49.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.835+0000 7f31a48a3640 1 -- 172.21.15.2:0/2791430236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a0109c30 con 0x7f31a007a3f0 2024-09-21T13:33:49.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.835+0000 7f31a48a3640 1 --2- 172.21.15.2:0/2791430236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a0109570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3188009820 tx=0x7f318802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8d03ec5dc785a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:49.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.836+0000 7f319f7fe640 1 -- 172.21.15.2:0/2791430236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188037070 con 0x7f31a007a3f0 2024-09-21T13:33:49.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.836+0000 7f319f7fe640 1 -- 172.21.15.2:0/2791430236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f31880328c0 con 0x7f31a007a3f0 2024-09-21T13:33:49.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.836+0000 7f319f7fe640 1 -- 172.21.15.2:0/2791430236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188030640 con 0x7f31a007a3f0 2024-09-21T13:33:49.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.836+0000 7f31a6b07640 1 -- 172.21.15.2:0/2791430236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 msgr2=0x7f31a0109570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:49.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.836+0000 7f31a6b07640 1 --2- 172.21.15.2:0/2791430236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a0109570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3188009820 tx=0x7f318802a270 comp rx=0 tx=0).stop 2024-09-21T13:33:49.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.836+0000 7f31a6b07640 1 -- 172.21.15.2:0/2791430236 shutdown_connections 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.836+0000 7f31a6b07640 1 --2- 172.21.15.2:0/2791430236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a0109570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.836+0000 7f31a6b07640 1 -- 172.21.15.2:0/2791430236 >> 172.21.15.2:0/2791430236 conn(0x7f31a01011c0 msgr2=0x7f31a01035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.836+0000 7f31a6b07640 1 -- 172.21.15.2:0/2791430236 shutdown_connections 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.836+0000 7f31a6b07640 1 -- 172.21.15.2:0/2791430236 wait complete. 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.837+0000 7f31a6b07640 1 Processor -- start 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.837+0000 7f31a6b07640 1 -- start start 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.837+0000 7f31a6b07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.837+0000 7f31a6b07640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31a010ace0 con 0x7f31a007a3f0 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.837+0000 7f31a48a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.837+0000 7f31a48a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a019a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49610/0 (socket says 172.21.15.2:49610) 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.837+0000 7f31a48a3640 1 -- 172.21.15.2:0/696011710 learned_addr learned my addr 172.21.15.2:0/696011710 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:49.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.837+0000 7f31a48a3640 1 -- 172.21.15.2:0/696011710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a019ad90 con 0x7f31a007a3f0 2024-09-21T13:33:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.838+0000 7f31a48a3640 1 --2- 172.21.15.2:0/696011710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a019a830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3188000c00 tx=0x7f3188030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.838+0000 7f319dffb640 1 -- 172.21.15.2:0/696011710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188037040 con 0x7f31a007a3f0 2024-09-21T13:33:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.838+0000 7f319dffb640 1 -- 172.21.15.2:0/696011710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f3188040070 con 0x7f31a007a3f0 2024-09-21T13:33:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.838+0000 7f31a6b07640 1 -- 172.21.15.2:0/696011710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a019b020 con 0x7f31a007a3f0 2024-09-21T13:33:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.838+0000 7f319dffb640 1 -- 172.21.15.2:0/696011710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318803a390 con 0x7f31a007a3f0 2024-09-21T13:33:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.838+0000 7f31a6b07640 1 -- 172.21.15.2:0/696011710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a019b9e0 con 0x7f31a007a3f0 2024-09-21T13:33:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.839+0000 7f319dffb640 1 -- 172.21.15.2:0/696011710 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 51807+0+0 (secure 0 0 0) 0x7f318803a610 con 0x7f31a007a3f0 2024-09-21T13:33:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.839+0000 7f31a6b07640 1 -- 172.21.15.2:0/696011710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a0107560 con 0x7f31a007a3f0 2024-09-21T13:33:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.839+0000 7f319dffb640 1 --2- 172.21.15.2:0/696011710 >> v2:172.21.15.2:6800/2044640733 conn(0x7f318c03f870 0x7f318c041d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.839+0000 7f319dffb640 1 -- 172.21.15.2:0/696011710 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f31880741c0 con 0x7f31a007a3f0 2024-09-21T13:33:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.839+0000 7f319ffff640 1 --2- 172.21.15.2:0/696011710 >> v2:172.21.15.2:6800/2044640733 conn(0x7f318c03f870 0x7f318c041d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.840+0000 7f319ffff640 1 --2- 172.21.15.2:0/696011710 >> v2:172.21.15.2:6800/2044640733 conn(0x7f318c03f870 0x7f318c041d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f31900098c0 tx=0x7f3190006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:48.844+0000 7f319dffb640 1 -- 172.21.15.2:0/696011710 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f318803a900 con 0x7f31a007a3f0 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.042+0000 7f31a6b07640 1 -- 172.21.15.2:0/696011710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f31a019c120 con 0x7f31a007a3f0 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.045+0000 7f319dffb640 1 -- 172.21.15.2:0/696011710 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f3188073f20 con 0x7f31a007a3f0 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.048+0000 7f31a6b07640 1 -- 172.21.15.2:0/696011710 >> v2:172.21.15.2:6800/2044640733 conn(0x7f318c03f870 msgr2=0x7f318c041d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.048+0000 7f31a6b07640 1 --2- 172.21.15.2:0/696011710 >> v2:172.21.15.2:6800/2044640733 conn(0x7f318c03f870 0x7f318c041d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f31900098c0 tx=0x7f3190006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.048+0000 7f31a6b07640 1 -- 172.21.15.2:0/696011710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 msgr2=0x7f31a019a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.048+0000 7f31a6b07640 1 --2- 172.21.15.2:0/696011710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a019a830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3188000c00 tx=0x7f3188030b70 comp rx=0 tx=0).stop 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.048+0000 7f31a6b07640 1 -- 172.21.15.2:0/696011710 shutdown_connections 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.048+0000 7f31a6b07640 1 --2- 172.21.15.2:0/696011710 >> v2:172.21.15.2:6800/2044640733 conn(0x7f318c03f870 0x7f318c041d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.048+0000 7f31a6b07640 1 --2- 172.21.15.2:0/696011710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a007a3f0 0x7f31a019a830 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.048+0000 7f31a6b07640 1 -- 172.21.15.2:0/696011710 >> 172.21.15.2:0/696011710 conn(0x7f31a01011c0 msgr2=0x7f31a0101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:49.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.048+0000 7f31a6b07640 1 -- 172.21.15.2:0/696011710 shutdown_connections 2024-09-21T13:33:49.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:49.048+0000 7f31a6b07640 1 -- 172.21.15.2:0/696011710 wait complete. 2024-09-21T13:33:51.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.141+0000 7f5bf9e89640 1 Processor -- start 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.141+0000 7f5bf9e89640 1 -- start start 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.141+0000 7f5bf9e89640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf4106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.141+0000 7f5bf9e89640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf4107360 con 0x7f5bf4106970 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.142+0000 7f5bf37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf4106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.142+0000 7f5bf37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf4106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49620/0 (socket says 172.21.15.2:49620) 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.142+0000 7f5bf37fe640 1 -- 172.21.15.2:0/1593444931 learned_addr learned my addr 172.21.15.2:0/1593444931 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.142+0000 7f5bf37fe640 1 -- 172.21.15.2:0/1593444931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf41074e0 con 0x7f5bf4106970 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.143+0000 7f5bf37fe640 1 --2- 172.21.15.2:0/1593444931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf4106d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009820 tx=0x7f5be402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dda0106ef8caa5c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.143+0000 7f5bf2ffd640 1 -- 172.21.15.2:0/1593444931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be4037070 con 0x7f5bf4106970 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.143+0000 7f5bf2ffd640 1 -- 172.21.15.2:0/1593444931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5be40328c0 con 0x7f5bf4106970 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.143+0000 7f5bf2ffd640 1 -- 172.21.15.2:0/1593444931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be4030640 con 0x7f5bf4106970 2024-09-21T13:33:51.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.143+0000 7f5bf9e89640 1 -- 172.21.15.2:0/1593444931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 msgr2=0x7f5bf4106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.143+0000 7f5bf9e89640 1 --2- 172.21.15.2:0/1593444931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf4106d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009820 tx=0x7f5be402a270 comp rx=0 tx=0).stop 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.143+0000 7f5bf9e89640 1 -- 172.21.15.2:0/1593444931 shutdown_connections 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.143+0000 7f5bf9e89640 1 --2- 172.21.15.2:0/1593444931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf4106d70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.143+0000 7f5bf9e89640 1 -- 172.21.15.2:0/1593444931 >> 172.21.15.2:0/1593444931 conn(0x7f5bf4102280 msgr2=0x7f5bf41046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.143+0000 7f5bf9e89640 1 -- 172.21.15.2:0/1593444931 shutdown_connections 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.143+0000 7f5bf9e89640 1 -- 172.21.15.2:0/1593444931 wait complete. 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.144+0000 7f5bf9e89640 1 Processor -- start 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.144+0000 7f5bf9e89640 1 -- start start 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.144+0000 7f5bf9e89640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf419a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.144+0000 7f5bf9e89640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf410adf0 con 0x7f5bf4106970 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.145+0000 7f5bf37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf419a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.145+0000 7f5bf37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf419a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49630/0 (socket says 172.21.15.2:49630) 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.145+0000 7f5bf37fe640 1 -- 172.21.15.2:0/2478663548 learned_addr learned my addr 172.21.15.2:0/2478663548 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:51.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.145+0000 7f5bf37fe640 1 -- 172.21.15.2:0/2478663548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf419adb0 con 0x7f5bf4106970 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.145+0000 7f5bf37fe640 1 --2- 172.21.15.2:0/2478663548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf419a850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5be402a830 tx=0x7f5be4030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.145+0000 7f5bf17fa640 1 -- 172.21.15.2:0/2478663548 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be4037040 con 0x7f5bf4106970 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.145+0000 7f5bf17fa640 1 -- 172.21.15.2:0/2478663548 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5be4040070 con 0x7f5bf4106970 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.145+0000 7f5bf9e89640 1 -- 172.21.15.2:0/2478663548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf419b040 con 0x7f5bf4106970 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.145+0000 7f5bf17fa640 1 -- 172.21.15.2:0/2478663548 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be403be40 con 0x7f5bf4106970 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.145+0000 7f5bf9e89640 1 -- 172.21.15.2:0/2478663548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf419ba00 con 0x7f5bf4106970 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.146+0000 7f5bf9e89640 1 -- 172.21.15.2:0/2478663548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf4106d70 con 0x7f5bf4106970 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.146+0000 7f5bf17fa640 1 -- 172.21.15.2:0/2478663548 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 51807+0+0 (secure 0 0 0) 0x7f5be403a4a0 con 0x7f5bf4106970 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.147+0000 7f5bf17fa640 1 --2- 172.21.15.2:0/2478663548 >> v2:172.21.15.2:6800/2044640733 conn(0x7f5be003f8c0 0x7f5be0041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.147+0000 7f5bf17fa640 1 -- 172.21.15.2:0/2478663548 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f5be4074080 con 0x7f5bf4106970 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.147+0000 7f5beaffd640 1 --2- 172.21.15.2:0/2478663548 >> v2:172.21.15.2:6800/2044640733 conn(0x7f5be003f8c0 0x7f5be0041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.147+0000 7f5beaffd640 1 --2- 172.21.15.2:0/2478663548 >> v2:172.21.15.2:6800/2044640733 conn(0x7f5be003f8c0 0x7f5be0041d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0098c0 tx=0x7f5bdc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:51.093 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.151+0000 7f5bf17fa640 1 -- 172.21.15.2:0/2478663548 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5be40328c0 con 0x7f5bf4106970 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.355+0000 7f5bf9e89640 1 -- 172.21.15.2:0/2478663548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f5bf419c270 con 0x7f5bf4106970 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.357+0000 7f5bf17fa640 1 -- 172.21.15.2:0/2478663548 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f5be4073de0 con 0x7f5bf4106970 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.360+0000 7f5bf9e89640 1 -- 172.21.15.2:0/2478663548 >> v2:172.21.15.2:6800/2044640733 conn(0x7f5be003f8c0 msgr2=0x7f5be0041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.360+0000 7f5bf9e89640 1 --2- 172.21.15.2:0/2478663548 >> v2:172.21.15.2:6800/2044640733 conn(0x7f5be003f8c0 0x7f5be0041d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0098c0 tx=0x7f5bdc006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.360+0000 7f5bf9e89640 1 -- 172.21.15.2:0/2478663548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 msgr2=0x7f5bf419a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.360+0000 7f5bf9e89640 1 --2- 172.21.15.2:0/2478663548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf419a850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5be402a830 tx=0x7f5be4030bc0 comp rx=0 tx=0).stop 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.360+0000 7f5bf9e89640 1 -- 172.21.15.2:0/2478663548 shutdown_connections 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.360+0000 7f5bf9e89640 1 --2- 172.21.15.2:0/2478663548 >> v2:172.21.15.2:6800/2044640733 conn(0x7f5be003f8c0 0x7f5be0041d80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.360+0000 7f5bf9e89640 1 --2- 172.21.15.2:0/2478663548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bf4106970 0x7f5bf419a850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.360+0000 7f5bf9e89640 1 -- 172.21.15.2:0/2478663548 >> 172.21.15.2:0/2478663548 conn(0x7f5bf4102280 msgr2=0x7f5bf4102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.360+0000 7f5bf9e89640 1 -- 172.21.15.2:0/2478663548 shutdown_connections 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:50.360+0000 7f5bf9e89640 1 -- 172.21.15.2:0/2478663548 wait complete. 2024-09-21T13:33:51.094 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2024-09-21T13:33:51.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2478663548' entity='client.admin' 2024-09-21T13:33:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:52 smithi002 ceph-mon[30076]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:33:53.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:52 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:53.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3095766144' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T13:33:53.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:52 smithi002 ceph-mon[30076]: from='mgr.14118 172.21.15.2:0/4238019204' entity='mgr.y' 2024-09-21T13:33:53.101 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:52 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ignoring --setuser ceph since I am not root 2024-09-21T13:33:53.101 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:33:52 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ignoring --setgroup ceph since I am not root 2024-09-21T13:33:53.955 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3095766144' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T13:33:53.955 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:53 smithi002 ceph-mon[30076]: mgrmap e9: y(active, since 21s) 2024-09-21T13:33:53.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.005+0000 7fa97e813640 1 Processor -- start 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.006+0000 7fa97e813640 1 -- start start 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.006+0000 7fa97e813640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.006+0000 7fa97e813640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa978109a70 con 0x7fa97807a430 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.006+0000 7fa977fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.006+0000 7fa977fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978109530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49642/0 (socket says 172.21.15.2:49642) 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.006+0000 7fa977fff640 1 -- 172.21.15.2:0/2779590663 learned_addr learned my addr 172.21.15.2:0/2779590663 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.006+0000 7fa977fff640 1 -- 172.21.15.2:0/2779590663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa978109bf0 con 0x7fa97807a430 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.007+0000 7fa977fff640 1 --2- 172.21.15.2:0/2779590663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978109530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa968009820 tx=0x7fa96802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85bfaf4bc0568a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.007+0000 7fa976ffd640 1 -- 172.21.15.2:0/2779590663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa968037070 con 0x7fa97807a430 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.007+0000 7fa976ffd640 1 -- 172.21.15.2:0/2779590663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fa9680328c0 con 0x7fa97807a430 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.007+0000 7fa976ffd640 1 -- 172.21.15.2:0/2779590663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680306d0 con 0x7fa97807a430 2024-09-21T13:33:53.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.008+0000 7fa97e813640 1 -- 172.21.15.2:0/2779590663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 msgr2=0x7fa978109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.008+0000 7fa97e813640 1 --2- 172.21.15.2:0/2779590663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978109530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa968009820 tx=0x7fa96802a300 comp rx=0 tx=0).stop 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.008+0000 7fa97e813640 1 -- 172.21.15.2:0/2779590663 shutdown_connections 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.008+0000 7fa97e813640 1 --2- 172.21.15.2:0/2779590663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978109530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.008+0000 7fa97e813640 1 -- 172.21.15.2:0/2779590663 >> 172.21.15.2:0/2779590663 conn(0x7fa9781011c0 msgr2=0x7fa9781035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.008+0000 7fa97e813640 1 -- 172.21.15.2:0/2779590663 shutdown_connections 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.008+0000 7fa97e813640 1 -- 172.21.15.2:0/2779590663 wait complete. 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.009+0000 7fa97e813640 1 Processor -- start 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.009+0000 7fa97e813640 1 -- start start 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.009+0000 7fa97e813640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978106b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.009+0000 7fa97e813640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa97810acf0 con 0x7fa97807a430 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.009+0000 7fa977fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.009+0000 7fa977fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49644/0 (socket says 172.21.15.2:49644) 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.009+0000 7fa977fff640 1 -- 172.21.15.2:0/3095766144 learned_addr learned my addr 172.21.15.2:0/3095766144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:53.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.009+0000 7fa977fff640 1 -- 172.21.15.2:0/3095766144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9781070e0 con 0x7fa97807a430 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.010+0000 7fa977fff640 1 --2- 172.21.15.2:0/3095766144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978106b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa968000c00 tx=0x7fa968030a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.010+0000 7fa9757fa640 1 -- 172.21.15.2:0/3095766144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa968037040 con 0x7fa97807a430 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.010+0000 7fa9757fa640 1 -- 172.21.15.2:0/3095766144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fa968040070 con 0x7fa97807a430 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.010+0000 7fa97e813640 1 -- 172.21.15.2:0/3095766144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9781054d0 con 0x7fa97807a430 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.010+0000 7fa9757fa640 1 -- 172.21.15.2:0/3095766144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96803be20 con 0x7fa97807a430 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.010+0000 7fa97e813640 1 -- 172.21.15.2:0/3095766144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa978105a50 con 0x7fa97807a430 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.011+0000 7fa9757fa640 1 -- 172.21.15.2:0/3095766144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 51807+0+0 (secure 0 0 0) 0x7fa968045460 con 0x7fa97807a430 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.011+0000 7fa97e813640 1 -- 172.21.15.2:0/3095766144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9781072b0 con 0x7fa97807a430 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.011+0000 7fa9757fa640 1 --2- 172.21.15.2:0/3095766144 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa96003f870 0x7fa960041d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.011+0000 7fa9757fa640 1 -- 172.21.15.2:0/3095766144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fa968074080 con 0x7fa97807a430 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.012+0000 7fa9777fe640 1 --2- 172.21.15.2:0/3095766144 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa96003f870 0x7fa960041d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.012+0000 7fa9777fe640 1 --2- 172.21.15.2:0/3095766144 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa96003f870 0x7fa960041d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0098c0 tx=0x7fa96c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:53.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.017+0000 7fa9757fa640 1 -- 172.21.15.2:0/3095766144 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa968030de0 con 0x7fa97807a430 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.292+0000 7fa97e813640 1 -- 172.21.15.2:0/3095766144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fa978105f80 con 0x7fa97807a430 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.815+0000 7fa9757fa640 1 -- 172.21.15.2:0/3095766144 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fa968073de0 con 0x7fa97807a430 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.818+0000 7fa9757fa640 1 -- 172.21.15.2:0/3095766144 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 9) ==== 51820+0+0 (secure 0 0 0) 0x7fa968045ad0 con 0x7fa97807a430 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.819+0000 7fa97e813640 1 -- 172.21.15.2:0/3095766144 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa96003f870 msgr2=0x7fa960041d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.819+0000 7fa97e813640 1 --2- 172.21.15.2:0/3095766144 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa96003f870 0x7fa960041d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0098c0 tx=0x7fa96c006db0 comp rx=0 tx=0).stop 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.819+0000 7fa97e813640 1 -- 172.21.15.2:0/3095766144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 msgr2=0x7fa978106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.819+0000 7fa97e813640 1 --2- 172.21.15.2:0/3095766144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978106b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa968000c00 tx=0x7fa968030a60 comp rx=0 tx=0).stop 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.819+0000 7fa97e813640 1 -- 172.21.15.2:0/3095766144 shutdown_connections 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.819+0000 7fa97e813640 1 --2- 172.21.15.2:0/3095766144 >> v2:172.21.15.2:6800/2044640733 conn(0x7fa96003f870 0x7fa960041d30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.819+0000 7fa97e813640 1 --2- 172.21.15.2:0/3095766144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97807a430 0x7fa978106b80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.819+0000 7fa97e813640 1 -- 172.21.15.2:0/3095766144 >> 172.21.15.2:0/3095766144 conn(0x7fa9781011c0 msgr2=0x7fa978101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.819+0000 7fa97e813640 1 -- 172.21.15.2:0/3095766144 shutdown_connections 2024-09-21T13:33:53.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:52.819+0000 7fa97e813640 1 -- 172.21.15.2:0/3095766144 wait complete. 2024-09-21T13:33:55.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/274421425' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T13:33:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-21T13:33:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.852+0000 7f23cb1e8640 1 Processor -- start 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.852+0000 7f23cb1e8640 1 -- start start 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.852+0000 7f23cb1e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c4109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.852+0000 7f23cb1e8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23c4109a70 con 0x7f23c407a430 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.852+0000 7f23c8f84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c4109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.852+0000 7f23c8f84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c4109530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49684/0 (socket says 172.21.15.2:49684) 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.852+0000 7f23c8f84640 1 -- 172.21.15.2:0/3532069255 learned_addr learned my addr 172.21.15.2:0/3532069255 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.853+0000 7f23c8f84640 1 -- 172.21.15.2:0/3532069255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c4109bf0 con 0x7f23c407a430 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.853+0000 7f23c8f84640 1 --2- 172.21.15.2:0/3532069255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c4109530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009820 tx=0x7f23b802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8cd90377c3ad0e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.853+0000 7f23c37fe640 1 -- 172.21.15.2:0/3532069255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b8037070 con 0x7f23c407a430 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.854+0000 7f23c37fe640 1 -- 172.21.15.2:0/3532069255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f23b80328c0 con 0x7f23c407a430 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.854+0000 7f23c37fe640 1 -- 172.21.15.2:0/3532069255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b80306d0 con 0x7f23c407a430 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.854+0000 7f23cb1e8640 1 -- 172.21.15.2:0/3532069255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 msgr2=0x7f23c4109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.854+0000 7f23cb1e8640 1 --2- 172.21.15.2:0/3532069255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c4109530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009820 tx=0x7f23b802a300 comp rx=0 tx=0).stop 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.854+0000 7f23cb1e8640 1 -- 172.21.15.2:0/3532069255 shutdown_connections 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.854+0000 7f23cb1e8640 1 --2- 172.21.15.2:0/3532069255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c4109530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.854+0000 7f23cb1e8640 1 -- 172.21.15.2:0/3532069255 >> 172.21.15.2:0/3532069255 conn(0x7f23c41011c0 msgr2=0x7f23c41035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.854+0000 7f23cb1e8640 1 -- 172.21.15.2:0/3532069255 shutdown_connections 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.854+0000 7f23cb1e8640 1 -- 172.21.15.2:0/3532069255 wait complete. 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.855+0000 7f23cb1e8640 1 Processor -- start 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.855+0000 7f23cb1e8640 1 -- start start 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.855+0000 7f23cb1e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.855+0000 7f23cb1e8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23c410acf0 con 0x7f23c407a430 2024-09-21T13:33:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.855+0000 7f23c8f84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.855+0000 7f23c8f84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49688/0 (socket says 172.21.15.2:49688) 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.855+0000 7f23c8f84640 1 -- 172.21.15.2:0/274421425 learned_addr learned my addr 172.21.15.2:0/274421425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.855+0000 7f23c8f84640 1 -- 172.21.15.2:0/274421425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c419cfd0 con 0x7f23c407a430 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.856+0000 7f23c8f84640 1 --2- 172.21.15.2:0/274421425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c419ca70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23b8032b90 tx=0x7f23b8032790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.856+0000 7f23c1ffb640 1 -- 172.21.15.2:0/274421425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b8037040 con 0x7f23c407a430 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.856+0000 7f23c1ffb640 1 -- 172.21.15.2:0/274421425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f23b8040070 con 0x7f23c407a430 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.856+0000 7f23cb1e8640 1 -- 172.21.15.2:0/274421425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c419d260 con 0x7f23c407a430 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.856+0000 7f23c1ffb640 1 -- 172.21.15.2:0/274421425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b803be30 con 0x7f23c407a430 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.856+0000 7f23cb1e8640 1 -- 172.21.15.2:0/274421425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c419dc20 con 0x7f23c407a430 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.857+0000 7f23c1ffb640 1 -- 172.21.15.2:0/274421425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 51820+0+0 (secure 0 0 0) 0x7f23b803a470 con 0x7f23c407a430 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.857+0000 7f23cb1e8640 1 -- 172.21.15.2:0/274421425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c4107520 con 0x7f23c407a430 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.857+0000 7f23c1ffb640 1 --2- 172.21.15.2:0/274421425 >> v2:172.21.15.2:6800/2044640733 conn(0x7f23b403f8c0 0x7f23b4041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.857+0000 7f23c3fff640 1 -- 172.21.15.2:0/274421425 >> v2:172.21.15.2:6800/2044640733 conn(0x7f23b403f8c0 msgr2=0x7f23b4041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2044640733 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.857+0000 7f23c1ffb640 1 -- 172.21.15.2:0/274421425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f23b803b470 con 0x7f23c407a430 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.857+0000 7f23c3fff640 1 --2- 172.21.15.2:0/274421425 >> v2:172.21.15.2:6800/2044640733 conn(0x7f23b403f8c0 0x7f23b4041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:54.862+0000 7f23c1ffb640 1 -- 172.21.15.2:0/274421425 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23b8036170 con 0x7f23c407a430 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.058+0000 7f23c3fff640 1 -- 172.21.15.2:0/274421425 >> v2:172.21.15.2:6800/2044640733 conn(0x7f23b403f8c0 msgr2=0x7f23b4041d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2044640733 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.058+0000 7f23c3fff640 1 --2- 172.21.15.2:0/274421425 >> v2:172.21.15.2:6800/2044640733 conn(0x7f23b403f8c0 0x7f23b4041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.099+0000 7f23cb1e8640 1 -- 172.21.15.2:0/274421425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f23c419e480 con 0x7f23c407a430 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.100+0000 7f23c1ffb640 1 -- 172.21.15.2:0/274421425 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f23b8049dc0 con 0x7f23c407a430 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.102+0000 7f23cb1e8640 1 -- 172.21.15.2:0/274421425 >> v2:172.21.15.2:6800/2044640733 conn(0x7f23b403f8c0 msgr2=0x7f23b4041d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.102+0000 7f23cb1e8640 1 --2- 172.21.15.2:0/274421425 >> v2:172.21.15.2:6800/2044640733 conn(0x7f23b403f8c0 0x7f23b4041d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.102+0000 7f23cb1e8640 1 -- 172.21.15.2:0/274421425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 msgr2=0x7f23c419ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.102+0000 7f23cb1e8640 1 --2- 172.21.15.2:0/274421425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c419ca70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23b8032b90 tx=0x7f23b8032790 comp rx=0 tx=0).stop 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.102+0000 7f23cb1e8640 1 -- 172.21.15.2:0/274421425 shutdown_connections 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.102+0000 7f23cb1e8640 1 --2- 172.21.15.2:0/274421425 >> v2:172.21.15.2:6800/2044640733 conn(0x7f23b403f8c0 0x7f23b4041d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.102+0000 7f23cb1e8640 1 --2- 172.21.15.2:0/274421425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c407a430 0x7f23c419ca70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.102+0000 7f23cb1e8640 1 -- 172.21.15.2:0/274421425 >> 172.21.15.2:0/274421425 conn(0x7f23c41011c0 msgr2=0x7f23c4101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.102+0000 7f23cb1e8640 1 -- 172.21.15.2:0/274421425 shutdown_connections 2024-09-21T13:33:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:55.102+0000 7f23cb1e8640 1 -- 172.21.15.2:0/274421425 wait complete. 2024-09-21T13:33:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-21T13:33:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2024-09-21T13:33:58.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:58 smithi002 ceph-mon[30076]: Active manager daemon y restarted 2024-09-21T13:33:58.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:58 smithi002 ceph-mon[30076]: Activating manager daemon y 2024-09-21T13:33:58.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:58 smithi002 ceph-mon[30076]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T13:33:58.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:58 smithi002 ceph-mon[30076]: mgrmap e10: y(active, starting, since 0.00356443s) 2024-09-21T13:33:58.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:33:58.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T13:33:58.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T13:33:58.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T13:33:58.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T13:33:58.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:58 smithi002 ceph-mon[30076]: Manager daemon y is now available 2024-09-21T13:33:59.578 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:59 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:33:59.578 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:59 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T13:33:59.578 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:59 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T13:33:59.578 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:33:59 smithi002 ceph-mon[30076]: mgrmap e11: y(active, since 1.00685s) 2024-09-21T13:33:59.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.171+0000 7fdf457b8640 1 Processor -- start 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.171+0000 7fdf457b8640 1 -- start start 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.172+0000 7fdf457b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf40106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.172+0000 7fdf457b8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf40107360 con 0x7fdf40106970 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.172+0000 7fdf3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf40106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.172+0000 7fdf3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf40106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47964/0 (socket says 172.21.15.2:47964) 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.172+0000 7fdf3effd640 1 -- 172.21.15.2:0/1605996267 learned_addr learned my addr 172.21.15.2:0/1605996267 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.172+0000 7fdf3effd640 1 -- 172.21.15.2:0/1605996267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf401074e0 con 0x7fdf40106970 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.173+0000 7fdf3effd640 1 --2- 172.21.15.2:0/1605996267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf40106d70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009820 tx=0x7fdf3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5be95678fb1519 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:59.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.173+0000 7fdf3dffb640 1 -- 172.21.15.2:0/1605996267 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf30037070 con 0x7fdf40106970 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.173+0000 7fdf3dffb640 1 -- 172.21.15.2:0/1605996267 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fdf300328c0 con 0x7fdf40106970 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.173+0000 7fdf3dffb640 1 -- 172.21.15.2:0/1605996267 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf30030640 con 0x7fdf40106970 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.174+0000 7fdf457b8640 1 -- 172.21.15.2:0/1605996267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 msgr2=0x7fdf40106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.174+0000 7fdf457b8640 1 --2- 172.21.15.2:0/1605996267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf40106d70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009820 tx=0x7fdf3002a270 comp rx=0 tx=0).stop 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.174+0000 7fdf457b8640 1 -- 172.21.15.2:0/1605996267 shutdown_connections 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.174+0000 7fdf457b8640 1 --2- 172.21.15.2:0/1605996267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf40106d70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.174+0000 7fdf457b8640 1 -- 172.21.15.2:0/1605996267 >> 172.21.15.2:0/1605996267 conn(0x7fdf40102280 msgr2=0x7fdf401046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.174+0000 7fdf457b8640 1 -- 172.21.15.2:0/1605996267 shutdown_connections 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.174+0000 7fdf457b8640 1 -- 172.21.15.2:0/1605996267 wait complete. 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.174+0000 7fdf457b8640 1 Processor -- start 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.174+0000 7fdf457b8640 1 -- start start 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf457b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf4007c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:59.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf457b8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4010adf0 con 0x7fdf40106970 2024-09-21T13:33:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf4007c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf4007c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47980/0 (socket says 172.21.15.2:47980) 2024-09-21T13:33:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf3effd640 1 -- 172.21.15.2:0/460640374 learned_addr learned my addr 172.21.15.2:0/460640374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:33:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf3effd640 1 -- 172.21.15.2:0/460640374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4007cee0 con 0x7fdf40106970 2024-09-21T13:33:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf3effd640 1 --2- 172.21.15.2:0/460640374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf4007c980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf3002a830 tx=0x7fdf30030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf37fff640 1 -- 172.21.15.2:0/460640374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf30037040 con 0x7fdf40106970 2024-09-21T13:33:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf37fff640 1 -- 172.21.15.2:0/460640374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fdf30040070 con 0x7fdf40106970 2024-09-21T13:33:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf457b8640 1 -- 172.21.15.2:0/460640374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4007b2d0 con 0x7fdf40106970 2024-09-21T13:33:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf37fff640 1 -- 172.21.15.2:0/460640374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf3003be40 con 0x7fdf40106970 2024-09-21T13:33:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.175+0000 7fdf457b8640 1 -- 172.21.15.2:0/460640374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf4007b850 con 0x7fdf40106970 2024-09-21T13:33:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.176+0000 7fdf37fff640 1 -- 172.21.15.2:0/460640374 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 51820+0+0 (secure 0 0 0) 0x7fdf3003a4a0 con 0x7fdf40106970 2024-09-21T13:33:59.900 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.177+0000 7fdf37fff640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 0x7fdf2c041dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:59.900 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.177+0000 7fdf457b8640 1 -- 172.21.15.2:0/460640374 --> v2:172.21.15.2:6800/2044640733 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdf4007d170 con 0x7fdf2c03f910 2024-09-21T13:33:59.900 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.177+0000 7fdf3e7fc640 1 -- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 msgr2=0x7fdf2c041dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2044640733 2024-09-21T13:33:59.900 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.177+0000 7fdf37fff640 1 -- 172.21.15.2:0/460640374 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fdf30074110 con 0x7fdf40106970 2024-09-21T13:33:59.900 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.177+0000 7fdf3e7fc640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 0x7fdf2c041dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:33:59.900 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.378+0000 7fdf3e7fc640 1 -- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 msgr2=0x7fdf2c041dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2044640733 2024-09-21T13:33:59.900 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.378+0000 7fdf3e7fc640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 0x7fdf2c041dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.779+0000 7fdf3e7fc640 1 -- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 msgr2=0x7fdf2c041dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2044640733 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:56.779+0000 7fdf3e7fc640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 0x7fdf2c041dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:57.581+0000 7fdf3e7fc640 1 -- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 msgr2=0x7fdf2c041dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2044640733 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:57.581+0000 7fdf3e7fc640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 0x7fdf2c041dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:58.103+0000 7fdf37fff640 1 -- 172.21.15.2:0/460640374 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 10) ==== 51622+0+0 (secure 0 0 0) 0x7fdf30041d60 con 0x7fdf40106970 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:58.103+0000 7fdf37fff640 1 -- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 msgr2=0x7fdf2c041dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:58.103+0000 7fdf37fff640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 0x7fdf2c041dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.104+0000 7fdf37fff640 1 -- 172.21.15.2:0/460640374 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 11) ==== 51714+0+0 (secure 0 0 0) 0x7fdf30042be0 con 0x7fdf40106970 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.104+0000 7fdf37fff640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf2c042ff0 0x7fdf2c0453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.104+0000 7fdf37fff640 1 -- 172.21.15.2:0/460640374 --> v2:172.21.15.2:6800/3897423974 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdf3003de70 con 0x7fdf2c042ff0 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.106+0000 7fdf3e7fc640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf2c042ff0 0x7fdf2c0453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.107+0000 7fdf3e7fc640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf2c042ff0 0x7fdf2c0453e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdf28003980 tx=0x7fdf280092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.107+0000 7fdf37fff640 1 -- 172.21.15.2:0/460640374 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fdf3003de70 con 0x7fdf2c042ff0 2024-09-21T13:33:59.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.115+0000 7fdf457b8640 1 -- 172.21.15.2:0/460640374 --> v2:172.21.15.2:6800/3897423974 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fdf40106d70 con 0x7fdf2c042ff0 2024-09-21T13:33:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.115+0000 7fdf37fff640 1 -- 172.21.15.2:0/460640374 <== mgr.14152 v2:172.21.15.2:6800/3897423974 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fdf40106d70 con 0x7fdf2c042ff0 2024-09-21T13:33:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.116+0000 7fdf457b8640 1 -- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf2c042ff0 msgr2=0x7fdf2c0453e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.116+0000 7fdf457b8640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf2c042ff0 0x7fdf2c0453e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdf28003980 tx=0x7fdf280092b0 comp rx=0 tx=0).stop 2024-09-21T13:33:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.116+0000 7fdf457b8640 1 -- 172.21.15.2:0/460640374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 msgr2=0x7fdf4007c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:33:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.116+0000 7fdf457b8640 1 --2- 172.21.15.2:0/460640374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf4007c980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf3002a830 tx=0x7fdf30030bc0 comp rx=0 tx=0).stop 2024-09-21T13:33:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.116+0000 7fdf457b8640 1 -- 172.21.15.2:0/460640374 shutdown_connections 2024-09-21T13:33:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.116+0000 7fdf457b8640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf2c042ff0 0x7fdf2c0453e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.116+0000 7fdf457b8640 1 --2- 172.21.15.2:0/460640374 >> v2:172.21.15.2:6800/2044640733 conn(0x7fdf2c03f910 0x7fdf2c041dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.116+0000 7fdf457b8640 1 --2- 172.21.15.2:0/460640374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf40106970 0x7fdf4007c980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:33:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.116+0000 7fdf457b8640 1 -- 172.21.15.2:0/460640374 >> 172.21.15.2:0/460640374 conn(0x7fdf40102280 msgr2=0x7fdf40102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:33:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.116+0000 7fdf457b8640 1 -- 172.21.15.2:0/460640374 shutdown_connections 2024-09-21T13:33:59.903 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:33:59.116+0000 7fdf457b8640 1 -- 172.21.15.2:0/460640374 wait complete. 2024-09-21T13:33:59.903 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2024-09-21T13:33:59.903 INFO:teuthology.orchestra.run.smithi002.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T13:34:00.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:00 smithi002 ceph-mon[30076]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T13:34:00.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:00 smithi002 ceph-mon[30076]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T13:34:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-mon[30076]: mgrmap e12: y(active, since 2s) 2024-09-21T13:34:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:01.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: 2024-09-21T13:34:01.604+0000 7f99abaf8640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:13:34:01] ENGINE Error in HTTPServer.serve 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: Traceback (most recent call last): 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self._connections.run(self.expiration_interval) 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self._run(expiration_interval) 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: s = self.context.wrap_socket( 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T13:34:01.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: return self.sslsocket_class._create( 2024-09-21T13:34:01.852 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T13:34:01.852 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self.do_handshake() 2024-09-21T13:34:01.852 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T13:34:01.852 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self._sslobj.do_handshake() 2024-09-21T13:34:01.852 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T13:34:01.852 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: 2024-09-21T13:34:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUceaV99WyjudBEtrYmPxj1HXN8XwwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTEzMzQwMVoXDTM0\nMDkyMjEzMzQwMVowFjEUMBIGA1UEAwwLMTcyLjIxLjE1LjIwggIiMA0GCSqGSIb3\nDQEBAQUAA4ICDwAwggIKAoICAQCaeSzh0WMGCcUM2uecrnmVPpKO1OjS0u4O0hKi\nV5I2JIq8XW0O6a7uRobjNtjAX3VUwa9S/aJkKeM3WTJOIM+sNYkCEW2kRA1sigDA\nK+ya9lkTqUrBcbeXF8A4y114zSkW8jCk3pRoMFlu1pCSu95xGFG45rkQbRezLEoP\nIU0R0g7w70cwEZbyIML+7hNsnFt/73xHISYZhAguEA5ed1XLebI4l1ZY3DfC5saR\nHb8ktjnGGCQYrf8TxLMPQ+fJk/kuxGnahipmK3HO94NX6LwQ9RaugWPVtVOV4JE0\nWrFazMXw2P6XzyjKOUI3OKbGiwnAwNGQyNxqYtDRcVuo1kQ2f65xyE94JXJsS6TW\nzF/nx0sEngId39A3pnO/DXysbzWDJruzDtbiy+kRsMLvGqggcd2hDLmxA5tGfV/P\nEXwKXarl0OsPVPd7OZHvlSTRmxuWFVP1ZIT8nZdTYE3q7ja3tqsum1L74bLaE/ea\niqyEd9loi18mrZUGhBPBPr0JxXhZJD/rbHvcL28MGJDS0gn9BloDDWvwdq+N0+AE\nX96Ay42T4JM4TysFFbxDIVG0WUY2HOE4xe6OKDZEI8o5liPWeY3jCad29yClZg4B\nuLuinZA0j+t6dHwUZvS+u7tLt0O0SCxssejtXZLiPMwm49mMcHeE9l7VzlcJE0Cf\n0lwyawIDAQABoz8wPTAtBgNVHREEJjAkgglzbWl0aGkwMDKCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwSsFQ8CMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBAIbD\nAFi7PVdrGfOCnRPcjPJMgUVNAX5yxc3II6VFqO+mhdVz4APNmvgaU7Zp2UqcRuNZ\nuaKM3L4P0U+zoNJJLrY0HMD4xMJOYbkE9Zk6mpplb5LuyUIk6sMOIyrda5+VQrul\nP+SUSSZSEAtfvb6f8P+62lqhXI7LjbvI9wTEYwwixTlVcJ4BEZWFB7pvvTxjCeFL\nNRVGePitDEF68XIE8t+4XApWa4Dndd1gxCUmheiRruo1R5EjX4MXTKhxGAgmVHES\n/eEdEC1S9jYE5lnysJaenfsGNXjceAIxzNtX9CUbvVO1lRxaJl+DMpi236HIsRxc\n2M+u7pMmAZNj4k9rsIF//OoJVQfU0T9QF1Kf+w5q/HlcSjDV302O8UrszVmOmFVD\n2Q6oklXh2y5q6pcIwX5sQdJtXwPQlvsbvKZ5rja80qh2vcr6QjD0Lnw9fH8Op3x7\n/3qalojFR+4KghAf/guzWp0tVqqm/k8kEgzXHdW6u0ff+31x5PSkCPJFIWQN8ekc\ncmOQBdYxCW3/UJ/dIsMUN8fKRo2tLFedRfo4NyIYHCk9p/2K9DP9g+W3UBLBEZJ4\nFD6VdJk5e/jVqMuje8gHud7OGp8oK3XmB8M+5iArBaBWmnmynoHVXyycblgoUski\nNxBtY32ahQwzfdJO45Za3tUPVyU87A4jCvxcLkSe\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAmnks4dFjBgnFDNrnnK55lT6SjtTo0tLuDtISoleSNiSKvF1t\nDumu7kaG4zbYwF91VMGvUv2iZCnjN1kyTiDPrDWJAhFtpEQNbIoAwCvsmvZZE6lK\nwXG3lxfAOMtdeM0pFvIwpN6UaDBZbtaQkrvecRhRuOa5EG0XsyxKDyFNEdIO8O9H\nMBGW8iDC/u4TbJxbf+98RyEmGYQILhAOXndVy3myOJdWWNw3wubGkR2/JLY5xhgk\nGK3/E8SzD0PnyZP5LsRp2oYqZitxzveDV+i8EPUWroFj1bVTleCRNFqxWszF8Nj+\nl88oyjlCNzimxosJwMDRkMjcamLQ0XFbqNZENn+ucchPeCVybEuk1sxf58dLBJ4C\nHd/QN6Zzvw18rG81gya7sw7W4svpEbDC7xqoIHHdoQy5sQObRn1fzxF8Cl2q5dDr\nD1T3ezmR75Uk0ZsblhVT9WSE/J2XU2BN6u42t7arLptS++Gy2hP3moqshHfZaItf\nJq2VBoQTwT69CcV4WSQ/62x73C9vDBiQ0tIJ/QZaAw1r8HavjdPgBF/egMuNk+CT\nOE8rBRW8QyFRtFlGNhzhOMXujig2RCPKOZYj1nmN4wmndvcgpWYOAbi7op2QNI/r\nenR8FGb0vru7S7dDtEgsbLHo7V2S4jzMJuPZjHB3hPZe1c5XCRNAn9JcMmsCAwEA\nAQKCAgAk9ts1HFhgUQUsutNSrHOesY77i9o83MmnlUBtRZxQxXTHd2nJ+ERqc0kC\n5RSAEDew9Poh11y9MELVc0w04ugfEt56trXwaXJ25x0f30LqoAmXyVqAqNggWUgf\nrxZqelmbSpA2W6bSucMk4UZOPpOPp5yirN9bHWfe8bm1Hihlm8kEgZWc3JCs1wci\nXtEaG95PYnzwPm/yCiS09RWjKFZI7xGlNh2s/OGBC503i5E6VTrE+vDkUPqpfdfF\nTuAP3g9yUADukE1kDoBY4OS2rBQY0LVBQ+gicxYR1t+YUh1/l2HEbQCbTjC6F3KP\naUiLWSkXzWw4g8Au2v+SJtiiscc3jeSphhAUYN3xVOLjiQKekmwX/a+5AtqsIMEs\nsQlZFJwObjGTjOYoPutfQ3/sQ0inkcNB34WMdT7XXzo9JGMJP9xAOS798LZFwutS\ng1RPV9AbjS2dxfF18+gYyDJ8pkk8jiuJVF90FAdpy4vIF0ndGk3h3R/BRCcmf4Ir\n1LpmAx35gtW4Ow/Oja7OUFtF5izfz8kdAYIYr4E83YNnzVy4X6xgdPDj+vAXP9fh\ngjcYXQNHxN0m2DVbqv7Ja9+Z7O3AQnt+zKHvtE9f4QETi09IxB/IBXZoM5HSfZBa\nYKfSOj3+RwTha1+MrfVF/IPPrB7V/CokGueKs93wQgtxeIPf9QKCAQEA1zwyx7KH\nNS2BhEDxxclamHbgMqS2a62zUTr7GmEDIh0o9mUtVcPj068J8yYyd+/kE2HADrKQ\nAyxQacut3UPKdAq+GsMheUvhIBasZKLF0JXlC8zHh6YhN5eTwKXjuLZ+4OwlNqqo\n4+etnNo9lt9tBRBKDAroR42jV8ETyelqQzdVeG5KbJs8gx1T/oBNV9MhL5eQ3C28\nFai7dKlgZIWYF156sc/FTkW0Uf2e6MYshwbn/frpljlI2xNxhSUw5kBTclsoKMjJ\nTQ1ei/YyHvoa7momUWDcTD/JJ2kiw+31k+dPBeByvQU7Fmz+Dt8YzhCFmD51mmYb\nP3mXwLp3wjJCNwKCAQEAt7rnv1DOrO2B5GsxVWXCB+0SAF2+Yq56g+c6cQvoJiLG\nQ/WP+YrLf8ERIx6bEfwjOTHY/0ckvkSGd/ol8awdW0XVXdcKw7H15vUjVLN2xJjy\npYZhTGqRKuOm54jNkJLsdPGf4o0a1l0DuK/JV5Lfw8TU08/G4FIoHE5xsjNsnmNy\nlDw07jbei3580Z4WJBGGsNDY4EQ3gN4i8VdAKBlW+1xBoucNkcT7nr6P8er5q7ZZ\n2Nre+lux9sRRFBx80KPJzgs++DN3r22igS1j8CDxL+1mrNoBrScYqYfv9FaS2pwX\nWDvKzxeGJWQR8FbQj7NMQQMlVJ2CRk+eS4i8RM2HbQKCAQAAmrKpzN6ET7RlYqlL\nHN2cP/kxKzU36CzwtXGvCUaw+dP7nR0beIlTNtKYVCsgGxRQ2Z1obSfqWl1/bor2\nbBJNcRpHiPS3GndvV6D0R2C2zTTva4vD3buKJGrNx6l0A08n4oHYPXJr8WKTZil2\nGvp7YShUEFPGn6ctv+UGVBlwRt9+jxC2bVkmJRbvR/zvmjAlqg9GDvrQNMER+sfC\ngH2E00cU6LhtF9UBxeyESsolNue/1syBF3gU5WEUNp6Ehvm1AHyEYMvv43G4guBx\nJdKdiL7Cy7rSm/s8mRb35dsipyuZoJ+x2CnqTjQIZqfzLCiz3LkHzfGVpAnBCMT9\nTpbRAoIBAFog2NBz/n68H+0CXHgM6+rhc+Q0GFHmT3lnM7cC5UXX5zStQIxkdsFb\n32FAAUgITOsgtdc8ehzQFrrCPlzYVqpQjoNzGve20+8RL9y8ELYOZXGngxFucXn9\npQGNjXGvcUlIwmrrV0/y3wF5UiagiR5K7zBci628/6orHQES0uS72hg3lKuKxQ7e\n5LIbf7b/1ffk647QR/3yemezqmhBTfcOYbBc8b4hSGGuD4TYBNQkJt0HOTzNQHbS\nBQf9lYjv3+4wfBpbfQnUmVQPBShlsIsXRTfj1dCwDhwT8DUHRxDwY09IPYvreUXc\nWiRxIexsQyrdNTHV9nMxWXCqSdjijd0CggEATOy28/DpXlYNIMcj4EEu6wdGTv4w\n5RxXINfqeWNdUcmOUyahVGg6vJsOwGlEEO++PmDLeNeNqVkRPdmLXj94NoIE17a+\nAHe5QjZyNpd3McET6rRICCGCe4vw6uGmMriqVslOD6oDbq+WM0OxkpBofuYlZDHS\nSkhq2WXwwE8Syl0Ec96Yb2Zr31eOZvWNxg1PwFrqB3cmEVBVbainbxsVYeIqGIa7\nBf3SdYedyn1sBdtKiKje4YahvYGrMeP0yMz7W4vFyeTUwxQPiD8Tgxjsb5KPCHeh\nXrKCBrgl0htGZc6UpG9S/gd36Uw/xhjuQqINBf6XNivq7dpS/8O+1W7UdQ==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T13:34:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.699+0000 7f186c83d640 1 Processor -- start 2024-09-21T13:34:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.699+0000 7f186c83d640 1 -- start start 2024-09-21T13:34:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.699+0000 7f186c83d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.699+0000 7f186c83d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1868109a70 con 0x7f186807a430 2024-09-21T13:34:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.700+0000 7f186659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.700+0000 7f186659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868109530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48050/0 (socket says 172.21.15.2:48050) 2024-09-21T13:34:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.700+0000 7f186659c640 1 -- 172.21.15.2:0/1782073691 learned_addr learned my addr 172.21.15.2:0/1782073691 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.700+0000 7f186659c640 1 -- 172.21.15.2:0/1782073691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1868109bf0 con 0x7f186807a430 2024-09-21T13:34:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.701+0000 7f186659c640 1 --2- 172.21.15.2:0/1782073691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868109530 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1858009820 tx=0x7f185802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d42a3358ec935df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.701+0000 7f186559a640 1 -- 172.21.15.2:0/1782073691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1858037070 con 0x7f186807a430 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.701+0000 7f186559a640 1 -- 172.21.15.2:0/1782073691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f18580328c0 con 0x7f186807a430 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.701+0000 7f186559a640 1 -- 172.21.15.2:0/1782073691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18580306d0 con 0x7f186807a430 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.702+0000 7f186c83d640 1 -- 172.21.15.2:0/1782073691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 msgr2=0x7f1868109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.702+0000 7f186c83d640 1 --2- 172.21.15.2:0/1782073691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868109530 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1858009820 tx=0x7f185802a300 comp rx=0 tx=0).stop 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.702+0000 7f186c83d640 1 -- 172.21.15.2:0/1782073691 shutdown_connections 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.702+0000 7f186c83d640 1 --2- 172.21.15.2:0/1782073691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868109530 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.702+0000 7f186c83d640 1 -- 172.21.15.2:0/1782073691 >> 172.21.15.2:0/1782073691 conn(0x7f18681011c0 msgr2=0x7f18681035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.702+0000 7f186c83d640 1 -- 172.21.15.2:0/1782073691 shutdown_connections 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.702+0000 7f186c83d640 1 -- 172.21.15.2:0/1782073691 wait complete. 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.703+0000 7f186c83d640 1 Processor -- start 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.703+0000 7f186c83d640 1 -- start start 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.703+0000 7f186c83d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868106b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.703+0000 7f186c83d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f186810acf0 con 0x7f186807a430 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.703+0000 7f186659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.703+0000 7f186659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48058/0 (socket says 172.21.15.2:48058) 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.703+0000 7f186659c640 1 -- 172.21.15.2:0/3619198161 learned_addr learned my addr 172.21.15.2:0/3619198161 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.703+0000 7f186659c640 1 -- 172.21.15.2:0/3619198161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18681070e0 con 0x7f186807a430 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.703+0000 7f186659c640 1 --2- 172.21.15.2:0/3619198161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868106b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1858000c00 tx=0x7f1858030a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.704+0000 7f18577fe640 1 -- 172.21.15.2:0/3619198161 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1858037040 con 0x7f186807a430 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.704+0000 7f18577fe640 1 -- 172.21.15.2:0/3619198161 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f1858040070 con 0x7f186807a430 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.704+0000 7f186c83d640 1 -- 172.21.15.2:0/3619198161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18681054d0 con 0x7f186807a430 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.704+0000 7f18577fe640 1 -- 172.21.15.2:0/3619198161 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f185803be20 con 0x7f186807a430 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.704+0000 7f186c83d640 1 -- 172.21.15.2:0/3619198161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1868105a50 con 0x7f186807a430 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.705+0000 7f18577fe640 1 -- 172.21.15.2:0/3619198161 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 51820+0+0 (secure 0 0 0) 0x7f1858045460 con 0x7f186807a430 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.705+0000 7f186c83d640 1 -- 172.21.15.2:0/3619198161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18681072b0 con 0x7f186807a430 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.705+0000 7f18577fe640 1 --2- 172.21.15.2:0/3619198161 >> v2:172.21.15.2:6800/3897423974 conn(0x7f185003f8c0 0x7f1850041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.705+0000 7f18577fe640 1 -- 172.21.15.2:0/3619198161 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f18580744b0 con 0x7f186807a430 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.705+0000 7f1865d9b640 1 --2- 172.21.15.2:0/3619198161 >> v2:172.21.15.2:6800/3897423974 conn(0x7f185003f8c0 0x7f1850041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.705+0000 7f1865d9b640 1 --2- 172.21.15.2:0/3619198161 >> v2:172.21.15.2:6800/3897423974 conn(0x7f185003f8c0 0x7f1850041d80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f185c0098c0 tx=0x7f185c006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.710+0000 7f18577fe640 1 -- 172.21.15.2:0/3619198161 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1858030de0 con 0x7f186807a430 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:00.912+0000 7f186c83d640 1 -- 172.21.15.2:0/3619198161 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}) -- 0x7f1868105ff0 con 0x7f185003f8c0 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:01.542+0000 7f18577fe640 1 -- 172.21.15.2:0/3619198161 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5132 (secure 0 0 0) 0x7f1868105ff0 con 0x7f185003f8c0 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:01.545+0000 7f186c83d640 1 -- 172.21.15.2:0/3619198161 >> v2:172.21.15.2:6800/3897423974 conn(0x7f185003f8c0 msgr2=0x7f1850041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:01.545+0000 7f186c83d640 1 --2- 172.21.15.2:0/3619198161 >> v2:172.21.15.2:6800/3897423974 conn(0x7f185003f8c0 0x7f1850041d80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f185c0098c0 tx=0x7f185c006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:01.545+0000 7f186c83d640 1 -- 172.21.15.2:0/3619198161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 msgr2=0x7f1868106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:01.545+0000 7f186c83d640 1 --2- 172.21.15.2:0/3619198161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868106b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1858000c00 tx=0x7f1858030a60 comp rx=0 tx=0).stop 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:01.545+0000 7f186c83d640 1 -- 172.21.15.2:0/3619198161 shutdown_connections 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:01.545+0000 7f186c83d640 1 --2- 172.21.15.2:0/3619198161 >> v2:172.21.15.2:6800/3897423974 conn(0x7f185003f8c0 0x7f1850041d80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:01.545+0000 7f186c83d640 1 --2- 172.21.15.2:0/3619198161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f186807a430 0x7f1868106b80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:01.545+0000 7f186c83d640 1 -- 172.21.15.2:0/3619198161 >> 172.21.15.2:0/3619198161 conn(0x7f18681011c0 msgr2=0x7f1868101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:01.545+0000 7f186c83d640 1 -- 172.21.15.2:0/3619198161 shutdown_connections 2024-09-21T13:34:02.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:01.545+0000 7f186c83d640 1 -- 172.21.15.2:0/3619198161 wait complete. 2024-09-21T13:34:02.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:02 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:02.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:02 smithi002 ceph-mon[30076]: [21/Sep/2024:13:34:01] ENGINE Bus STARTING 2024-09-21T13:34:02.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:02 smithi002 ceph-mon[30076]: [21/Sep/2024:13:34:01] ENGINE Serving on http://172.21.15.2:8765 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:02 smithi002 ceph-mon[30076]: [21/Sep/2024:13:34:01] ENGINE Serving on https://172.21.15.2:7150 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:02 smithi002 ceph-mon[30076]: [21/Sep/2024:13:34:01] ENGINE Bus STARTED 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:02 smithi002 ceph-mon[30076]: [21/Sep/2024:13:34:01] ENGINE Error in HTTPServer.serve 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T13:34:02.456 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-21T13:34:02.457 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T13:34:02.457 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-21T13:34:02.457 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T13:34:02.457 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-21T13:34:02.457 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T13:34:02.457 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-21T13:34:02.457 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T13:34:04.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:04 smithi002 ceph-mon[30076]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:04.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:04 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:04.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T13:34:04.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.873+0000 7fc8d8a2d640 1 Processor -- start 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.873+0000 7fc8d8a2d640 1 -- start start 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.873+0000 7fc8d8a2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d4106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.873+0000 7fc8d8a2d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4107360 con 0x7fc8d4106970 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.873+0000 7fc8d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d4106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.873+0000 7fc8d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d4106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48066/0 (socket says 172.21.15.2:48066) 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.873+0000 7fc8d259c640 1 -- 172.21.15.2:0/2630972695 learned_addr learned my addr 172.21.15.2:0/2630972695 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.874+0000 7fc8d259c640 1 -- 172.21.15.2:0/2630972695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d41074e0 con 0x7fc8d4106970 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.874+0000 7fc8d259c640 1 --2- 172.21.15.2:0/2630972695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d4106d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009820 tx=0x7fc8c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a2f9f0e7034cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.875+0000 7fc8d159a640 1 -- 172.21.15.2:0/2630972695 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c4037070 con 0x7fc8d4106970 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.875+0000 7fc8d159a640 1 -- 172.21.15.2:0/2630972695 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fc8c40328c0 con 0x7fc8d4106970 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.875+0000 7fc8d159a640 1 -- 172.21.15.2:0/2630972695 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c4030640 con 0x7fc8d4106970 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.875+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/2630972695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 msgr2=0x7fc8d4106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:04.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.875+0000 7fc8d8a2d640 1 --2- 172.21.15.2:0/2630972695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d4106d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009820 tx=0x7fc8c402a270 comp rx=0 tx=0).stop 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.875+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/2630972695 shutdown_connections 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.875+0000 7fc8d8a2d640 1 --2- 172.21.15.2:0/2630972695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d4106d70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.875+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/2630972695 >> 172.21.15.2:0/2630972695 conn(0x7fc8d4102280 msgr2=0x7fc8d41046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.875+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/2630972695 shutdown_connections 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.875+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/2630972695 wait complete. 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.876+0000 7fc8d8a2d640 1 Processor -- start 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.876+0000 7fc8d8a2d640 1 -- start start 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.876+0000 7fc8d8a2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d407c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.876+0000 7fc8d8a2d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d410adf0 con 0x7fc8d4106970 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.877+0000 7fc8d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d407c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.877+0000 7fc8d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d407c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48070/0 (socket says 172.21.15.2:48070) 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.877+0000 7fc8d259c640 1 -- 172.21.15.2:0/3441498531 learned_addr learned my addr 172.21.15.2:0/3441498531 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.877+0000 7fc8d259c640 1 -- 172.21.15.2:0/3441498531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d407cee0 con 0x7fc8d4106970 2024-09-21T13:34:04.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.877+0000 7fc8d259c640 1 --2- 172.21.15.2:0/3441498531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d407c980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4000c00 tx=0x7fc8c4030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.877+0000 7fc8c37fe640 1 -- 172.21.15.2:0/3441498531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c4037040 con 0x7fc8d4106970 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.877+0000 7fc8c37fe640 1 -- 172.21.15.2:0/3441498531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fc8c4040070 con 0x7fc8d4106970 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.877+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/3441498531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d407b2d0 con 0x7fc8d4106970 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.877+0000 7fc8c37fe640 1 -- 172.21.15.2:0/3441498531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c403a390 con 0x7fc8d4106970 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.877+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/3441498531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d407b850 con 0x7fc8d4106970 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.878+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/3441498531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d4106d70 con 0x7fc8d4106970 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.878+0000 7fc8c37fe640 1 -- 172.21.15.2:0/3441498531 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 51820+0+0 (secure 0 0 0) 0x7fc8c403b430 con 0x7fc8d4106970 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.879+0000 7fc8c37fe640 1 --2- 172.21.15.2:0/3441498531 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc8bc03f910 0x7fc8bc041dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.879+0000 7fc8c37fe640 1 -- 172.21.15.2:0/3441498531 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fc8c40744e0 con 0x7fc8d4106970 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.879+0000 7fc8d1d9b640 1 --2- 172.21.15.2:0/3441498531 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc8bc03f910 0x7fc8bc041dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.879+0000 7fc8d1d9b640 1 --2- 172.21.15.2:0/3441498531 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc8bc03f910 0x7fc8bc041dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80098c0 tx=0x7fc8c8006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:02.883+0000 7fc8c37fe640 1 -- 172.21.15.2:0/3441498531 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8c4043360 con 0x7fc8d4106970 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.094+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/3441498531 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}) -- 0x7fc8d407bd80 con 0x7fc8bc03f910 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.097+0000 7fc8c37fe640 1 -- 172.21.15.2:0/3441498531 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc8d407bd80 con 0x7fc8bc03f910 2024-09-21T13:34:04.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.100+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/3441498531 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc8bc03f910 msgr2=0x7fc8bc041dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.100+0000 7fc8d8a2d640 1 --2- 172.21.15.2:0/3441498531 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc8bc03f910 0x7fc8bc041dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80098c0 tx=0x7fc8c8006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.100+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/3441498531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 msgr2=0x7fc8d407c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.100+0000 7fc8d8a2d640 1 --2- 172.21.15.2:0/3441498531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d407c980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4000c00 tx=0x7fc8c4030b70 comp rx=0 tx=0).stop 2024-09-21T13:34:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.100+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/3441498531 shutdown_connections 2024-09-21T13:34:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.100+0000 7fc8d8a2d640 1 --2- 172.21.15.2:0/3441498531 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc8bc03f910 0x7fc8bc041dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.100+0000 7fc8d8a2d640 1 --2- 172.21.15.2:0/3441498531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8d4106970 0x7fc8d407c980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.100+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/3441498531 >> 172.21.15.2:0/3441498531 conn(0x7fc8d4102280 msgr2=0x7fc8d4102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.100+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/3441498531 shutdown_connections 2024-09-21T13:34:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:03.100+0000 7fc8d8a2d640 1 -- 172.21.15.2:0/3441498531 wait complete. 2024-09-21T13:34:05.574 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T13:34:05.574 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.749+0000 7f8c00092640 1 Processor -- start 2024-09-21T13:34:05.574 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.749+0000 7f8c00092640 1 -- start start 2024-09-21T13:34:05.574 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.749+0000 7f8c00092640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf810b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.749+0000 7f8c00092640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf807aec0 con 0x7f8bf807aac0 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.749+0000 7f8bfde2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf810b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.749+0000 7f8bfde2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf810b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48072/0 (socket says 172.21.15.2:48072) 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.749+0000 7f8bfde2e640 1 -- 172.21.15.2:0/4070040813 learned_addr learned my addr 172.21.15.2:0/4070040813 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.750+0000 7f8bfde2e640 1 -- 172.21.15.2:0/4070040813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf810bef0 con 0x7f8bf807aac0 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.750+0000 7f8bfde2e640 1 --2- 172.21.15.2:0/4070040813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf810b9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009e80 tx=0x7f8bf402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1331543bca5d62af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.751+0000 7f8bfce2c640 1 -- 172.21.15.2:0/4070040813 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bf4036070 con 0x7f8bf807aac0 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.751+0000 7f8bfce2c640 1 -- 172.21.15.2:0/4070040813 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f8bf4031880 con 0x7f8bf807aac0 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.751+0000 7f8bfce2c640 1 -- 172.21.15.2:0/4070040813 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bf4007880 con 0x7f8bf807aac0 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.751+0000 7f8c00092640 1 -- 172.21.15.2:0/4070040813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 msgr2=0x7f8bf810b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.751+0000 7f8c00092640 1 --2- 172.21.15.2:0/4070040813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf810b9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009e80 tx=0x7f8bf402a7a0 comp rx=0 tx=0).stop 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.751+0000 7f8c00092640 1 -- 172.21.15.2:0/4070040813 shutdown_connections 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.751+0000 7f8c00092640 1 --2- 172.21.15.2:0/4070040813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf810b9b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:05.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.751+0000 7f8c00092640 1 -- 172.21.15.2:0/4070040813 >> 172.21.15.2:0/4070040813 conn(0x7f8bf8101140 msgr2=0x7f8bf8103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.751+0000 7f8c00092640 1 -- 172.21.15.2:0/4070040813 shutdown_connections 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.751+0000 7f8c00092640 1 -- 172.21.15.2:0/4070040813 wait complete. 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.752+0000 7f8c00092640 1 Processor -- start 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.752+0000 7f8c00092640 1 -- start start 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.752+0000 7f8c00092640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.752+0000 7f8c00092640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf810cf30 con 0x7f8bf807aac0 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.753+0000 7f8bfde2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.753+0000 7f8bfde2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf819ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48076/0 (socket says 172.21.15.2:48076) 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.753+0000 7f8bfde2e640 1 -- 172.21.15.2:0/2373572173 learned_addr learned my addr 172.21.15.2:0/2373572173 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.753+0000 7f8bfde2e640 1 -- 172.21.15.2:0/2373572173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf819cfd0 con 0x7f8bf807aac0 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.753+0000 7f8bfde2e640 1 --2- 172.21.15.2:0/2373572173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf819ca70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4008dc0 tx=0x7f8bf4008df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.753+0000 7f8beeffd640 1 -- 172.21.15.2:0/2373572173 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bf4041020 con 0x7f8bf807aac0 2024-09-21T13:34:05.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.753+0000 7f8c00092640 1 -- 172.21.15.2:0/2373572173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf819d260 con 0x7f8bf807aac0 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.753+0000 7f8beeffd640 1 -- 172.21.15.2:0/2373572173 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f8bf403c8f0 con 0x7f8bf807aac0 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.753+0000 7f8beeffd640 1 -- 172.21.15.2:0/2373572173 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bf4036040 con 0x7f8bf807aac0 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.753+0000 7f8c00092640 1 -- 172.21.15.2:0/2373572173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf819dca0 con 0x7f8bf807aac0 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.754+0000 7f8beeffd640 1 -- 172.21.15.2:0/2373572173 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 51820+0+0 (secure 0 0 0) 0x7f8bf4044020 con 0x7f8bf807aac0 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.754+0000 7f8c00092640 1 -- 172.21.15.2:0/2373572173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf810ba30 con 0x7f8bf807aac0 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.755+0000 7f8beeffd640 1 --2- 172.21.15.2:0/2373572173 >> v2:172.21.15.2:6800/3897423974 conn(0x7f8be403f8c0 0x7f8be4041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.755+0000 7f8beeffd640 1 -- 172.21.15.2:0/2373572173 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f8bf40757a0 con 0x7f8bf807aac0 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.755+0000 7f8bfd62d640 1 --2- 172.21.15.2:0/2373572173 >> v2:172.21.15.2:6800/3897423974 conn(0x7f8be403f8c0 0x7f8be4041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.755+0000 7f8bfd62d640 1 --2- 172.21.15.2:0/2373572173 >> v2:172.21.15.2:6800/3897423974 conn(0x7f8be403f8c0 0x7f8be4041d80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8be80098c0 tx=0x7f8be8006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.760+0000 7f8beeffd640 1 -- 172.21.15.2:0/2373572173 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8bf404b020 con 0x7f8bf807aac0 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.966+0000 7f8c00092640 1 -- 172.21.15.2:0/2373572173 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}) -- 0x7f8bf819e4f0 con 0x7f8be403f8c0 2024-09-21T13:34:05.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.969+0000 7f8beeffd640 1 -- 172.21.15.2:0/2373572173 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f8bf819e4f0 con 0x7f8be403f8c0 2024-09-21T13:34:05.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.972+0000 7f8c00092640 1 -- 172.21.15.2:0/2373572173 >> v2:172.21.15.2:6800/3897423974 conn(0x7f8be403f8c0 msgr2=0x7f8be4041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:05.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.972+0000 7f8c00092640 1 --2- 172.21.15.2:0/2373572173 >> v2:172.21.15.2:6800/3897423974 conn(0x7f8be403f8c0 0x7f8be4041d80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8be80098c0 tx=0x7f8be8006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:05.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.972+0000 7f8c00092640 1 -- 172.21.15.2:0/2373572173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 msgr2=0x7f8bf819ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:05.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.972+0000 7f8c00092640 1 --2- 172.21.15.2:0/2373572173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf819ca70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4008dc0 tx=0x7f8bf4008df0 comp rx=0 tx=0).stop 2024-09-21T13:34:05.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.972+0000 7f8c00092640 1 -- 172.21.15.2:0/2373572173 shutdown_connections 2024-09-21T13:34:05.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.972+0000 7f8c00092640 1 --2- 172.21.15.2:0/2373572173 >> v2:172.21.15.2:6800/3897423974 conn(0x7f8be403f8c0 0x7f8be4041d80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:05.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.972+0000 7f8c00092640 1 --2- 172.21.15.2:0/2373572173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf807aac0 0x7f8bf819ca70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:05.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.972+0000 7f8c00092640 1 -- 172.21.15.2:0/2373572173 >> 172.21.15.2:0/2373572173 conn(0x7f8bf8101140 msgr2=0x7f8bf8101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:05.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.972+0000 7f8c00092640 1 -- 172.21.15.2:0/2373572173 shutdown_connections 2024-09-21T13:34:05.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:04.972+0000 7f8c00092640 1 -- 172.21.15.2:0/2373572173 wait complete. 2024-09-21T13:34:05.578 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2024-09-21T13:34:06.253 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:05 smithi002 ceph-mon[30076]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:06.253 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:05 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:07.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$PD.FRFZ23CWFokrR4/lwxuBIFthZLMYFvZHTd3JwDXYKtpG/CnzoC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726925646, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.037+0000 7f2fbb271640 1 Processor -- start 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.037+0000 7f2fbb271640 1 -- start start 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.037+0000 7f2fbb271640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb4106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.037+0000 7f2fbb271640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb4107350 con 0x7f2fb4106960 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.037+0000 7f2fb900d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb4106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.037+0000 7f2fb900d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb4106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48084/0 (socket says 172.21.15.2:48084) 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.037+0000 7f2fb900d640 1 -- 172.21.15.2:0/2943683447 learned_addr learned my addr 172.21.15.2:0/2943683447 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.038+0000 7f2fb900d640 1 -- 172.21.15.2:0/2943683447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb41074d0 con 0x7f2fb4106960 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.038+0000 7f2fb900d640 1 --2- 172.21.15.2:0/2943683447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb4106d60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009820 tx=0x7f2fb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd42d013e604953 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.038+0000 7f2fa7fff640 1 -- 172.21.15.2:0/2943683447 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb0037070 con 0x7f2fb4106960 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.039+0000 7f2fa7fff640 1 -- 172.21.15.2:0/2943683447 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2fb00328c0 con 0x7f2fb4106960 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.039+0000 7f2fa7fff640 1 -- 172.21.15.2:0/2943683447 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb0030640 con 0x7f2fb4106960 2024-09-21T13:34:07.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.039+0000 7f2fbb271640 1 -- 172.21.15.2:0/2943683447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 msgr2=0x7f2fb4106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.039+0000 7f2fbb271640 1 --2- 172.21.15.2:0/2943683447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb4106d60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009820 tx=0x7f2fb002a270 comp rx=0 tx=0).stop 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.039+0000 7f2fbb271640 1 -- 172.21.15.2:0/2943683447 shutdown_connections 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.039+0000 7f2fbb271640 1 --2- 172.21.15.2:0/2943683447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb4106d60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.039+0000 7f2fbb271640 1 -- 172.21.15.2:0/2943683447 >> 172.21.15.2:0/2943683447 conn(0x7f2fb4102250 msgr2=0x7f2fb4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.039+0000 7f2fbb271640 1 -- 172.21.15.2:0/2943683447 shutdown_connections 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.039+0000 7f2fbb271640 1 -- 172.21.15.2:0/2943683447 wait complete. 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.040+0000 7f2fbb271640 1 Processor -- start 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.040+0000 7f2fbb271640 1 -- start start 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.040+0000 7f2fbb271640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb419a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.040+0000 7f2fbb271640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb410ade0 con 0x7f2fb4106960 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.040+0000 7f2fb900d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb419a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.040+0000 7f2fb900d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb419a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48086/0 (socket says 172.21.15.2:48086) 2024-09-21T13:34:07.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.040+0000 7f2fb900d640 1 -- 172.21.15.2:0/2360003940 learned_addr learned my addr 172.21.15.2:0/2360003940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.040+0000 7f2fb900d640 1 -- 172.21.15.2:0/2360003940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb419adc0 con 0x7f2fb4106960 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.041+0000 7f2fb900d640 1 --2- 172.21.15.2:0/2360003940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb419a860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fb002a830 tx=0x7f2fb0030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.041+0000 7f2fa67fc640 1 -- 172.21.15.2:0/2360003940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb0037040 con 0x7f2fb4106960 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.041+0000 7f2fa67fc640 1 -- 172.21.15.2:0/2360003940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2fb0040070 con 0x7f2fb4106960 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.041+0000 7f2fbb271640 1 -- 172.21.15.2:0/2360003940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb419b050 con 0x7f2fb4106960 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.041+0000 7f2fa67fc640 1 -- 172.21.15.2:0/2360003940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb003be40 con 0x7f2fb4106960 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.041+0000 7f2fbb271640 1 -- 172.21.15.2:0/2360003940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb419ba10 con 0x7f2fb4106960 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.042+0000 7f2fa67fc640 1 -- 172.21.15.2:0/2360003940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 51820+0+0 (secure 0 0 0) 0x7f2fb003b430 con 0x7f2fb4106960 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.042+0000 7f2fbb271640 1 -- 172.21.15.2:0/2360003940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb4106d60 con 0x7f2fb4106960 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.042+0000 7f2fa67fc640 1 --2- 172.21.15.2:0/2360003940 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2fa003f910 0x7f2fa0041dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.042+0000 7f2fa67fc640 1 -- 172.21.15.2:0/2360003940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f2fb0074480 con 0x7f2fb4106960 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.042+0000 7f2fb880c640 1 --2- 172.21.15.2:0/2360003940 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2fa003f910 0x7f2fa0041dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.042+0000 7f2fb880c640 1 --2- 172.21.15.2:0/2360003940 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2fa003f910 0x7f2fa0041dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80098c0 tx=0x7f2fa8006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:07.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.047+0000 7f2fa67fc640 1 -- 172.21.15.2:0/2360003940 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2fb0030d50 con 0x7f2fb4106960 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.251+0000 7f2fbb271640 1 -- 172.21.15.2:0/2360003940 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f2fb4103450 con 0x7f2fa003f910 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.499+0000 7f2fa67fc640 1 -- 172.21.15.2:0/2360003940 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f2fb4103450 con 0x7f2fa003f910 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.501+0000 7f2fbb271640 1 -- 172.21.15.2:0/2360003940 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2fa003f910 msgr2=0x7f2fa0041dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.501+0000 7f2fbb271640 1 --2- 172.21.15.2:0/2360003940 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2fa003f910 0x7f2fa0041dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80098c0 tx=0x7f2fa8006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.501+0000 7f2fbb271640 1 -- 172.21.15.2:0/2360003940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 msgr2=0x7f2fb419a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.501+0000 7f2fbb271640 1 --2- 172.21.15.2:0/2360003940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb419a860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fb002a830 tx=0x7f2fb0030bc0 comp rx=0 tx=0).stop 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.501+0000 7f2fbb271640 1 -- 172.21.15.2:0/2360003940 shutdown_connections 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.501+0000 7f2fbb271640 1 --2- 172.21.15.2:0/2360003940 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2fa003f910 0x7f2fa0041dd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.501+0000 7f2fbb271640 1 --2- 172.21.15.2:0/2360003940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fb4106960 0x7f2fb419a860 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.501+0000 7f2fbb271640 1 -- 172.21.15.2:0/2360003940 >> 172.21.15.2:0/2360003940 conn(0x7f2fb4102250 msgr2=0x7f2fb4102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.501+0000 7f2fbb271640 1 -- 172.21.15.2:0/2360003940 shutdown_connections 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:06.502+0000 7f2fbb271640 1 -- 172.21.15.2:0/2360003940 wait complete. 2024-09-21T13:34:07.124 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2024-09-21T13:34:07.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:07 smithi002 ceph-mon[30076]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:07.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:07 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:08.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T13:34:08.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.552+0000 7f571db37640 1 Processor -- start 2024-09-21T13:34:08.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.552+0000 7f571db37640 1 -- start start 2024-09-21T13:34:08.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.552+0000 7f571db37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718105c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:08.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.552+0000 7f571db37640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5718106260 con 0x7f5718105870 2024-09-21T13:34:08.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.552+0000 7f57177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718105c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:08.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.552+0000 7f57177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718105c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35084/0 (socket says 172.21.15.2:35084) 2024-09-21T13:34:08.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.552+0000 7f57177fe640 1 -- 172.21.15.2:0/1522561676 learned_addr learned my addr 172.21.15.2:0/1522561676 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:08.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.552+0000 7f57177fe640 1 -- 172.21.15.2:0/1522561676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57181063e0 con 0x7f5718105870 2024-09-21T13:34:08.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.553+0000 7f57177fe640 1 --2- 172.21.15.2:0/1522561676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718105c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5708009820 tx=0x7f570802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e8bd6c9635a317 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:08.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.553+0000 7f57167fc640 1 -- 172.21.15.2:0/1522561676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5708037070 con 0x7f5718105870 2024-09-21T13:34:08.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.553+0000 7f57167fc640 1 -- 172.21.15.2:0/1522561676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f57080328c0 con 0x7f5718105870 2024-09-21T13:34:08.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.553+0000 7f57167fc640 1 -- 172.21.15.2:0/1522561676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5708030640 con 0x7f5718105870 2024-09-21T13:34:08.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.554+0000 7f571db37640 1 -- 172.21.15.2:0/1522561676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 msgr2=0x7f5718105c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:08.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.554+0000 7f571db37640 1 --2- 172.21.15.2:0/1522561676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718105c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5708009820 tx=0x7f570802a270 comp rx=0 tx=0).stop 2024-09-21T13:34:08.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.554+0000 7f571db37640 1 -- 172.21.15.2:0/1522561676 shutdown_connections 2024-09-21T13:34:08.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.554+0000 7f571db37640 1 --2- 172.21.15.2:0/1522561676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718105c70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:08.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.554+0000 7f571db37640 1 -- 172.21.15.2:0/1522561676 >> 172.21.15.2:0/1522561676 conn(0x7f57181011c0 msgr2=0x7f57181035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:08.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.554+0000 7f571db37640 1 -- 172.21.15.2:0/1522561676 shutdown_connections 2024-09-21T13:34:08.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.554+0000 7f571db37640 1 -- 172.21.15.2:0/1522561676 wait complete. 2024-09-21T13:34:08.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.555+0000 7f571db37640 1 Processor -- start 2024-09-21T13:34:08.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.555+0000 7f571db37640 1 -- start start 2024-09-21T13:34:08.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.555+0000 7f571db37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718190800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:08.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.555+0000 7f571db37640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5718109cf0 con 0x7f5718105870 2024-09-21T13:34:08.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.555+0000 7f57177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718190800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:08.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.555+0000 7f57177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718190800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35088/0 (socket says 172.21.15.2:35088) 2024-09-21T13:34:08.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.555+0000 7f57177fe640 1 -- 172.21.15.2:0/3053098897 learned_addr learned my addr 172.21.15.2:0/3053098897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:08.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.555+0000 7f57177fe640 1 -- 172.21.15.2:0/3053098897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5718190d60 con 0x7f5718105870 2024-09-21T13:34:08.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.556+0000 7f57177fe640 1 --2- 172.21.15.2:0/3053098897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718190800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5708000c00 tx=0x7f5708030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:08.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.556+0000 7f5714ff9640 1 -- 172.21.15.2:0/3053098897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5708037040 con 0x7f5718105870 2024-09-21T13:34:08.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.556+0000 7f5714ff9640 1 -- 172.21.15.2:0/3053098897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5708040070 con 0x7f5718105870 2024-09-21T13:34:08.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.556+0000 7f571db37640 1 -- 172.21.15.2:0/3053098897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571818f150 con 0x7f5718105870 2024-09-21T13:34:08.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.556+0000 7f5714ff9640 1 -- 172.21.15.2:0/3053098897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f570803a390 con 0x7f5718105870 2024-09-21T13:34:08.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.556+0000 7f571db37640 1 -- 172.21.15.2:0/3053098897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571818f6d0 con 0x7f5718105870 2024-09-21T13:34:08.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.557+0000 7f5714ff9640 1 -- 172.21.15.2:0/3053098897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 51820+0+0 (secure 0 0 0) 0x7f570803a5c0 con 0x7f5718105870 2024-09-21T13:34:08.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.557+0000 7f571db37640 1 -- 172.21.15.2:0/3053098897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5718105c70 con 0x7f5718105870 2024-09-21T13:34:08.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.557+0000 7f5714ff9640 1 --2- 172.21.15.2:0/3053098897 >> v2:172.21.15.2:6800/3897423974 conn(0x7f570003f910 0x7f5700041dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:08.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.557+0000 7f5714ff9640 1 -- 172.21.15.2:0/3053098897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f5708074460 con 0x7f5718105870 2024-09-21T13:34:08.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.557+0000 7f5716ffd640 1 --2- 172.21.15.2:0/3053098897 >> v2:172.21.15.2:6800/3897423974 conn(0x7f570003f910 0x7f5700041dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:08.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.558+0000 7f5716ffd640 1 --2- 172.21.15.2:0/3053098897 >> v2:172.21.15.2:6800/3897423974 conn(0x7f570003f910 0x7f5700041dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f570c0098c0 tx=0x7f570c006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:08.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.562+0000 7f5714ff9640 1 -- 172.21.15.2:0/3053098897 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5708043360 con 0x7f5718105870 2024-09-21T13:34:08.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.748+0000 7f571db37640 1 -- 172.21.15.2:0/3053098897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f571818fc00 con 0x7f5718105870 2024-09-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.748+0000 7f5714ff9640 1 -- 172.21.15.2:0/3053098897 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f5708031dd0 con 0x7f5718105870 2024-09-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.750+0000 7f571db37640 1 -- 172.21.15.2:0/3053098897 >> v2:172.21.15.2:6800/3897423974 conn(0x7f570003f910 msgr2=0x7f5700041dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.750+0000 7f571db37640 1 --2- 172.21.15.2:0/3053098897 >> v2:172.21.15.2:6800/3897423974 conn(0x7f570003f910 0x7f5700041dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f570c0098c0 tx=0x7f570c006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.750+0000 7f571db37640 1 -- 172.21.15.2:0/3053098897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 msgr2=0x7f5718190800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.750+0000 7f571db37640 1 --2- 172.21.15.2:0/3053098897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718190800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5708000c00 tx=0x7f5708030b70 comp rx=0 tx=0).stop 2024-09-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.750+0000 7f571db37640 1 -- 172.21.15.2:0/3053098897 shutdown_connections 2024-09-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.750+0000 7f571db37640 1 --2- 172.21.15.2:0/3053098897 >> v2:172.21.15.2:6800/3897423974 conn(0x7f570003f910 0x7f5700041dd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.750+0000 7f571db37640 1 --2- 172.21.15.2:0/3053098897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5718105870 0x7f5718190800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.750+0000 7f571db37640 1 -- 172.21.15.2:0/3053098897 >> 172.21.15.2:0/3053098897 conn(0x7f57181011c0 msgr2=0x7f5718101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.751+0000 7f571db37640 1 -- 172.21.15.2:0/3053098897 shutdown_connections 2024-09-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:07.751+0000 7f571db37640 1 -- 172.21.15.2:0/3053098897 wait complete. 2024-09-21T13:34:08.335 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T13:34:08.335 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-21T13:34:08.343 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T13:34:08.343 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-21T13:34:08.343 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-21T13:34:08.344 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T13:34:08.346 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2024-09-21T13:34:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002.front.sepia.ceph.com:8443/ 2024-09-21T13:34:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2024-09-21T13:34:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: Password: ne9xvu2gsy 2024-09-21T13:34:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:08.346 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config directory 2024-09-21T13:34:08.572 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3053098897' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T13:34:09.733 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.782+0000 7faea88be640 1 Processor -- start 2024-09-21T13:34:09.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.782+0000 7faea88be640 1 -- start start 2024-09-21T13:34:09.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.782+0000 7faea88be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea4109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:09.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.782+0000 7faea88be640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faea4109a70 con 0x7faea407a430 2024-09-21T13:34:09.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.782+0000 7faea259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea4109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:09.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.782+0000 7faea259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea4109530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35096/0 (socket says 172.21.15.2:35096) 2024-09-21T13:34:09.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.782+0000 7faea259c640 1 -- 172.21.15.2:0/3603446562 learned_addr learned my addr 172.21.15.2:0/3603446562 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:09.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.782+0000 7faea259c640 1 -- 172.21.15.2:0/3603446562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea4109bf0 con 0x7faea407a430 2024-09-21T13:34:09.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.783+0000 7faea259c640 1 --2- 172.21.15.2:0/3603446562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea4109530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae94009820 tx=0x7fae9402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6060775e38f94646 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:09.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.783+0000 7faea1d9b640 1 -- 172.21.15.2:0/3603446562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae94037070 con 0x7faea407a430 2024-09-21T13:34:09.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.783+0000 7faea1d9b640 1 -- 172.21.15.2:0/3603446562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fae940328c0 con 0x7faea407a430 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.783+0000 7faea1d9b640 1 -- 172.21.15.2:0/3603446562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae940306d0 con 0x7faea407a430 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.784+0000 7faea88be640 1 -- 172.21.15.2:0/3603446562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 msgr2=0x7faea4109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.784+0000 7faea88be640 1 --2- 172.21.15.2:0/3603446562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea4109530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae94009820 tx=0x7fae9402a300 comp rx=0 tx=0).stop 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.784+0000 7faea88be640 1 -- 172.21.15.2:0/3603446562 shutdown_connections 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.784+0000 7faea88be640 1 --2- 172.21.15.2:0/3603446562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea4109530 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.784+0000 7faea88be640 1 -- 172.21.15.2:0/3603446562 >> 172.21.15.2:0/3603446562 conn(0x7faea41011c0 msgr2=0x7faea41035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.784+0000 7faea88be640 1 -- 172.21.15.2:0/3603446562 shutdown_connections 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.784+0000 7faea88be640 1 -- 172.21.15.2:0/3603446562 wait complete. 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.784+0000 7faea88be640 1 Processor -- start 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7faea88be640 1 -- start start 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7faea88be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea419a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7faea88be640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faea410acf0 con 0x7faea407a430 2024-09-21T13:34:09.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7faea259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea419a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:09.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7faea259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea419a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35106/0 (socket says 172.21.15.2:35106) 2024-09-21T13:34:09.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7faea259c640 1 -- 172.21.15.2:0/2632339951 learned_addr learned my addr 172.21.15.2:0/2632339951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:09.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7faea259c640 1 -- 172.21.15.2:0/2632339951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea419adc0 con 0x7faea407a430 2024-09-21T13:34:09.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7faea259c640 1 --2- 172.21.15.2:0/2632339951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea419a860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fae94032b90 tx=0x7fae94032790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:09.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7fae9b7fe640 1 -- 172.21.15.2:0/2632339951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae94037040 con 0x7faea407a430 2024-09-21T13:34:09.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7faea88be640 1 -- 172.21.15.2:0/2632339951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea419b050 con 0x7faea407a430 2024-09-21T13:34:09.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7fae9b7fe640 1 -- 172.21.15.2:0/2632339951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fae94040070 con 0x7faea407a430 2024-09-21T13:34:09.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.785+0000 7fae9b7fe640 1 -- 172.21.15.2:0/2632339951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae9403be30 con 0x7faea407a430 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.786+0000 7faea88be640 1 -- 172.21.15.2:0/2632339951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea419ba10 con 0x7faea407a430 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.787+0000 7fae9b7fe640 1 -- 172.21.15.2:0/2632339951 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 51820+0+0 (secure 0 0 0) 0x7fae9403b430 con 0x7faea407a430 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.787+0000 7faea88be640 1 -- 172.21.15.2:0/2632339951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea4107520 con 0x7faea407a430 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.787+0000 7fae9b7fe640 1 --2- 172.21.15.2:0/2632339951 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae9003f910 0x7fae90041dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.787+0000 7fae9b7fe640 1 -- 172.21.15.2:0/2632339951 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fae94074370 con 0x7faea407a430 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.787+0000 7fae9bfff640 1 --2- 172.21.15.2:0/2632339951 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae9003f910 0x7fae90041dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.787+0000 7fae9bfff640 1 --2- 172.21.15.2:0/2632339951 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae9003f910 0x7fae90041dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0098c0 tx=0x7fae8c006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:08.795+0000 7fae9b7fe640 1 -- 172.21.15.2:0/2632339951 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae94043360 con 0x7faea407a430 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.086+0000 7faea88be640 1 -- 172.21.15.2:0/2632339951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7faea419c150 con 0x7faea407a430 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.089+0000 7fae9b7fe640 1 -- 172.21.15.2:0/2632339951 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fae94044db0 con 0x7faea407a430 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T13:34:09.737 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.092+0000 7faea88be640 1 -- 172.21.15.2:0/2632339951 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae9003f910 msgr2=0x7fae90041dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:09.738 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.092+0000 7faea88be640 1 --2- 172.21.15.2:0/2632339951 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae9003f910 0x7fae90041dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0098c0 tx=0x7fae8c006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:09.738 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.092+0000 7faea88be640 1 -- 172.21.15.2:0/2632339951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 msgr2=0x7faea419a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:09.738 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.092+0000 7faea88be640 1 --2- 172.21.15.2:0/2632339951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea419a860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fae94032b90 tx=0x7fae94032790 comp rx=0 tx=0).stop 2024-09-21T13:34:09.738 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.092+0000 7faea88be640 1 -- 172.21.15.2:0/2632339951 shutdown_connections 2024-09-21T13:34:09.738 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.092+0000 7faea88be640 1 --2- 172.21.15.2:0/2632339951 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae9003f910 0x7fae90041dd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:09.738 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.092+0000 7faea88be640 1 --2- 172.21.15.2:0/2632339951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea407a430 0x7faea419a860 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:09.738 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.092+0000 7faea88be640 1 -- 172.21.15.2:0/2632339951 >> 172.21.15.2:0/2632339951 conn(0x7faea41011c0 msgr2=0x7faea4101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:09.738 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.092+0000 7faea88be640 1 -- 172.21.15.2:0/2632339951 shutdown_connections 2024-09-21T13:34:09.738 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-21T13:34:09.092+0000 7faea88be640 1 -- 172.21.15.2:0/2632339951 wait complete. 2024-09-21T13:34:09.738 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T13:34:09.738 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /sbin/cephadm shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /sbin/cephadm shell 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:09.739 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2024-09-21T13:34:09.773 INFO:tasks.cephadm:Fetching config... 2024-09-21T13:34:09.773 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:34:09.773 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T13:34:09.789 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T13:34:09.790 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:34:09.790 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T13:34:09.845 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T13:34:09.845 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:34:09.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T13:34:09.912 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T13:34:09.913 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:34:09.913 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T13:34:09.969 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T13:34:09.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zMyC5P7LNjaLyLtf3jtF9mXkLf9WuKWyW0Rm0bO1qPK0qmLs3FESiEEBFYrEm/6eR3GF0k6yP0C1kywxg/cmszkvq6paKPblGVOKLmm+NsISkLkhLC04xTxnjsImdnUHnKYpNkt47eFDoVD1Oj1+8iaV50uLIKyVEgOCjhI0aYyYdIiZTUJp/UQbn/IpPf7UWbMocJWg+esWQBIGWJY4sBYgWGzdZRYg8RhEnrlEzFzOshubHgveWDxrNqq7GxuMGTlNdS+A+nkBIUpqa83+8PE5KdOyma5c5SwnOWQ5j/Qnp7AY9iiB3Zt3bTvhoc9K3dDXXn7mgBJSOmPsMjI8lyh6UefZW+7lHolGKe/pg/BG0WZu66A3VcMe7LqS+r3ucdZsYoyCHSzzgtnNiyGc0QrP85T66/PIA5ToyqMTV7u6YLCptgWSoLrFnfy7rGeBzaLj7cxZwts1sEaOOvIo4VZVkRUyap6naSaWVa5TFYdTg3C0LeNZxSXTlmyXC8s= ceph-e6144070-781d-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T13:34:10.044 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zMyC5P7LNjaLyLtf3jtF9mXkLf9WuKWyW0Rm0bO1qPK0qmLs3FESiEEBFYrEm/6eR3GF0k6yP0C1kywxg/cmszkvq6paKPblGVOKLmm+NsISkLkhLC04xTxnjsImdnUHnKYpNkt47eFDoVD1Oj1+8iaV50uLIKyVEgOCjhI0aYyYdIiZTUJp/UQbn/IpPf7UWbMocJWg+esWQBIGWJY4sBYgWGzdZRYg8RhEnrlEzFzOshubHgveWDxrNqq7GxuMGTlNdS+A+nkBIUpqa83+8PE5KdOyma5c5SwnOWQ5j/Qnp7AY9iiB3Zt3bTvhoc9K3dDXXn7mgBJSOmPsMjI8lyh6UefZW+7lHolGKe/pg/BG0WZu66A3VcMe7LqS+r3ucdZsYoyCHSzzgtnNiyGc0QrP85T66/PIA5ToyqMTV7u6YLCptgWSoLrFnfy7rGeBzaLj7cxZwts1sEaOOvIo4VZVkRUyap6naSaWVa5TFYdTg3C0LeNZxSXTlmyXC8s= ceph-e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:10.056 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zMyC5P7LNjaLyLtf3jtF9mXkLf9WuKWyW0Rm0bO1qPK0qmLs3FESiEEBFYrEm/6eR3GF0k6yP0C1kywxg/cmszkvq6paKPblGVOKLmm+NsISkLkhLC04xTxnjsImdnUHnKYpNkt47eFDoVD1Oj1+8iaV50uLIKyVEgOCjhI0aYyYdIiZTUJp/UQbn/IpPf7UWbMocJWg+esWQBIGWJY4sBYgWGzdZRYg8RhEnrlEzFzOshubHgveWDxrNqq7GxuMGTlNdS+A+nkBIUpqa83+8PE5KdOyma5c5SwnOWQ5j/Qnp7AY9iiB3Zt3bTvhoc9K3dDXXn7mgBJSOmPsMjI8lyh6UefZW+7lHolGKe/pg/BG0WZu66A3VcMe7LqS+r3ucdZsYoyCHSzzgtnNiyGc0QrP85T66/PIA5ToyqMTV7u6YLCptgWSoLrFnfy7rGeBzaLj7cxZwts1sEaOOvIo4VZVkRUyap6naSaWVa5TFYdTg3C0LeNZxSXTlmyXC8s= ceph-e6144070-781d-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T13:34:10.111 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zMyC5P7LNjaLyLtf3jtF9mXkLf9WuKWyW0Rm0bO1qPK0qmLs3FESiEEBFYrEm/6eR3GF0k6yP0C1kywxg/cmszkvq6paKPblGVOKLmm+NsISkLkhLC04xTxnjsImdnUHnKYpNkt47eFDoVD1Oj1+8iaV50uLIKyVEgOCjhI0aYyYdIiZTUJp/UQbn/IpPf7UWbMocJWg+esWQBIGWJY4sBYgWGzdZRYg8RhEnrlEzFzOshubHgveWDxrNqq7GxuMGTlNdS+A+nkBIUpqa83+8PE5KdOyma5c5SwnOWQ5j/Qnp7AY9iiB3Zt3bTvhoc9K3dDXXn7mgBJSOmPsMjI8lyh6UefZW+7lHolGKe/pg/BG0WZu66A3VcMe7LqS+r3ucdZsYoyCHSzzgtnNiyGc0QrP85T66/PIA5ToyqMTV7u6YLCptgWSoLrFnfy7rGeBzaLj7cxZwts1sEaOOvIo4VZVkRUyap6naSaWVa5TFYdTg3C0LeNZxSXTlmyXC8s= ceph-e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:10.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T13:34:10.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2632339951' entity='client.admin' 2024-09-21T13:34:10.386 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:34:10.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.869+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1338187131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e41012e0 msgr2=0x7ff4e41016e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:10.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.869+0000 7ff4eafa1640 1 --2- 172.21.15.2:0/1338187131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e41012e0 0x7ff4e41016e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009880 tx=0x7ff4d802a5d0 comp rx=0 tx=0).stop 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.869+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1338187131 shutdown_connections 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.869+0000 7ff4eafa1640 1 --2- 172.21.15.2:0/1338187131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e41012e0 0x7ff4e41016e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.869+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1338187131 >> 172.21.15.2:0/1338187131 conn(0x7ff4e40fcbd0 msgr2=0x7ff4e40feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.869+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1338187131 shutdown_connections 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.869+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1338187131 wait complete. 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.870+0000 7ff4eafa1640 1 Processor -- start 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.870+0000 7ff4eafa1640 1 -- start start 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.870+0000 7ff4eafa1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e41012e0 0x7ff4e40fe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.870+0000 7ff4eafa1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e41069f0 con 0x7ff4e41012e0 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.870+0000 7ff4e8d3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e41012e0 0x7ff4e40fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.870+0000 7ff4e8d3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e41012e0 0x7ff4e40fe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35122/0 (socket says 172.21.15.2:35122) 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.870+0000 7ff4e8d3d640 1 -- 172.21.15.2:0/1547152277 learned_addr learned my addr 172.21.15.2:0/1547152277 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.871+0000 7ff4e8d3d640 1 -- 172.21.15.2:0/1547152277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e40fed80 con 0x7ff4e41012e0 2024-09-21T13:34:10.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.871+0000 7ff4e8d3d640 1 --2- 172.21.15.2:0/1547152277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e41012e0 0x7ff4e40fe820 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80057c0 tx=0x7ff4d80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.871+0000 7ff4e1ffb640 1 -- 172.21.15.2:0/1547152277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4d803f070 con 0x7ff4e41012e0 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.871+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1547152277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e40fd170 con 0x7ff4e41012e0 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.871+0000 7ff4e1ffb640 1 -- 172.21.15.2:0/1547152277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff4d8003ba0 con 0x7ff4e41012e0 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.871+0000 7ff4e1ffb640 1 -- 172.21.15.2:0/1547152277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4d8035030 con 0x7ff4e41012e0 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.871+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1547152277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e40fd6f0 con 0x7ff4e41012e0 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.872+0000 7ff4e1ffb640 1 -- 172.21.15.2:0/1547152277 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 51820+0+0 (secure 0 0 0) 0x7ff4d8042070 con 0x7ff4e41012e0 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.872+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1547152277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e4107170 con 0x7ff4e41012e0 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.873+0000 7ff4e1ffb640 1 --2- 172.21.15.2:0/1547152277 >> v2:172.21.15.2:6800/3897423974 conn(0x7ff4d403f800 0x7ff4d4041cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.873+0000 7ff4e1ffb640 1 -- 172.21.15.2:0/1547152277 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7ff4d8074cc0 con 0x7ff4e41012e0 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.873+0000 7ff4e3fff640 1 --2- 172.21.15.2:0/1547152277 >> v2:172.21.15.2:6800/3897423974 conn(0x7ff4d403f800 0x7ff4d4041cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.873+0000 7ff4e3fff640 1 --2- 172.21.15.2:0/1547152277 >> v2:172.21.15.2:6800/3897423974 conn(0x7ff4d403f800 0x7ff4d4041cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00098c0 tx=0x7ff4d0006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:10.878+0000 7ff4e1ffb640 1 -- 172.21.15.2:0/1547152277 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4d8036260 con 0x7ff4e41012e0 2024-09-21T13:34:11.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.068+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1547152277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7ff4e402e5c0 con 0x7ff4e41012e0 2024-09-21T13:34:11.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.070+0000 7ff4e1ffb640 1 -- 172.21.15.2:0/1547152277 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7ff4d804ad50 con 0x7ff4e41012e0 2024-09-21T13:34:11.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.073+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1547152277 >> v2:172.21.15.2:6800/3897423974 conn(0x7ff4d403f800 msgr2=0x7ff4d4041cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:11.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.073+0000 7ff4eafa1640 1 --2- 172.21.15.2:0/1547152277 >> v2:172.21.15.2:6800/3897423974 conn(0x7ff4d403f800 0x7ff4d4041cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00098c0 tx=0x7ff4d0006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:11.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.073+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1547152277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e41012e0 msgr2=0x7ff4e40fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:11.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.073+0000 7ff4eafa1640 1 --2- 172.21.15.2:0/1547152277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e41012e0 0x7ff4e40fe820 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80057c0 tx=0x7ff4d80048f0 comp rx=0 tx=0).stop 2024-09-21T13:34:11.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.073+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1547152277 shutdown_connections 2024-09-21T13:34:11.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.073+0000 7ff4eafa1640 1 --2- 172.21.15.2:0/1547152277 >> v2:172.21.15.2:6800/3897423974 conn(0x7ff4d403f800 0x7ff4d4041cc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:11.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.073+0000 7ff4eafa1640 1 --2- 172.21.15.2:0/1547152277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e41012e0 0x7ff4e40fe820 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:11.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.073+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1547152277 >> 172.21.15.2:0/1547152277 conn(0x7ff4e40fcbd0 msgr2=0x7ff4e406ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:11.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.073+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1547152277 shutdown_connections 2024-09-21T13:34:11.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:11.073+0000 7ff4eafa1640 1 -- 172.21.15.2:0/1547152277 wait complete. 2024-09-21T13:34:12.104 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T13:34:12.104 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T13:34:12.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1547152277' entity='client.admin' 2024-09-21T13:34:12.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:12 smithi002 ceph-mon[30076]: mgrmap e13: y(active, since 12s) 2024-09-21T13:34:12.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:12 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:12.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:12 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:12.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:12 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"} : dispatch 2024-09-21T13:34:12.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:12 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:12.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:12 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:12.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:12 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:12.558 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:34:13.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.063+0000 7f7121e41640 1 -- 172.21.15.2:0/1170674638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f711c101330 msgr2=0x7f711c101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:13.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.063+0000 7f7121e41640 1 --2- 172.21.15.2:0/1170674638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f711c101330 0x7f711c101730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f710c009880 tx=0x7f710c02a5d0 comp rx=0 tx=0).stop 2024-09-21T13:34:13.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.063+0000 7f7121e41640 1 -- 172.21.15.2:0/1170674638 shutdown_connections 2024-09-21T13:34:13.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.063+0000 7f7121e41640 1 --2- 172.21.15.2:0/1170674638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f711c101330 0x7f711c101730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:13.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.063+0000 7f7121e41640 1 -- 172.21.15.2:0/1170674638 >> 172.21.15.2:0/1170674638 conn(0x7f711c0fcc20 msgr2=0x7f711c0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:13.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.063+0000 7f7121e41640 1 -- 172.21.15.2:0/1170674638 shutdown_connections 2024-09-21T13:34:13.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.063+0000 7f7121e41640 1 -- 172.21.15.2:0/1170674638 wait complete. 2024-09-21T13:34:13.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.064+0000 7f7121e41640 1 Processor -- start 2024-09-21T13:34:13.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.064+0000 7f7121e41640 1 -- start start 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.064+0000 7f7121e41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f711c101330 0x7f711c196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.064+0000 7f7121e41640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f711c106a40 con 0x7f711c101330 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.065+0000 7f711b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f711c101330 0x7f711c196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.065+0000 7f711b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f711c101330 0x7f711c196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35150/0 (socket says 172.21.15.2:35150) 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.065+0000 7f711b7fe640 1 -- 172.21.15.2:0/1497792664 learned_addr learned my addr 172.21.15.2:0/1497792664 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.065+0000 7f711b7fe640 1 -- 172.21.15.2:0/1497792664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711c1967f0 con 0x7f711c101330 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.065+0000 7f711b7fe640 1 --2- 172.21.15.2:0/1497792664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f711c101330 0x7f711c196290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f710c0057c0 tx=0x7f710c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.065+0000 7f7118ff9640 1 -- 172.21.15.2:0/1497792664 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f710c03f070 con 0x7f711c101330 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.065+0000 7f7118ff9640 1 -- 172.21.15.2:0/1497792664 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f710c003ba0 con 0x7f711c101330 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.065+0000 7f7118ff9640 1 -- 172.21.15.2:0/1497792664 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f710c035030 con 0x7f711c101330 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.065+0000 7f7121e41640 1 -- 172.21.15.2:0/1497792664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711c196a80 con 0x7f711c101330 2024-09-21T13:34:13.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.065+0000 7f7121e41640 1 -- 172.21.15.2:0/1497792664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f711c197440 con 0x7f711c101330 2024-09-21T13:34:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.066+0000 7f7121e41640 1 -- 172.21.15.2:0/1497792664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f711c1071c0 con 0x7f711c101330 2024-09-21T13:34:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.066+0000 7f7118ff9640 1 -- 172.21.15.2:0/1497792664 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7f710c042070 con 0x7f711c101330 2024-09-21T13:34:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.067+0000 7f7118ff9640 1 --2- 172.21.15.2:0/1497792664 >> v2:172.21.15.2:6800/3897423974 conn(0x7f710403f8f0 0x7f7104041db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.067+0000 7f7118ff9640 1 -- 172.21.15.2:0/1497792664 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f710c074e10 con 0x7f711c101330 2024-09-21T13:34:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.067+0000 7f711affd640 1 --2- 172.21.15.2:0/1497792664 >> v2:172.21.15.2:6800/3897423974 conn(0x7f710403f8f0 0x7f7104041db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.067+0000 7f711affd640 1 --2- 172.21.15.2:0/1497792664 >> v2:172.21.15.2:6800/3897423974 conn(0x7f710403f8f0 0x7f7104041db0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f71100098c0 tx=0x7f7110006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.071+0000 7f7118ff9640 1 -- 172.21.15.2:0/1497792664 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f710c039df0 con 0x7f711c101330 2024-09-21T13:34:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.287+0000 7f7121e41640 1 -- 172.21.15.2:0/1497792664 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f711c0fef40 con 0x7f710403f8f0 2024-09-21T13:34:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.290+0000 7f7118ff9640 1 -- 172.21.15.2:0/1497792664 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f711c0fef40 con 0x7f710403f8f0 2024-09-21T13:34:13.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.293+0000 7f7121e41640 1 -- 172.21.15.2:0/1497792664 >> v2:172.21.15.2:6800/3897423974 conn(0x7f710403f8f0 msgr2=0x7f7104041db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:13.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.293+0000 7f7121e41640 1 --2- 172.21.15.2:0/1497792664 >> v2:172.21.15.2:6800/3897423974 conn(0x7f710403f8f0 0x7f7104041db0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f71100098c0 tx=0x7f7110006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:13.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.293+0000 7f7121e41640 1 -- 172.21.15.2:0/1497792664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f711c101330 msgr2=0x7f711c196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:13.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.293+0000 7f7121e41640 1 --2- 172.21.15.2:0/1497792664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f711c101330 0x7f711c196290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f710c0057c0 tx=0x7f710c0048f0 comp rx=0 tx=0).stop 2024-09-21T13:34:13.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.293+0000 7f7121e41640 1 -- 172.21.15.2:0/1497792664 shutdown_connections 2024-09-21T13:34:13.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.293+0000 7f7121e41640 1 --2- 172.21.15.2:0/1497792664 >> v2:172.21.15.2:6800/3897423974 conn(0x7f710403f8f0 0x7f7104041db0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:13.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.293+0000 7f7121e41640 1 --2- 172.21.15.2:0/1497792664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f711c101330 0x7f711c196290 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:13.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.293+0000 7f7121e41640 1 -- 172.21.15.2:0/1497792664 >> 172.21.15.2:0/1497792664 conn(0x7f711c0fcc20 msgr2=0x7f711c0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:13.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.294+0000 7f7121e41640 1 -- 172.21.15.2:0/1497792664 shutdown_connections 2024-09-21T13:34:13.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:13.294+0000 7f7121e41640 1 -- 172.21.15.2:0/1497792664 wait complete. 2024-09-21T13:34:14.123 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2024-09-21T13:34:14.123 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:34:14.123 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2024-09-21T13:34:14.143 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:34:14.143 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:34:14.202 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2024-09-21T13:34:14.202 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch host add smithi162 2024-09-21T13:34:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:14.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:14.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-21T13:34:14.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: Updating smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:34:14.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:34:14.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: Updating smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T13:34:14.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:14.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:14.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:14.634 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:34:15.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.085+0000 7fc371a90640 1 -- 172.21.15.2:0/722456829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc36c1084b0 msgr2=0x7fc36c108890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.085+0000 7fc371a90640 1 --2- 172.21.15.2:0/722456829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc36c1084b0 0x7fc36c108890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009880 tx=0x7fc35c02a670 comp rx=0 tx=0).stop 2024-09-21T13:34:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.085+0000 7fc371a90640 1 -- 172.21.15.2:0/722456829 shutdown_connections 2024-09-21T13:34:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.085+0000 7fc371a90640 1 --2- 172.21.15.2:0/722456829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc36c1084b0 0x7fc36c108890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.085+0000 7fc371a90640 1 -- 172.21.15.2:0/722456829 >> 172.21.15.2:0/722456829 conn(0x7fc36c078210 msgr2=0x7fc36c078620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.085+0000 7fc371a90640 1 -- 172.21.15.2:0/722456829 shutdown_connections 2024-09-21T13:34:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.085+0000 7fc371a90640 1 -- 172.21.15.2:0/722456829 wait complete. 2024-09-21T13:34:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.085+0000 7fc371a90640 1 Processor -- start 2024-09-21T13:34:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.086+0000 7fc371a90640 1 -- start start 2024-09-21T13:34:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.086+0000 7fc371a90640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc36c1084b0 0x7fc36c197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.086+0000 7fc371a90640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c10c0e0 con 0x7fc36c1084b0 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.086+0000 7fc36b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc36c1084b0 0x7fc36c197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.086+0000 7fc36b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc36c1084b0 0x7fc36c197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35174/0 (socket says 172.21.15.2:35174) 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.086+0000 7fc36b7fe640 1 -- 172.21.15.2:0/629087530 learned_addr learned my addr 172.21.15.2:0/629087530 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.086+0000 7fc36b7fe640 1 -- 172.21.15.2:0/629087530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c197bc0 con 0x7fc36c1084b0 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.086+0000 7fc36b7fe640 1 --2- 172.21.15.2:0/629087530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc36c1084b0 0x7fc36c197680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc35c005ab0 tx=0x7fc35c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.086+0000 7fc368ff9640 1 -- 172.21.15.2:0/629087530 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c03f070 con 0x7fc36c1084b0 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.086+0000 7fc368ff9640 1 -- 172.21.15.2:0/629087530 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fc35c003a70 con 0x7fc36c1084b0 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.086+0000 7fc368ff9640 1 -- 172.21.15.2:0/629087530 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c035030 con 0x7fc36c1084b0 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.087+0000 7fc371a90640 1 -- 172.21.15.2:0/629087530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36c197eb0 con 0x7fc36c1084b0 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.087+0000 7fc371a90640 1 -- 172.21.15.2:0/629087530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36c19cf60 con 0x7fc36c1084b0 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.087+0000 7fc368ff9640 1 -- 172.21.15.2:0/629087530 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7fc35c042070 con 0x7fc36c1084b0 2024-09-21T13:34:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.088+0000 7fc371a90640 1 -- 172.21.15.2:0/629087530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc36c103a50 con 0x7fc36c1084b0 2024-09-21T13:34:15.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.088+0000 7fc368ff9640 1 --2- 172.21.15.2:0/629087530 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc35403f8f0 0x7fc354041db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:15.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.088+0000 7fc368ff9640 1 -- 172.21.15.2:0/629087530 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fc35c074c20 con 0x7fc36c1084b0 2024-09-21T13:34:15.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.088+0000 7fc36affd640 1 --2- 172.21.15.2:0/629087530 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc35403f8f0 0x7fc354041db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:15.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.088+0000 7fc36affd640 1 --2- 172.21.15.2:0/629087530 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc35403f8f0 0x7fc354041db0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc3600098c0 tx=0x7fc360006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:15.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.093+0000 7fc368ff9640 1 -- 172.21.15.2:0/629087530 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc35c036260 con 0x7fc36c1084b0 2024-09-21T13:34:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:15.284+0000 7fc371a90640 1 -- 172.21.15.2:0/629087530 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}) -- 0x7fc36c1987b0 con 0x7fc35403f8f0 2024-09-21T13:34:16.174 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:15 smithi002 ceph-mon[30076]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:17.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:16 smithi002 ceph-mon[30076]: Deploying cephadm binary to smithi162 2024-09-21T13:34:18.977 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi162' with addr '172.21.15.162' 2024-09-21T13:34:18.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:18.974+0000 7fc368ff9640 1 -- 172.21.15.2:0/629087530 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc36c1987b0 con 0x7fc35403f8f0 2024-09-21T13:34:18.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:18.976+0000 7fc371a90640 1 -- 172.21.15.2:0/629087530 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc35403f8f0 msgr2=0x7fc354041db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:18.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:18.976+0000 7fc371a90640 1 --2- 172.21.15.2:0/629087530 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc35403f8f0 0x7fc354041db0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc3600098c0 tx=0x7fc360006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:18.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:18.976+0000 7fc371a90640 1 -- 172.21.15.2:0/629087530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc36c1084b0 msgr2=0x7fc36c197680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:18.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:18.976+0000 7fc371a90640 1 --2- 172.21.15.2:0/629087530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc36c1084b0 0x7fc36c197680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc35c005ab0 tx=0x7fc35c0048f0 comp rx=0 tx=0).stop 2024-09-21T13:34:18.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:18.976+0000 7fc371a90640 1 -- 172.21.15.2:0/629087530 shutdown_connections 2024-09-21T13:34:18.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:18.976+0000 7fc371a90640 1 --2- 172.21.15.2:0/629087530 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc35403f8f0 0x7fc354041db0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:18.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:18.976+0000 7fc371a90640 1 --2- 172.21.15.2:0/629087530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc36c1084b0 0x7fc36c197680 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:18.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:18.977+0000 7fc371a90640 1 -- 172.21.15.2:0/629087530 >> 172.21.15.2:0/629087530 conn(0x7fc36c078210 msgr2=0x7fc36c1047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:18.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:18.977+0000 7fc371a90640 1 -- 172.21.15.2:0/629087530 shutdown_connections 2024-09-21T13:34:18.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:18.977+0000 7fc371a90640 1 -- 172.21.15.2:0/629087530 wait complete. 2024-09-21T13:34:19.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:19 smithi002 ceph-mon[30076]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:19.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:19.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:19.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T13:34:19.905 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:34:20.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:20 smithi002 ceph-mon[30076]: Added host smithi162 2024-09-21T13:34:20.343 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:20 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:20.343 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:20 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.340+0000 7f4454194640 1 -- 172.21.15.2:0/229899744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f444c101680 msgr2=0x7f444c101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.340+0000 7f4454194640 1 --2- 172.21.15.2:0/229899744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f444c101680 0x7f444c101a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4448009880 tx=0x7f444802a5d0 comp rx=0 tx=0).stop 2024-09-21T13:34:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.341+0000 7f4454194640 1 -- 172.21.15.2:0/229899744 shutdown_connections 2024-09-21T13:34:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.341+0000 7f4454194640 1 --2- 172.21.15.2:0/229899744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f444c101680 0x7f444c101a60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.341+0000 7f4454194640 1 -- 172.21.15.2:0/229899744 >> 172.21.15.2:0/229899744 conn(0x7f444c078280 msgr2=0x7f444c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.341+0000 7f4454194640 1 -- 172.21.15.2:0/229899744 shutdown_connections 2024-09-21T13:34:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.341+0000 7f4454194640 1 -- 172.21.15.2:0/229899744 wait complete. 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.341+0000 7f4454194640 1 Processor -- start 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.341+0000 7f4454194640 1 -- start start 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4454194640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f444c1998b0 0x7f444c199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4454194640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f444c10afe0 con 0x7f444c1998b0 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4451f30640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f444c1998b0 0x7f444c199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4451f30640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f444c1998b0 0x7f444c199c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36098/0 (socket says 172.21.15.2:36098) 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4451f30640 1 -- 172.21.15.2:0/2967973447 learned_addr learned my addr 172.21.15.2:0/2967973447 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4451f30640 1 -- 172.21.15.2:0/2967973447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c19a1d0 con 0x7f444c1998b0 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4451f30640 1 --2- 172.21.15.2:0/2967973447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f444c1998b0 0x7f444c199c90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4448005ab0 tx=0x7f44480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4442ffd640 1 -- 172.21.15.2:0/2967973447 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f444803f070 con 0x7f444c1998b0 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4442ffd640 1 -- 172.21.15.2:0/2967973447 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f4448003a70 con 0x7f444c1998b0 2024-09-21T13:34:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4454194640 1 -- 172.21.15.2:0/2967973447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444c19a4c0 con 0x7f444c1998b0 2024-09-21T13:34:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4442ffd640 1 -- 172.21.15.2:0/2967973447 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4448035030 con 0x7f444c1998b0 2024-09-21T13:34:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.342+0000 7f4454194640 1 -- 172.21.15.2:0/2967973447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f444c19f490 con 0x7f444c1998b0 2024-09-21T13:34:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.343+0000 7f4454194640 1 -- 172.21.15.2:0/2967973447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f444c102930 con 0x7f444c1998b0 2024-09-21T13:34:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.343+0000 7f4442ffd640 1 -- 172.21.15.2:0/2967973447 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7f4448042070 con 0x7f444c1998b0 2024-09-21T13:34:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.344+0000 7f4442ffd640 1 --2- 172.21.15.2:0/2967973447 >> v2:172.21.15.2:6800/3897423974 conn(0x7f443803f8a0 0x7f4438041d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.344+0000 7f4442ffd640 1 -- 172.21.15.2:0/2967973447 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f4448074cd0 con 0x7f444c1998b0 2024-09-21T13:34:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.344+0000 7f445172f640 1 --2- 172.21.15.2:0/2967973447 >> v2:172.21.15.2:6800/3897423974 conn(0x7f443803f8a0 0x7f4438041d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.344+0000 7f445172f640 1 --2- 172.21.15.2:0/2967973447 >> v2:172.21.15.2:6800/3897423974 conn(0x7f443803f8a0 0x7f4438041d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f443c0098c0 tx=0x7f443c006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.348+0000 7f4442ffd640 1 -- 172.21.15.2:0/2967973447 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44480372d0 con 0x7f444c1998b0 2024-09-21T13:34:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.545+0000 7f4454194640 1 -- 172.21.15.2:0/2967973447 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f444c19a9e0 con 0x7f443803f8a0 2024-09-21T13:34:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.546+0000 7f4442ffd640 1 -- 172.21.15.2:0/2967973447 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f444c19a9e0 con 0x7f443803f8a0 2024-09-21T13:34:20.548 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:20.548 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}] 2024-09-21T13:34:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.548+0000 7f4454194640 1 -- 172.21.15.2:0/2967973447 >> v2:172.21.15.2:6800/3897423974 conn(0x7f443803f8a0 msgr2=0x7f4438041d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.548+0000 7f4454194640 1 --2- 172.21.15.2:0/2967973447 >> v2:172.21.15.2:6800/3897423974 conn(0x7f443803f8a0 0x7f4438041d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f443c0098c0 tx=0x7f443c006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.548+0000 7f4454194640 1 -- 172.21.15.2:0/2967973447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f444c1998b0 msgr2=0x7f444c199c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.548+0000 7f4454194640 1 --2- 172.21.15.2:0/2967973447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f444c1998b0 0x7f444c199c90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4448005ab0 tx=0x7f44480048f0 comp rx=0 tx=0).stop 2024-09-21T13:34:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.548+0000 7f4454194640 1 -- 172.21.15.2:0/2967973447 shutdown_connections 2024-09-21T13:34:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.548+0000 7f4454194640 1 --2- 172.21.15.2:0/2967973447 >> v2:172.21.15.2:6800/3897423974 conn(0x7f443803f8a0 0x7f4438041d60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.548+0000 7f4454194640 1 --2- 172.21.15.2:0/2967973447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f444c1998b0 0x7f444c199c90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.548+0000 7f4454194640 1 -- 172.21.15.2:0/2967973447 >> 172.21.15.2:0/2967973447 conn(0x7f444c101680 msgr2=0x7f444c0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.548+0000 7f4454194640 1 -- 172.21.15.2:0/2967973447 shutdown_connections 2024-09-21T13:34:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:20.548+0000 7f4454194640 1 -- 172.21.15.2:0/2967973447 wait complete. 2024-09-21T13:34:21.180 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T13:34:21.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd crush tunables default 2024-09-21T13:34:21.430 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:34:21.543 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:21 smithi002 ceph-mon[30076]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:21.544 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:21 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:21.544 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:21 smithi002 ceph-mon[30076]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T13:34:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.820+0000 7f7ea1be1640 1 -- 172.21.15.2:0/3486636882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9c1035a0 msgr2=0x7f7e9c103980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.820+0000 7f7ea1be1640 1 --2- 172.21.15.2:0/3486636882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9c1035a0 0x7f7e9c103980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009880 tx=0x7f7e8c02a5d0 comp rx=0 tx=0).stop 2024-09-21T13:34:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.820+0000 7f7ea1be1640 1 -- 172.21.15.2:0/3486636882 shutdown_connections 2024-09-21T13:34:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.820+0000 7f7ea1be1640 1 --2- 172.21.15.2:0/3486636882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9c1035a0 0x7f7e9c103980 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.820+0000 7f7ea1be1640 1 -- 172.21.15.2:0/3486636882 >> 172.21.15.2:0/3486636882 conn(0x7f7e9c0fd0f0 msgr2=0x7f7e9c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.820+0000 7f7ea1be1640 1 -- 172.21.15.2:0/3486636882 shutdown_connections 2024-09-21T13:34:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.820+0000 7f7ea1be1640 1 -- 172.21.15.2:0/3486636882 wait complete. 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.821+0000 7f7ea1be1640 1 Processor -- start 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.821+0000 7f7ea1be1640 1 -- start start 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.821+0000 7f7ea1be1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9c1035a0 0x7f7e9c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.821+0000 7f7ea1be1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c10c150 con 0x7f7e9c1035a0 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.821+0000 7f7e9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9c1035a0 0x7f7e9c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.821+0000 7f7e9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9c1035a0 0x7f7e9c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36122/0 (socket says 172.21.15.2:36122) 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.821+0000 7f7e9b7fe640 1 -- 172.21.15.2:0/95869746 learned_addr learned my addr 172.21.15.2:0/95869746 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.821+0000 7f7e9b7fe640 1 -- 172.21.15.2:0/95869746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9c1031c0 con 0x7f7e9c1035a0 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.822+0000 7f7e9b7fe640 1 --2- 172.21.15.2:0/95869746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9c1035a0 0x7f7e9c101420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0099a0 tx=0x7f7e8c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.822+0000 7f7e98ff9640 1 -- 172.21.15.2:0/95869746 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e8c03f070 con 0x7f7e9c1035a0 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.822+0000 7f7ea1be1640 1 -- 172.21.15.2:0/95869746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9c101960 con 0x7f7e9c1035a0 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.822+0000 7f7e98ff9640 1 -- 172.21.15.2:0/95869746 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7e8c003a70 con 0x7f7e9c1035a0 2024-09-21T13:34:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.822+0000 7f7e98ff9640 1 -- 172.21.15.2:0/95869746 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e8c035030 con 0x7f7e9c1035a0 2024-09-21T13:34:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.822+0000 7f7ea1be1640 1 -- 172.21.15.2:0/95869746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e9c101ee0 con 0x7f7e9c1035a0 2024-09-21T13:34:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.823+0000 7f7e98ff9640 1 -- 172.21.15.2:0/95869746 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7f7e8c042070 con 0x7f7e9c1035a0 2024-09-21T13:34:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.823+0000 7f7ea1be1640 1 -- 172.21.15.2:0/95869746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e9c06b470 con 0x7f7e9c1035a0 2024-09-21T13:34:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.823+0000 7f7e98ff9640 1 --2- 172.21.15.2:0/95869746 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7e8403f8a0 0x7f7e84041d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.823+0000 7f7e98ff9640 1 -- 172.21.15.2:0/95869746 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f7e8c074d60 con 0x7f7e9c1035a0 2024-09-21T13:34:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.823+0000 7f7e9affd640 1 --2- 172.21.15.2:0/95869746 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7e8403f8a0 0x7f7e84041d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.824+0000 7f7e9affd640 1 --2- 172.21.15.2:0/95869746 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7e8403f8a0 0x7f7e84041d60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7e900098c0 tx=0x7f7e90006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:21.828+0000 7f7e98ff9640 1 -- 172.21.15.2:0/95869746 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e8c03be20 con 0x7f7e9c1035a0 2024-09-21T13:34:22.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.021+0000 7f7ea1be1640 1 -- 172.21.15.2:0/95869746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7e9c103a00 con 0x7f7e9c1035a0 2024-09-21T13:34:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.283+0000 7f7e98ff9640 1 -- 172.21.15.2:0/95869746 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f7e8c03aa20 con 0x7f7e9c1035a0 2024-09-21T13:34:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-21T13:34:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.285+0000 7f7ea1be1640 1 -- 172.21.15.2:0/95869746 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7e8403f8a0 msgr2=0x7f7e84041d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.285+0000 7f7ea1be1640 1 --2- 172.21.15.2:0/95869746 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7e8403f8a0 0x7f7e84041d60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7e900098c0 tx=0x7f7e90006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.285+0000 7f7ea1be1640 1 -- 172.21.15.2:0/95869746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9c1035a0 msgr2=0x7f7e9c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.285+0000 7f7ea1be1640 1 --2- 172.21.15.2:0/95869746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9c1035a0 0x7f7e9c101420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0099a0 tx=0x7f7e8c0048f0 comp rx=0 tx=0).stop 2024-09-21T13:34:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.285+0000 7f7ea1be1640 1 -- 172.21.15.2:0/95869746 shutdown_connections 2024-09-21T13:34:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.285+0000 7f7ea1be1640 1 --2- 172.21.15.2:0/95869746 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7e8403f8a0 0x7f7e84041d60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.285+0000 7f7ea1be1640 1 --2- 172.21.15.2:0/95869746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9c1035a0 0x7f7e9c101420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.285+0000 7f7ea1be1640 1 -- 172.21.15.2:0/95869746 >> 172.21.15.2:0/95869746 conn(0x7f7e9c0fd0f0 msgr2=0x7f7e9c106d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.285+0000 7f7ea1be1640 1 -- 172.21.15.2:0/95869746 shutdown_connections 2024-09-21T13:34:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:22.285+0000 7f7ea1be1640 1 -- 172.21.15.2:0/95869746 wait complete. 2024-09-21T13:34:22.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/95869746' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T13:34:22.881 INFO:tasks.cephadm:Adding mon.a on smithi002 2024-09-21T13:34:22.881 INFO:tasks.cephadm:Adding mon.c on smithi002 2024-09-21T13:34:22.881 INFO:tasks.cephadm:Adding mon.b on smithi162 2024-09-21T13:34:22.882 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch apply mon '3;smithi002:172.21.15.2=a;smithi002:[v2:172.21.15.2:3301,v1:172.21.15.2:6790]=c;smithi162:172.21.15.162=b' 2024-09-21T13:34:23.200 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T13:34:23.246 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T13:34:23.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:23 smithi002 ceph-mon[30076]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:23.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/95869746' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T13:34:23.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:23 smithi002 ceph-mon[30076]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T13:34:23.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:23.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:23.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:23.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:23.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T13:34:23.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:23.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:23.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.779+0000 7f0e996e5640 1 -- 172.21.15.162:0/1452135491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e941012e0 msgr2=0x7f0e941016e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:23.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.779+0000 7f0e996e5640 1 --2- 172.21.15.162:0/1452135491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e941012e0 0x7f0e941016e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009880 tx=0x7f0e8402a5d0 comp rx=0 tx=0).stop 2024-09-21T13:34:23.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.779+0000 7f0e996e5640 1 -- 172.21.15.162:0/1452135491 shutdown_connections 2024-09-21T13:34:23.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.779+0000 7f0e996e5640 1 --2- 172.21.15.162:0/1452135491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e941012e0 0x7f0e941016e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:23.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.779+0000 7f0e996e5640 1 -- 172.21.15.162:0/1452135491 >> 172.21.15.162:0/1452135491 conn(0x7f0e940fcbd0 msgr2=0x7f0e940feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:23.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.779+0000 7f0e996e5640 1 -- 172.21.15.162:0/1452135491 shutdown_connections 2024-09-21T13:34:23.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.779+0000 7f0e996e5640 1 -- 172.21.15.162:0/1452135491 wait complete. 2024-09-21T13:34:23.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.780+0000 7f0e996e5640 1 Processor -- start 2024-09-21T13:34:23.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.780+0000 7f0e996e5640 1 -- start start 2024-09-21T13:34:23.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.780+0000 7f0e996e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e941012e0 0x7f0e94197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.780+0000 7f0e996e5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e941069f0 con 0x7f0e941012e0 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.781+0000 7f0e92ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e941012e0 0x7f0e94197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.781+0000 7f0e92ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e941012e0 0x7f0e94197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.162:50176/0 (socket says 172.21.15.162:50176) 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.781+0000 7f0e92ffd640 1 -- 172.21.15.162:0/2207171481 learned_addr learned my addr 172.21.15.162:0/2207171481 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.781+0000 7f0e92ffd640 1 -- 172.21.15.162:0/2207171481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e941978c0 con 0x7f0e941012e0 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.781+0000 7f0e92ffd640 1 --2- 172.21.15.162:0/2207171481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e941012e0 0x7f0e94197360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e840057c0 tx=0x7f0e840048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.781+0000 7f0e7bfff640 1 -- 172.21.15.162:0/2207171481 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e8403f070 con 0x7f0e941012e0 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.781+0000 7f0e7bfff640 1 -- 172.21.15.162:0/2207171481 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f0e84003ba0 con 0x7f0e941012e0 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.782+0000 7f0e7bfff640 1 -- 172.21.15.162:0/2207171481 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e84035030 con 0x7f0e941012e0 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.782+0000 7f0e996e5640 1 -- 172.21.15.162:0/2207171481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e94197b50 con 0x7f0e941012e0 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.782+0000 7f0e996e5640 1 -- 172.21.15.162:0/2207171481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e94198510 con 0x7f0e941012e0 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.782+0000 7f0e7bfff640 1 -- 172.21.15.162:0/2207171481 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7f0e84042070 con 0x7f0e941012e0 2024-09-21T13:34:23.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.782+0000 7f0e996e5640 1 -- 172.21.15.162:0/2207171481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e94107170 con 0x7f0e941012e0 2024-09-21T13:34:23.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.783+0000 7f0e7bfff640 1 --2- 172.21.15.162:0/2207171481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0e7c03f8a0 0x7f0e7c041d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:23.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.783+0000 7f0e7bfff640 1 -- 172.21.15.162:0/2207171481 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f0e84074e90 con 0x7f0e941012e0 2024-09-21T13:34:23.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.783+0000 7f0e927fc640 1 --2- 172.21.15.162:0/2207171481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0e7c03f8a0 0x7f0e7c041d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:23.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.783+0000 7f0e927fc640 1 --2- 172.21.15.162:0/2207171481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0e7c03f8a0 0x7f0e7c041d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0e880098c0 tx=0x7f0e88006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:23.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.788+0000 7f0e7bfff640 1 -- 172.21.15.162:0/2207171481 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e8403b460 con 0x7f0e941012e0 2024-09-21T13:34:23.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.977+0000 7f0e996e5640 1 -- 172.21.15.162:0/2207171481 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi002:[v2:172.21.15.2:3301,v1:172.21.15.2:6790]=c;smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}) -- 0x7f0e9406adf0 con 0x7f0e7c03f8a0 2024-09-21T13:34:23.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.983+0000 7f0e7bfff640 1 -- 172.21.15.162:0/2207171481 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0e9406adf0 con 0x7f0e7c03f8a0 2024-09-21T13:34:23.984 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mon update... 2024-09-21T13:34:23.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.984+0000 7f0e996e5640 1 -- 172.21.15.162:0/2207171481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0e7c03f8a0 msgr2=0x7f0e7c041d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:23.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.985+0000 7f0e996e5640 1 --2- 172.21.15.162:0/2207171481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0e7c03f8a0 0x7f0e7c041d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0e880098c0 tx=0x7f0e88006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:23.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.985+0000 7f0e996e5640 1 -- 172.21.15.162:0/2207171481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e941012e0 msgr2=0x7f0e94197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:23.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.985+0000 7f0e996e5640 1 --2- 172.21.15.162:0/2207171481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e941012e0 0x7f0e94197360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e840057c0 tx=0x7f0e840048f0 comp rx=0 tx=0).stop 2024-09-21T13:34:23.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.985+0000 7f0e996e5640 1 -- 172.21.15.162:0/2207171481 shutdown_connections 2024-09-21T13:34:23.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.985+0000 7f0e996e5640 1 --2- 172.21.15.162:0/2207171481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0e7c03f8a0 0x7f0e7c041d60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:23.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.985+0000 7f0e996e5640 1 --2- 172.21.15.162:0/2207171481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e941012e0 0x7f0e94197360 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:23.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.985+0000 7f0e996e5640 1 -- 172.21.15.162:0/2207171481 >> 172.21.15.162:0/2207171481 conn(0x7f0e940fcbd0 msgr2=0x7f0e9406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:23.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.985+0000 7f0e996e5640 1 -- 172.21.15.162:0/2207171481 shutdown_connections 2024-09-21T13:34:23.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:23.985+0000 7f0e996e5640 1 -- 172.21.15.162:0/2207171481 wait complete. 2024-09-21T13:34:24.585 DEBUG:teuthology.orchestra.run.smithi002:mon.c> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.c.service 2024-09-21T13:34:24.588 DEBUG:teuthology.orchestra.run.smithi162:mon.b> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.b.service 2024-09-21T13:34:24.590 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T13:34:24.590 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T13:34:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T13:34:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:26.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:25 smithi002 ceph-mon[30076]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi002:[v2:172.21.15.2:3301,v1:172.21.15.2:6790]=c;smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:26.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:25 smithi002 ceph-mon[30076]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi002:[v2:172.21.15.2:3301,v1:172.21.15.2:6790]=c;smithi162:172.21.15.162=b;count:3 2024-09-21T13:34:26.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:25 smithi002 ceph-mon[30076]: Deploying daemon mon.b on smithi162 2024-09-21T13:34:26.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:25 smithi002 ceph-mon[30076]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:26.601 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:34:27.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.217+0000 7f419bd30640 1 -- 172.21.15.162:0/3175139352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4194102780 msgr2=0x7f4194102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:27.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.217+0000 7f419bd30640 1 --2- 172.21.15.162:0/3175139352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4194102780 0x7f4194102b60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4190009880 tx=0x7f419002a5d0 comp rx=0 tx=0).stop 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.217+0000 7f419bd30640 1 -- 172.21.15.162:0/3175139352 shutdown_connections 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.217+0000 7f419bd30640 1 --2- 172.21.15.162:0/3175139352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4194102780 0x7f4194102b60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.217+0000 7f419bd30640 1 -- 172.21.15.162:0/3175139352 >> 172.21.15.162:0/3175139352 conn(0x7f41940fe1d0 msgr2=0x7f41941005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.217+0000 7f419bd30640 1 -- 172.21.15.162:0/3175139352 shutdown_connections 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.217+0000 7f419bd30640 1 -- 172.21.15.162:0/3175139352 wait complete. 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.218+0000 7f419bd30640 1 Processor -- start 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.218+0000 7f419bd30640 1 -- start start 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.218+0000 7f419bd30640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4194102780 0x7f41940754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.218+0000 7f419bd30640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f419410c0e0 con 0x7f4194102780 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.218+0000 7f4199acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4194102780 0x7f41940754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.218+0000 7f4199acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4194102780 0x7f41940754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.162:50198/0 (socket says 172.21.15.162:50198) 2024-09-21T13:34:27.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.218+0000 7f4199acc640 1 -- 172.21.15.162:0/3277136920 learned_addr learned my addr 172.21.15.162:0/3277136920 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:34:27.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.219+0000 7f4199acc640 1 -- 172.21.15.162:0/3277136920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4194077240 con 0x7f4194102780 2024-09-21T13:34:27.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.219+0000 7f4199acc640 1 --2- 172.21.15.162:0/3277136920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4194102780 0x7f41940754a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4190005ab0 tx=0x7f41900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:27.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.219+0000 7f418affd640 1 -- 172.21.15.162:0/3277136920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f419003f070 con 0x7f4194102780 2024-09-21T13:34:27.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.219+0000 7f419bd30640 1 -- 172.21.15.162:0/3277136920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41940759e0 con 0x7f4194102780 2024-09-21T13:34:27.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.219+0000 7f418affd640 1 -- 172.21.15.162:0/3277136920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f4190003a70 con 0x7f4194102780 2024-09-21T13:34:27.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.219+0000 7f418affd640 1 -- 172.21.15.162:0/3277136920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4190035030 con 0x7f4194102780 2024-09-21T13:34:27.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.219+0000 7f419bd30640 1 -- 172.21.15.162:0/3277136920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4194075f60 con 0x7f4194102780 2024-09-21T13:34:27.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.220+0000 7f419bd30640 1 -- 172.21.15.162:0/3277136920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4194103a30 con 0x7f4194102780 2024-09-21T13:34:27.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.220+0000 7f418affd640 1 -- 172.21.15.162:0/3277136920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7f4190042070 con 0x7f4194102780 2024-09-21T13:34:27.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.220+0000 7f418affd640 1 --2- 172.21.15.162:0/3277136920 >> v2:172.21.15.2:6800/3897423974 conn(0x7f418003f8a0 0x7f4180041d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:27.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.220+0000 7f418affd640 1 -- 172.21.15.162:0/3277136920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f4190074d50 con 0x7f4194102780 2024-09-21T13:34:27.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.221+0000 7f41992cb640 1 --2- 172.21.15.162:0/3277136920 >> v2:172.21.15.2:6800/3897423974 conn(0x7f418003f8a0 0x7f4180041d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:27.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.221+0000 7f41992cb640 1 --2- 172.21.15.162:0/3277136920 >> v2:172.21.15.2:6800/3897423974 conn(0x7f418003f8a0 0x7f4180041d60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f41840098c0 tx=0x7f4184006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:27.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.225+0000 7f418affd640 1 -- 172.21.15.162:0/3277136920 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f419004a260 con 0x7f4194102780 2024-09-21T13:34:27.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.496+0000 7f419bd30640 1 -- 172.21.15.162:0/3277136920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f41940767a0 con 0x7f4194102780 2024-09-21T13:34:27.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.497+0000 7f418affd640 1 -- 172.21.15.162:0/3277136920 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f41900035f0 con 0x7f4194102780 2024-09-21T13:34:27.498 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:34:27.499 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":1,"fsid":"e6144070-781d-11ef-baf6-efdc52797490","modified":"2024-09-21T13:33:04.349460Z","created":"2024-09-21T13:33:04.349460Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T13:34:27.499 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 1 2024-09-21T13:34:27.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.500+0000 7f419bd30640 1 -- 172.21.15.162:0/3277136920 >> v2:172.21.15.2:6800/3897423974 conn(0x7f418003f8a0 msgr2=0x7f4180041d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:27.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.500+0000 7f419bd30640 1 --2- 172.21.15.162:0/3277136920 >> v2:172.21.15.2:6800/3897423974 conn(0x7f418003f8a0 0x7f4180041d60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f41840098c0 tx=0x7f4184006db0 comp rx=0 tx=0).stop 2024-09-21T13:34:27.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.500+0000 7f419bd30640 1 -- 172.21.15.162:0/3277136920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4194102780 msgr2=0x7f41940754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:27.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.500+0000 7f419bd30640 1 --2- 172.21.15.162:0/3277136920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4194102780 0x7f41940754a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4190005ab0 tx=0x7f41900048f0 comp rx=0 tx=0).stop 2024-09-21T13:34:27.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.500+0000 7f419bd30640 1 -- 172.21.15.162:0/3277136920 shutdown_connections 2024-09-21T13:34:27.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.500+0000 7f419bd30640 1 --2- 172.21.15.162:0/3277136920 >> v2:172.21.15.2:6800/3897423974 conn(0x7f418003f8a0 0x7f4180041d60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:27.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.500+0000 7f419bd30640 1 --2- 172.21.15.162:0/3277136920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4194102780 0x7f41940754a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:27.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.500+0000 7f419bd30640 1 -- 172.21.15.162:0/3277136920 >> 172.21.15.162:0/3277136920 conn(0x7f41940fe1d0 msgr2=0x7f41940ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:27.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.500+0000 7f419bd30640 1 -- 172.21.15.162:0/3277136920 shutdown_connections 2024-09-21T13:34:27.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:27.500+0000 7f419bd30640 1 -- 172.21.15.162:0/3277136920 wait complete. 2024-09-21T13:34:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:27 smithi002 ceph-mon[30076]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:28.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/3277136920' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T13:34:28.638 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T13:34:28.638 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout: e1 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout: btime 2024-09-21T13:33:08:087660+0000 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout: legacy client fscid: -1 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout: No filesystems configured 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T13:34:28.639 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T13:34:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T13:34:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/95869746' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/95869746' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi002:[v2:172.21.15.2:3301,v1:172.21.15.2:6790]=c;smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:28.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi002:[v2:172.21.15.2:3301,v1:172.21.15.2:6790]=c;smithi162:172.21.15.162=b;count:3 2024-09-21T13:34:28.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: Deploying daemon mon.b on smithi162 2024-09-21T13:34:28.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:28.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:28.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/3277136920' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T13:34:28.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 ceph-mon[33046]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T13:34:28.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 bash[33008]: c5985f32b311f04e4a33bf8681b8c101ff6579f50d8112826e8666818df6c728 2024-09-21T13:34:28.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:28 smithi162 systemd[1]: Started Ceph mon.b for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:34:29.118 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T13:34:29.118 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T13:34:29.384 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: mon.a calling monitor election 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: mon.b calling monitor election 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:33.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: monmap epoch 2 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: last_changed 2024-09-21T13:34:28.643056+0000 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: created 2024-09-21T13:33:04.349460+0000 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: min_mon_release 19 (squid) 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: election_strategy: 1 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: fsmap 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: mgrmap e13: y(active, since 35s) 2024-09-21T13:34:33.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: overall HEALTH_OK 2024-09-21T13:34:33.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:33.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:33.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:33.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:33.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:33 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:34.074 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:34.074 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:34.074 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: mon.a calling monitor election 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: mon.b calling monitor election 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: monmap epoch 2 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:34.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: last_changed 2024-09-21T13:34:28.643056+0000 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: created 2024-09-21T13:33:04.349460+0000 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: min_mon_release 19 (squid) 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: election_strategy: 1 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: fsmap 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: mgrmap e13: y(active, since 35s) 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: overall HEALTH_OK 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:34.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:33 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:34.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.212+0000 7fa738ef8640 1 -- 172.21.15.162:0/744124081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa71c003530 msgr2=0x7fa71c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:34.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.212+0000 7fa738ef8640 1 --2- 172.21.15.162:0/744124081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa71c003530 0x7fa71c0059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa734102640 tx=0x7fa72402c490 comp rx=0 tx=0).stop 2024-09-21T13:34:34.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.213+0000 7fa738ef8640 1 -- 172.21.15.162:0/744124081 shutdown_connections 2024-09-21T13:34:34.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.213+0000 7fa738ef8640 1 --2- 172.21.15.162:0/744124081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa71c003530 0x7fa71c0059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:34.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.213+0000 7fa738ef8640 1 -- 172.21.15.162:0/744124081 >> 172.21.15.162:0/744124081 conn(0x7fa7340fe340 msgr2=0x7fa734100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:34.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.213+0000 7fa738ef8640 1 -- 172.21.15.162:0/744124081 shutdown_connections 2024-09-21T13:34:34.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.213+0000 7fa738ef8640 1 -- 172.21.15.162:0/744124081 wait complete. 2024-09-21T13:34:34.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.214+0000 7fa738ef8640 1 Processor -- start 2024-09-21T13:34:34.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.214+0000 7fa738ef8640 1 -- start start 2024-09-21T13:34:34.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.214+0000 7fa738ef8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c003530 0x7fa734076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:34.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.214+0000 7fa738ef8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7340754a0 0x7fa7340758e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:34.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.214+0000 7fa738ef8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa734109d00 con 0x7fa7340754a0 2024-09-21T13:34:34.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.214+0000 7fa738ef8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa734109b80 con 0x7fa71c003530 2024-09-21T13:34:34.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.214+0000 7fa73259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c003530 0x7fa734076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:34.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.214+0000 7fa73259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c003530 0x7fa734076f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42584/0 (socket says 172.21.15.162:42584) 2024-09-21T13:34:34.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.214+0000 7fa73259c640 1 -- 172.21.15.162:0/1428998883 learned_addr learned my addr 172.21.15.162:0/1428998883 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:34:34.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.214+0000 7fa731d9b640 1 --2- 172.21.15.162:0/1428998883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7340754a0 0x7fa7340758e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:34.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa73259c640 1 -- 172.21.15.162:0/1428998883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c003530 msgr2=0x7fa734076f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-21T13:34:34.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa73259c640 1 -- 172.21.15.162:0/1428998883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c003530 msgr2=0x7fa734076f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T13:34:34.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa73259c640 1 --2- 172.21.15.162:0/1428998883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c003530 0x7fa734076f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T13:34:34.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa73259c640 1 --2- 172.21.15.162:0/1428998883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c003530 0x7fa734076f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:34:34.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa731d9b640 1 -- 172.21.15.162:0/1428998883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c003530 msgr2=0x7fa734076f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:34:34.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa731d9b640 1 --2- 172.21.15.162:0/1428998883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c003530 0x7fa734076f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:34.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa731d9b640 1 -- 172.21.15.162:0/1428998883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa734075e20 con 0x7fa7340754a0 2024-09-21T13:34:34.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa731d9b640 1 --2- 172.21.15.162:0/1428998883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7340754a0 0x7fa7340758e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa72800b400 tx=0x7fa72800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:34.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa7237fe640 1 -- 172.21.15.162:0/1428998883 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa728011630 con 0x7fa7340754a0 2024-09-21T13:34:34.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa7237fe640 1 -- 172.21.15.162:0/1428998883 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fa728011c50 con 0x7fa7340754a0 2024-09-21T13:34:34.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa7237fe640 1 -- 172.21.15.162:0/1428998883 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa728010bb0 con 0x7fa7340754a0 2024-09-21T13:34:34.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.215+0000 7fa738ef8640 1 -- 172.21.15.162:0/1428998883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa734076110 con 0x7fa7340754a0 2024-09-21T13:34:34.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.216+0000 7fa738ef8640 1 -- 172.21.15.162:0/1428998883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7341a8490 con 0x7fa7340754a0 2024-09-21T13:34:34.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.217+0000 7fa7237fe640 1 -- 172.21.15.162:0/1428998883 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7fa728018020 con 0x7fa7340754a0 2024-09-21T13:34:34.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.217+0000 7fa738ef8640 1 -- 172.21.15.162:0/1428998883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa734103b80 con 0x7fa7340754a0 2024-09-21T13:34:34.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.217+0000 7fa7237fe640 1 --2- 172.21.15.162:0/1428998883 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa71403f690 0x7fa714041b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:34.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.217+0000 7fa7237fe640 1 -- 172.21.15.162:0/1428998883 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fa728053b90 con 0x7fa7340754a0 2024-09-21T13:34:34.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.217+0000 7fa73259c640 1 --2- 172.21.15.162:0/1428998883 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa71403f690 0x7fa714041b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:34.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.218+0000 7fa73259c640 1 --2- 172.21.15.162:0/1428998883 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa71403f690 0x7fa714041b50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa724012c10 tx=0x7fa7240323a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:34.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.222+0000 7fa7237fe640 1 -- 172.21.15.162:0/1428998883 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa72801f020 con 0x7fa7340754a0 2024-09-21T13:34:34.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.475+0000 7fa738ef8640 1 -- 172.21.15.162:0/1428998883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa734076830 con 0x7fa7340754a0 2024-09-21T13:34:34.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.475+0000 7fa7237fe640 1 -- 172.21.15.162:0/1428998883 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7fa734076830 con 0x7fa7340754a0 2024-09-21T13:34:34.476 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:34:34.477 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"e6144070-781d-11ef-baf6-efdc52797490","modified":"2024-09-21T13:34:28.643056Z","created":"2024-09-21T13:33:04.349460Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T13:34:34.477 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-21T13:34:34.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.477+0000 7fa738ef8640 1 -- 172.21.15.162:0/1428998883 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa71403f690 msgr2=0x7fa714041b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:34.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.477+0000 7fa738ef8640 1 --2- 172.21.15.162:0/1428998883 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa71403f690 0x7fa714041b50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa724012c10 tx=0x7fa7240323a0 comp rx=0 tx=0).stop 2024-09-21T13:34:34.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.477+0000 7fa738ef8640 1 -- 172.21.15.162:0/1428998883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7340754a0 msgr2=0x7fa7340758e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:34.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.477+0000 7fa738ef8640 1 --2- 172.21.15.162:0/1428998883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7340754a0 0x7fa7340758e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa72800b400 tx=0x7fa72800b8c0 comp rx=0 tx=0).stop 2024-09-21T13:34:34.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.477+0000 7fa738ef8640 1 -- 172.21.15.162:0/1428998883 shutdown_connections 2024-09-21T13:34:34.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.477+0000 7fa738ef8640 1 --2- 172.21.15.162:0/1428998883 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa71403f690 0x7fa714041b50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:34.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.477+0000 7fa738ef8640 1 --2- 172.21.15.162:0/1428998883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7340754a0 0x7fa7340758e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:34.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.477+0000 7fa738ef8640 1 --2- 172.21.15.162:0/1428998883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c003530 0x7fa734076f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:34.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.477+0000 7fa738ef8640 1 -- 172.21.15.162:0/1428998883 >> 172.21.15.162:0/1428998883 conn(0x7fa7340fe340 msgr2=0x7fa734104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:34.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.478+0000 7fa738ef8640 1 -- 172.21.15.162:0/1428998883 shutdown_connections 2024-09-21T13:34:34.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:34.478+0000 7fa738ef8640 1 -- 172.21.15.162:0/1428998883 wait complete. 2024-09-21T13:34:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:34 smithi162 ceph-mon[33046]: Deploying daemon mon.c on smithi002 2024-09-21T13:34:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/1428998883' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T13:34:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:34 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:34 smithi002 ceph-mon[30076]: Deploying daemon mon.c on smithi002 2024-09-21T13:34:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/1428998883' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T13:34:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:34 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:35.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:35 smithi002 ceph-mon[30076]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:35.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:34:35 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: 2024-09-21T13:34:35.643+0000 7f99e4d78640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T13:34:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:35 smithi162 ceph-mon[33046]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:36.068 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T13:34:36.069 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T13:34:36.320 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:34:36.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.837+0000 7f4318092640 1 -- 172.21.15.162:0/2466704931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4310101970 msgr2=0x7f4310101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:36.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.837+0000 7f4318092640 1 --2- 172.21.15.162:0/2466704931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4310101970 0x7f4310101d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f430c009880 tx=0x7f430c02a5d0 comp rx=0 tx=0).stop 2024-09-21T13:34:36.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.837+0000 7f4318092640 1 -- 172.21.15.162:0/2466704931 shutdown_connections 2024-09-21T13:34:36.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.837+0000 7f4318092640 1 --2- 172.21.15.162:0/2466704931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4310101970 0x7f4310101d50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:36.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.837+0000 7f4318092640 1 -- 172.21.15.162:0/2466704931 >> 172.21.15.162:0/2466704931 conn(0x7f4310077170 msgr2=0x7f4310077580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:36.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.837+0000 7f4318092640 1 -- 172.21.15.162:0/2466704931 shutdown_connections 2024-09-21T13:34:36.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.837+0000 7f4318092640 1 -- 172.21.15.162:0/2466704931 wait complete. 2024-09-21T13:34:36.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4318092640 1 Processor -- start 2024-09-21T13:34:36.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4318092640 1 -- start start 2024-09-21T13:34:36.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4318092640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4310101970 0x7f4310196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:36.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4318092640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4310196d40 0x7f431019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4318092640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f431010b120 con 0x7f4310196d40 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4318092640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f431010afa0 con 0x7f4310101970 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4315e2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4310101970 0x7f4310196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f431562d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4310196d40 0x7f431019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4315e2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4310101970 0x7f4310196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42598/0 (socket says 172.21.15.162:42598) 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f431562d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4310196d40 0x7f431019c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.162:55516/0 (socket says 172.21.15.162:55516) 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4315e2e640 1 -- 172.21.15.162:0/1306393633 learned_addr learned my addr 172.21.15.162:0/1306393633 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4315e2e640 1 -- 172.21.15.162:0/1306393633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4310101970 msgr2=0x7f4310196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4315e2e640 1 -- 172.21.15.162:0/1306393633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4310101970 msgr2=0x7f4310196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4315e2e640 1 --2- 172.21.15.162:0/1306393633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4310101970 0x7f4310196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f4315e2e640 1 --2- 172.21.15.162:0/1306393633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4310101970 0x7f4310196800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:34:36.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f431562d640 1 -- 172.21.15.162:0/1306393633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4310101970 msgr2=0x7f4310196800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f431562d640 1 --2- 172.21.15.162:0/1306393633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4310101970 0x7f4310196800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.838+0000 7f431562d640 1 -- 172.21.15.162:0/1306393633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43101973c0 con 0x7f4310196d40 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.839+0000 7f431562d640 1 --2- 172.21.15.162:0/1306393633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4310196d40 0x7f431019c0e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f430400b3d0 tx=0x7f430400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.839+0000 7f4302ffd640 1 -- 172.21.15.162:0/1306393633 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4304011630 con 0x7f4310196d40 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.839+0000 7f4318092640 1 -- 172.21.15.162:0/1306393633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f431019c680 con 0x7f4310196d40 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.839+0000 7f4302ffd640 1 -- 172.21.15.162:0/1306393633 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f4304011c50 con 0x7f4310196d40 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.839+0000 7f4302ffd640 1 -- 172.21.15.162:0/1306393633 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4304010c20 con 0x7f4310196d40 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.839+0000 7f4318092640 1 -- 172.21.15.162:0/1306393633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f431019cc40 con 0x7f4310196d40 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.840+0000 7f4318092640 1 -- 172.21.15.162:0/1306393633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4310102a90 con 0x7f4310196d40 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.840+0000 7f4302ffd640 1 -- 172.21.15.162:0/1306393633 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7f4304018020 con 0x7f4310196d40 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.840+0000 7f4302ffd640 1 --2- 172.21.15.162:0/1306393633 >> v2:172.21.15.2:6800/3897423974 conn(0x7f42fc03f650 0x7f42fc041b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.840+0000 7f4302ffd640 1 -- 172.21.15.162:0/1306393633 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f4304053c90 con 0x7f4310196d40 2024-09-21T13:34:36.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.840+0000 7f4315e2e640 1 --2- 172.21.15.162:0/1306393633 >> v2:172.21.15.2:6800/3897423974 conn(0x7f42fc03f650 0x7f42fc041b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:36.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.841+0000 7f4315e2e640 1 --2- 172.21.15.162:0/1306393633 >> v2:172.21.15.2:6800/3897423974 conn(0x7f42fc03f650 0x7f42fc041b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f430c005ab0 tx=0x7f430c005a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:36.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:36.846+0000 7f4302ffd640 1 -- 172.21.15.162:0/1306393633 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f430401f020 con 0x7f4310196d40 2024-09-21T13:34:37.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.089+0000 7f4318092640 1 -- 172.21.15.162:0/1306393633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4310101dd0 con 0x7f4310196d40 2024-09-21T13:34:37.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.090+0000 7f4302ffd640 1 -- 172.21.15.162:0/1306393633 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f4304014170 con 0x7f4310196d40 2024-09-21T13:34:37.092 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:34:37.092 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"e6144070-781d-11ef-baf6-efdc52797490","modified":"2024-09-21T13:34:28.643056Z","created":"2024-09-21T13:33:04.349460Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T13:34:37.093 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-21T13:34:37.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.093+0000 7f4318092640 1 -- 172.21.15.162:0/1306393633 >> v2:172.21.15.2:6800/3897423974 conn(0x7f42fc03f650 msgr2=0x7f42fc041b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:37.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.093+0000 7f4318092640 1 --2- 172.21.15.162:0/1306393633 >> v2:172.21.15.2:6800/3897423974 conn(0x7f42fc03f650 0x7f42fc041b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f430c005ab0 tx=0x7f430c005a40 comp rx=0 tx=0).stop 2024-09-21T13:34:37.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.093+0000 7f4318092640 1 -- 172.21.15.162:0/1306393633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4310196d40 msgr2=0x7f431019c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:37.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.093+0000 7f4318092640 1 --2- 172.21.15.162:0/1306393633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4310196d40 0x7f431019c0e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f430400b3d0 tx=0x7f430400b890 comp rx=0 tx=0).stop 2024-09-21T13:34:37.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.093+0000 7f4318092640 1 -- 172.21.15.162:0/1306393633 shutdown_connections 2024-09-21T13:34:37.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.093+0000 7f4318092640 1 --2- 172.21.15.162:0/1306393633 >> v2:172.21.15.2:6800/3897423974 conn(0x7f42fc03f650 0x7f42fc041b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:37.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.093+0000 7f4318092640 1 --2- 172.21.15.162:0/1306393633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4310196d40 0x7f431019c0e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:37.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.093+0000 7f4318092640 1 --2- 172.21.15.162:0/1306393633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4310101970 0x7f4310196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:37.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.093+0000 7f4318092640 1 -- 172.21.15.162:0/1306393633 >> 172.21.15.162:0/1306393633 conn(0x7f4310077170 msgr2=0x7f43101078d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:37.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.093+0000 7f4318092640 1 -- 172.21.15.162:0/1306393633 shutdown_connections 2024-09-21T13:34:37.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:37.093+0000 7f4318092640 1 -- 172.21.15.162:0/1306393633 wait complete. 2024-09-21T13:34:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 podman[40585]: 2024-09-21 13:34:36.94577221 +0000 UTC m=+0.016176550 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:34:37.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 podman[40585]: 2024-09-21 13:34:37.276173837 +0000 UTC m=+0.346578188 container init cda42718abf5511e3d45d5a5b40e8bfec0b359a5096b1f0cefe0b297c8784735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 podman[40585]: 2024-09-21 13:34:37.280916436 +0000 UTC m=+0.351320777 container start cda42718abf5511e3d45d5a5b40e8bfec0b359a5096b1f0cefe0b297c8784735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-c, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev), process ceph-mon, pid 7 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: pidfile_write: ignore empty --pid-file 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: load: jerasure load: lrc 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: RocksDB version: 7.9.2 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Git sha 0 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Compile date 2024-09-21 09:24:23 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: DB SUMMARY 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: DB Session ID: WN0TM9S25ZD8ZQIBM672 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: CURRENT file: CURRENT 2024-09-21T13:34:37.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 636 ; 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.error_if_exists: 0 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.create_if_missing: 0 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.paranoid_checks: 1 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.env: 0x55624a51b120 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.info_log: 0x55624cc45700 2024-09-21T13:34:37.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T13:34:37.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.statistics: (nil) 2024-09-21T13:34:37.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.use_fsync: 0 2024-09-21T13:34:37.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_log_file_size: 0 2024-09-21T13:34:37.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T13:34:37.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T13:34:37.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T13:34:37.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T13:34:37.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.allow_fallocate: 1 2024-09-21T13:34:37.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.use_direct_reads: 0 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.db_log_dir: 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.wal_dir: 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T13:34:37.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.write_buffer_manager: 0x55624cc49b80 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.unordered_write: 0 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T13:34:37.606 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.row_cache: None 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.wal_filter: None 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.two_write_queues: 0 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.wal_compression: 0 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.atomic_flush: 0 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.log_readahead_size: 0 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T13:34:37.607 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_background_jobs: 2 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_background_compactions: -1 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_subcompactions: 1 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T13:34:37.608 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_open_files: -1 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_background_flushes: -1 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Compression algorithms supported: 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: kZSTD supported: 0 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: kXpressCompression supported: 0 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: kBZip2Compression supported: 0 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: kLZ4Compression supported: 1 2024-09-21T13:34:37.609 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: kZlibCompression supported: 1 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: kSnappyCompression supported: 1 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.merge_operator: 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_filter: None 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T13:34:37.610 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55624cc45320) 2024-09-21T13:34:37.611 INFO:journalctl@ceph.mon.c.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-09-21T13:34:37.611 INFO:journalctl@ceph.mon.c.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T13:34:37.611 INFO:journalctl@ceph.mon.c.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T13:34:37.611 INFO:journalctl@ceph.mon.c.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-09-21T13:34:37.611 INFO:journalctl@ceph.mon.c.smithi002.stdout: index_type: 0 2024-09-21T13:34:37.611 INFO:journalctl@ceph.mon.c.smithi002.stdout: data_block_index_type: 0 2024-09-21T13:34:37.611 INFO:journalctl@ceph.mon.c.smithi002.stdout: index_shortening: 1 2024-09-21T13:34:37.611 INFO:journalctl@ceph.mon.c.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T13:34:37.611 INFO:journalctl@ceph.mon.c.smithi002.stdout: checksum: 4 2024-09-21T13:34:37.612 INFO:journalctl@ceph.mon.c.smithi002.stdout: no_block_cache: 0 2024-09-21T13:34:37.612 INFO:journalctl@ceph.mon.c.smithi002.stdout: block_cache: 0x55624cc39610 2024-09-21T13:34:37.612 INFO:journalctl@ceph.mon.c.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-09-21T13:34:37.612 INFO:journalctl@ceph.mon.c.smithi002.stdout: block_cache_options: 2024-09-21T13:34:37.612 INFO:journalctl@ceph.mon.c.smithi002.stdout: capacity : 536870912 2024-09-21T13:34:37.612 INFO:journalctl@ceph.mon.c.smithi002.stdout: num_shard_bits : 4 2024-09-21T13:34:37.612 INFO:journalctl@ceph.mon.c.smithi002.stdout: strict_capacity_limit : 0 2024-09-21T13:34:37.612 INFO:journalctl@ceph.mon.c.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-09-21T13:34:37.612 INFO:journalctl@ceph.mon.c.smithi002.stdout: block_cache_compressed: (nil) 2024-09-21T13:34:37.612 INFO:journalctl@ceph.mon.c.smithi002.stdout: persistent_cache: (nil) 2024-09-21T13:34:37.612 INFO:journalctl@ceph.mon.c.smithi002.stdout: block_size: 4096 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: block_size_deviation: 10 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: block_restart_interval: 16 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: index_block_restart_interval: 1 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: metadata_block_size: 4096 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: partition_filters: 0 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: use_delta_encoding: 1 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: filter_policy: bloomfilter 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: whole_key_filtering: 1 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: verify_compression: 0 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: format_version: 5 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: enable_index_compression: 1 2024-09-21T13:34:37.613 INFO:journalctl@ceph.mon.c.smithi002.stdout: block_align: 0 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout: max_auto_readahead_size: 262144 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout: prepopulate_block_cache: 0 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout: initial_auto_readahead_size: 8192 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compression: NoCompression 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.num_levels: 7 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T13:34:37.614 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T13:34:37.615 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T13:34:37.616 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T13:34:37.617 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.inplace_update_support: 0 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T13:34:37.618 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.bloom_locality: 0 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.max_successive_merges: 0 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.ttl: 2592000 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.enable_blob_files: false 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.min_blob_size: 0 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T13:34:37.619 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 058ce1bf-3027-40d0-935b-8ed7213aa3c0 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726925677308979, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726925677309361, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726925677, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "058ce1bf-3027-40d0-935b-8ed7213aa3c0", "db_session_id": "WN0TM9S25ZD8ZQIBM672", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726925677309463, "job": 1, "event": "recovery_finished"} 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55624cc68e00 2024-09-21T13:34:37.620 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: DB pointer 0x55624cd6a000 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: ** DB Stats ** 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T13:34:37.621 INFO:journalctl@ceph.mon.c.smithi002.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T13:34:37.622 INFO:journalctl@ceph.mon.c.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout: Block cache BinnedLRUCache@0x55624cc39610#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout: 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: using public_addrv [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: starting mon.c rank -1 at public addrs [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] at bind addrs [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:37.623 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(???) e0 preinit fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout: e1 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout: btime 2024-09-21T13:33:08:087660+0000 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout: legacy client fscid: -1 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout: 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout: No filesystems configured 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T13:34:37.624 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/95869746' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/95869746' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.625 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:37.626 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi002:[v2:172.21.15.2:3301,v1:172.21.15.2:6790]=c;smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi002:[v2:172.21.15.2:3301,v1:172.21.15.2:6790]=c;smithi162:172.21.15.162=b;count:3 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: Deploying daemon mon.b on smithi162 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/3277136920' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:34:37.627 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.a calling monitor election 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.b calling monitor election 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: monmap epoch 2 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: last_changed 2024-09-21T13:34:28.643056+0000 2024-09-21T13:34:37.628 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: created 2024-09-21T13:33:04.349460+0000 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: min_mon_release 19 (squid) 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: election_strategy: 1 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: fsmap 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mgrmap e13: y(active, since 35s) 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: overall HEALTH_OK 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:37.629 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: Deploying daemon mon.c on smithi002 2024-09-21T13:34:37.630 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/1428998883' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T13:34:37.630 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:37.630 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:37.630 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 ceph-mon[40622]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T13:34:37.630 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 bash[40585]: cda42718abf5511e3d45d5a5b40e8bfec0b359a5096b1f0cefe0b297c8784735 2024-09-21T13:34:37.630 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:37 smithi002 systemd[1]: Started Ceph mon.c for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:34:38.631 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T13:34:38.632 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T13:34:38.884 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:34:42.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.501+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/851182159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a94003530 msgr2=0x7f4a940059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:42.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.501+0000 7f4ab0f0b640 1 --2- 172.21.15.162:0/851182159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a94003530 0x7f4a940059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4aac102620 tx=0x7f4aa002c150 comp rx=0 tx=0).stop 2024-09-21T13:34:42.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.501+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/851182159 shutdown_connections 2024-09-21T13:34:42.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.501+0000 7f4ab0f0b640 1 --2- 172.21.15.162:0/851182159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a94003530 0x7f4a940059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:42.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.501+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/851182159 >> 172.21.15.162:0/851182159 conn(0x7f4aac0fe340 msgr2=0x7f4aac100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:42.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.501+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/851182159 shutdown_connections 2024-09-21T13:34:42.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.501+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/851182159 wait complete. 2024-09-21T13:34:42.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4ab0f0b640 1 Processor -- start 2024-09-21T13:34:42.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4ab0f0b640 1 -- start start 2024-09-21T13:34:42.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4ab0f0b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a94003530 0x7f4aac1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:42.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4ab0f0b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aac197ee0 0x7f4aac19d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:42.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4ab0f0b640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4aac19d7c0 0x7f4aac19dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:42.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4ab0f0b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac109df0 con 0x7f4a94003530 2024-09-21T13:34:42.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4ab0f0b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac109c70 con 0x7f4aac197ee0 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4ab0f0b640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f4aac109f70 con 0x7f4aac19d7c0 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4aa9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aac197ee0 0x7f4aac19d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4aaa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a94003530 0x7f4aac1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4aa9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aac197ee0 0x7f4aac19d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35714/0 (socket says 172.21.15.162:35714) 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4aa9d9b640 1 -- 172.21.15.162:0/1593977653 learned_addr learned my addr 172.21.15.162:0/1593977653 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4aaad9d640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4aac19d7c0 0x7f4aac19dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4aa9d9b640 1 -- 172.21.15.162:0/1593977653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aac197ee0 msgr2=0x7f4aac19d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4aa9d9b640 1 -- 172.21.15.162:0/1593977653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aac197ee0 msgr2=0x7f4aac19d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.503+0000 7f4aa9d9b640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aac197ee0 0x7f4aac19d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4aa9d9b640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aac197ee0 0x7f4aac19d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4aaad9d640 1 -- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4aac19d7c0 msgr2=0x7f4aac19dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4aaad9d640 1 -- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4aac19d7c0 msgr2=0x7f4aac19dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T13:34:42.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4aaad9d640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4aac19d7c0 0x7f4aac19dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4aaad9d640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4aac19d7c0 0x7f4aac19dc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4aaa59c640 1 -- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4aac19d7c0 msgr2=0x7f4aac19dc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4aaa59c640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4aac19d7c0 0x7f4aac19dc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4aaa59c640 1 -- 172.21.15.162:0/1593977653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aac197ee0 msgr2=0x7f4aac19d280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4aaa59c640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aac197ee0 0x7f4aac19d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4aaa59c640 1 -- 172.21.15.162:0/1593977653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac1a4400 con 0x7f4a94003530 2024-09-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4aaa59c640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a94003530 0x7f4aac1979a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0036000 tx=0x7f4aa0004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4a9b7fe640 1 -- 172.21.15.162:0/1593977653 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0032040 con 0x7f4a94003530 2024-09-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4a9b7fe640 1 -- 172.21.15.162:0/1593977653 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f4aa002dc60 con 0x7f4a94003530 2024-09-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/1593977653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac075380 con 0x7f4a94003530 2024-09-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4a9b7fe640 1 -- 172.21.15.162:0/1593977653 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00366d0 con 0x7f4a94003530 2024-09-21T13:34:42.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.504+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/1593977653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac0758c0 con 0x7f4a94003530 2024-09-21T13:34:42.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.505+0000 7f4a9b7fe640 1 -- 172.21.15.162:0/1593977653 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7f4aa0036870 con 0x7f4a94003530 2024-09-21T13:34:42.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.506+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/1593977653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aac103b60 con 0x7f4a94003530 2024-09-21T13:34:42.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.506+0000 7f4a9b7fe640 1 --2- 172.21.15.162:0/1593977653 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4a8c03fd30 0x7f4a8c0421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:42.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.506+0000 7f4a9b7fe640 1 -- 172.21.15.162:0/1593977653 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f4aa0079cd0 con 0x7f4a94003530 2024-09-21T13:34:42.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.506+0000 7f4aa9d9b640 1 --2- 172.21.15.162:0/1593977653 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4a8c03fd30 0x7f4a8c0421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:42.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.506+0000 7f4aa9d9b640 1 --2- 172.21.15.162:0/1593977653 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4a8c03fd30 0x7f4a8c0421f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009100 tx=0x7f4a9c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:42.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.511+0000 7f4a9b7fe640 1 -- 172.21.15.162:0/1593977653 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4aa007f020 con 0x7f4a94003530 2024-09-21T13:34:42.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:34:42.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: mon.a calling monitor election 2024-09-21T13:34:42.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:42.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: mon.b calling monitor election 2024-09-21T13:34:42.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:42.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: mon.c calling monitor election 2024-09-21T13:34:42.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:42.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: monmap epoch 3 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: last_changed 2024-09-21T13:34:37.332444+0000 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: created 2024-09-21T13:33:04.349460+0000 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: min_mon_release 19 (squid) 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: election_strategy: 1 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: 2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: fsmap 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T13:34:42.723 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: mgrmap e13: y(active, since 44s) 2024-09-21T13:34:42.724 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: overall HEALTH_OK 2024-09-21T13:34:42.724 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:42.724 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:42.724 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:42.724 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:42 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:42.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.787+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/1593977653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4aac1913a0 con 0x7f4a94003530 2024-09-21T13:34:42.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.788+0000 7f4a9b7fe640 1 -- 172.21.15.162:0/1593977653 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1273 (secure 0 0 0) 0x7f4aa004d5a0 con 0x7f4a94003530 2024-09-21T13:34:42.789 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:34:42.789 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":3,"fsid":"e6144070-781d-11ef-baf6-efdc52797490","modified":"2024-09-21T13:34:37.332444Z","created":"2024-09-21T13:33:04.349460Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3301","nonce":0},{"type":"v1","addr":"172.21.15.2:6790","nonce":0}]},"addr":"172.21.15.2:6790/0","public_addr":"172.21.15.2:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T13:34:42.789 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 3 2024-09-21T13:34:42.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.790+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/1593977653 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4a8c03fd30 msgr2=0x7f4a8c0421f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:42.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.790+0000 7f4ab0f0b640 1 --2- 172.21.15.162:0/1593977653 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4a8c03fd30 0x7f4a8c0421f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009100 tx=0x7f4a9c008040 comp rx=0 tx=0).stop 2024-09-21T13:34:42.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.790+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a94003530 msgr2=0x7f4aac1979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:42.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.790+0000 7f4ab0f0b640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a94003530 0x7f4aac1979a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0036000 tx=0x7f4aa0004800 comp rx=0 tx=0).stop 2024-09-21T13:34:42.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.790+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/1593977653 shutdown_connections 2024-09-21T13:34:42.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.790+0000 7f4ab0f0b640 1 --2- 172.21.15.162:0/1593977653 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4a8c03fd30 0x7f4a8c0421f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:42.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.790+0000 7f4ab0f0b640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4aac19d7c0 0x7f4aac19dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:42.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.790+0000 7f4ab0f0b640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aac197ee0 0x7f4aac19d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:42.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.790+0000 7f4ab0f0b640 1 --2- 172.21.15.162:0/1593977653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a94003530 0x7f4aac1979a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:42.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.790+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/1593977653 >> 172.21.15.162:0/1593977653 conn(0x7f4aac0fe340 msgr2=0x7f4aac104980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:42.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.791+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/1593977653 shutdown_connections 2024-09-21T13:34:42.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:42.791+0000 7f4ab0f0b640 1 -- 172.21.15.162:0/1593977653 wait complete. 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: mon.a calling monitor election 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: mon.b calling monitor election 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: mon.c calling monitor election 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: monmap epoch 3 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: last_changed 2024-09-21T13:34:37.332444+0000 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: created 2024-09-21T13:33:04.349460+0000 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: min_mon_release 19 (squid) 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: election_strategy: 1 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: 2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: fsmap 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: mgrmap e13: y(active, since 44s) 2024-09-21T13:34:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: overall HEALTH_OK 2024-09-21T13:34:42.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:42.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:42.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:42.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:34:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: mon.a calling monitor election 2024-09-21T13:34:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:34:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: mon.b calling monitor election 2024-09-21T13:34:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: mon.c calling monitor election 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: monmap epoch 3 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: fsid e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: last_changed 2024-09-21T13:34:37.332444+0000 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: created 2024-09-21T13:33:04.349460+0000 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: min_mon_release 19 (squid) 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: election_strategy: 1 2024-09-21T13:34:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-21T13:34:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T13:34:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: 2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-21T13:34:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: fsmap 2024-09-21T13:34:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T13:34:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: mgrmap e13: y(active, since 44s) 2024-09-21T13:34:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: overall HEALTH_OK 2024-09-21T13:34:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:42 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:43.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:43 smithi002 ceph-mon[30076]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:43.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:43 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:43.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/1593977653' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T13:34:43.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:43 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:43.634 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:43 smithi002 ceph-mon[40622]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:43.635 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:43 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:43.635 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/1593977653' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T13:34:43.635 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:43 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:43.720 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:43 smithi162 ceph-mon[33046]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:43.720 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:43 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:43.720 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/1593977653' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T13:34:43.720 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:43 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:34:44.132 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T13:34:44.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T13:34:44.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:44.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:44.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-21T13:34:44.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T13:34:44.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:34:44.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: Updating smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:34:44.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.706 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:44.706 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T13:34:44.706 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:44.706 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.706 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.706 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.706 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.706 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.706 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: Updating smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.707 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.708 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.708 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:44.708 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T13:34:44.708 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:34:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: Updating smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:44.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:44.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T13:34:44.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:45.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.782+0000 7fb6e4367640 1 -- 172.21.15.2:0/179059483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6dc103690 msgr2=0x7fb6dc103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:45.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.782+0000 7fb6e4367640 1 --2- 172.21.15.2:0/179059483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6dc103690 0x7fb6dc103a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009880 tx=0x7fb6d802a5d0 comp rx=0 tx=0).stop 2024-09-21T13:34:45.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.782+0000 7fb6e4367640 1 -- 172.21.15.2:0/179059483 shutdown_connections 2024-09-21T13:34:45.784 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:45 smithi002 ceph-mon[30076]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T13:34:45.784 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:45 smithi002 ceph-mon[30076]: Reconfiguring daemon mon.a on smithi002 2024-09-21T13:34:45.784 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:45 smithi002 ceph-mon[30076]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:45.785 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:45 smithi002 ceph-mon[40622]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T13:34:45.785 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:45 smithi002 ceph-mon[40622]: Reconfiguring daemon mon.a on smithi002 2024-09-21T13:34:45.785 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:45 smithi002 ceph-mon[40622]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.782+0000 7fb6e4367640 1 --2- 172.21.15.2:0/179059483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6dc103690 0x7fb6dc103a70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.782+0000 7fb6e4367640 1 -- 172.21.15.2:0/179059483 >> 172.21.15.2:0/179059483 conn(0x7fb6dc078280 msgr2=0x7fb6dc0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.782+0000 7fb6e4367640 1 -- 172.21.15.2:0/179059483 shutdown_connections 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.782+0000 7fb6e4367640 1 -- 172.21.15.2:0/179059483 wait complete. 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e4367640 1 Processor -- start 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e4367640 1 -- start start 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e4367640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb6dc101340 0x7fb6dc101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e4367640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6dc101c60 0x7fb6dc1a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e4367640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6dc1a3f70 0x7fb6dc1a6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e4367640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc10c0f0 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e4367640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc10bf70 con 0x7fb6dc101c60 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e4367640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fb6dc10c270 con 0x7fb6dc101340 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e2904640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6dc1a3f70 0x7fb6dc1a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e2904640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6dc1a3f70 0x7fb6dc1a6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41582/0 (socket says 172.21.15.2:41582) 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e2904640 1 -- 172.21.15.2:0/3411676689 learned_addr learned my addr 172.21.15.2:0/3411676689 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.783+0000 7fb6e2103640 1 --2- 172.21.15.2:0/3411676689 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb6dc101340 0x7fb6dc101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6e1902640 1 --2- 172.21.15.2:0/3411676689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6dc101c60 0x7fb6dc1a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6e2904640 1 -- 172.21.15.2:0/3411676689 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb6dc101340 msgr2=0x7fb6dc101720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6e2904640 1 --2- 172.21.15.2:0/3411676689 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb6dc101340 0x7fb6dc101720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6e2904640 1 -- 172.21.15.2:0/3411676689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6dc101c60 msgr2=0x7fb6dc1a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6e2904640 1 --2- 172.21.15.2:0/3411676689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6dc101c60 0x7fb6dc1a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6e2904640 1 -- 172.21.15.2:0/3411676689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6dc1a68a0 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6e1902640 1 --2- 172.21.15.2:0/3411676689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6dc101c60 0x7fb6dc1a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6e2904640 1 --2- 172.21.15.2:0/3411676689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6dc1a3f70 0x7fb6dc1a6360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400ba50 tx=0x7fb6d400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6d37fe640 1 -- 172.21.15.2:0/3411676689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4019070 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6e4367640 1 -- 172.21.15.2:0/3411676689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6dc1a6b30 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6d37fe640 1 -- 172.21.15.2:0/3411676689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fb6d400cbe0 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6d37fe640 1 -- 172.21.15.2:0/3411676689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d40075b0 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.784+0000 7fb6e4367640 1 -- 172.21.15.2:0/3411676689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6dc1a7070 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.785+0000 7fb6d37fe640 1 -- 172.21.15.2:0/3411676689 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7fb6d401c070 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.785+0000 7fb6e4367640 1 -- 172.21.15.2:0/3411676689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6dc103a70 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.786+0000 7fb6d37fe640 1 --2- 172.21.15.2:0/3411676689 >> v2:172.21.15.2:6800/3897423974 conn(0x7fb6c803fd30 0x7fb6c80421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.786+0000 7fb6d37fe640 1 -- 172.21.15.2:0/3411676689 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fb6d4053a10 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.786+0000 7fb6e2103640 1 --2- 172.21.15.2:0/3411676689 >> v2:172.21.15.2:6800/3897423974 conn(0x7fb6c803fd30 0x7fb6c80421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.786+0000 7fb6e2103640 1 --2- 172.21.15.2:0/3411676689 >> v2:172.21.15.2:6800/3897423974 conn(0x7fb6c803fd30 0x7fb6c80421f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8031440 tx=0x7fb6d8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:45.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.791+0000 7fb6d37fe640 1 -- 172.21.15.2:0/3411676689 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6d4012d10 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:45 smithi162 ceph-mon[33046]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T13:34:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:45 smithi162 ceph-mon[33046]: Reconfiguring daemon mon.a on smithi002 2024-09-21T13:34:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:45 smithi162 ceph-mon[33046]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.991+0000 7fb6e4367640 1 -- 172.21.15.2:0/3411676689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fb6dc078280 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.991+0000 7fb6d37fe640 1 -- 172.21.15.2:0/3411676689 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+269 (secure 0 0 0) 0x7fb6d4007c70 con 0x7fb6dc1a3f70 2024-09-21T13:34:45.993 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:45.993 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-21T13:34:45.993 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:34:45.993 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-21T13:34:45.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 -- 172.21.15.2:0/3411676689 >> v2:172.21.15.2:6800/3897423974 conn(0x7fb6c803fd30 msgr2=0x7fb6c80421f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:45.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 --2- 172.21.15.2:0/3411676689 >> v2:172.21.15.2:6800/3897423974 conn(0x7fb6c803fd30 0x7fb6c80421f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8031440 tx=0x7fb6d8005a20 comp rx=0 tx=0).stop 2024-09-21T13:34:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 -- 172.21.15.2:0/3411676689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6dc1a3f70 msgr2=0x7fb6dc1a6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 --2- 172.21.15.2:0/3411676689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6dc1a3f70 0x7fb6dc1a6360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400ba50 tx=0x7fb6d400bf10 comp rx=0 tx=0).stop 2024-09-21T13:34:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 -- 172.21.15.2:0/3411676689 shutdown_connections 2024-09-21T13:34:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 --2- 172.21.15.2:0/3411676689 >> v2:172.21.15.2:6800/3897423974 conn(0x7fb6c803fd30 0x7fb6c80421f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 --2- 172.21.15.2:0/3411676689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6dc1a3f70 0x7fb6dc1a6360 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 --2- 172.21.15.2:0/3411676689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6dc101c60 0x7fb6dc1a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 --2- 172.21.15.2:0/3411676689 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb6dc101340 0x7fb6dc101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 -- 172.21.15.2:0/3411676689 >> 172.21.15.2:0/3411676689 conn(0x7fb6dc103690 msgr2=0x7fb6dc106c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 -- 172.21.15.2:0/3411676689 shutdown_connections 2024-09-21T13:34:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:45.994+0000 7fb6e4367640 1 -- 172.21.15.2:0/3411676689 wait complete. 2024-09-21T13:34:46.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[40622]: Reconfiguring mon.c (monmap changed)... 2024-09-21T13:34:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T13:34:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[40622]: Reconfiguring daemon mon.c on smithi002 2024-09-21T13:34:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3411676689' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:46.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:46.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:46.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[30076]: Reconfiguring mon.c (monmap changed)... 2024-09-21T13:34:46.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:46.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T13:34:46.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:46.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[30076]: Reconfiguring daemon mon.c on smithi002 2024-09-21T13:34:46.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3411676689' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:46 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:46 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:46 smithi162 ceph-mon[33046]: Reconfiguring mon.c (monmap changed)... 2024-09-21T13:34:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:46 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:46 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T13:34:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:46 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:46 smithi162 ceph-mon[33046]: Reconfiguring daemon mon.c on smithi002 2024-09-21T13:34:46.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3411676689' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:47.165 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T13:34:47.165 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:34:47.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T13:34:47.198 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:34:47.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:34:47.267 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:34:47.267 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T13:34:47.300 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:34:47.300 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:34:47.371 INFO:tasks.cephadm:Adding mgr.y on smithi002 2024-09-21T13:34:47.371 INFO:tasks.cephadm:Adding mgr.x on smithi162 2024-09-21T13:34:47.371 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch apply mgr '2;smithi002=y;smithi162=x' 2024-09-21T13:34:47.660 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:34:47.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:47 smithi002 ceph-mon[30076]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:47.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:47 smithi002 ceph-mon[40622]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:47.912 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:47 smithi162 ceph-mon[33046]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:48.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.090+0000 7f8516762640 1 -- 172.21.15.162:0/3874841078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102520 msgr2=0x7f8510102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:48.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.090+0000 7f8516762640 1 --2- 172.21.15.162:0/3874841078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102520 0x7f8510102920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8500009880 tx=0x7f850002a5d0 comp rx=0 tx=0).stop 2024-09-21T13:34:48.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.090+0000 7f8516762640 1 -- 172.21.15.162:0/3874841078 shutdown_connections 2024-09-21T13:34:48.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.090+0000 7f8516762640 1 --2- 172.21.15.162:0/3874841078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102520 0x7f8510102920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:48.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.090+0000 7f8516762640 1 -- 172.21.15.162:0/3874841078 >> 172.21.15.162:0/3874841078 conn(0x7f85100fddf0 msgr2=0x7f8510100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:48.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.090+0000 7f8516762640 1 -- 172.21.15.162:0/3874841078 shutdown_connections 2024-09-21T13:34:48.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.090+0000 7f8516762640 1 -- 172.21.15.162:0/3874841078 wait complete. 2024-09-21T13:34:48.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.091+0000 7f8516762640 1 Processor -- start 2024-09-21T13:34:48.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.091+0000 7f8516762640 1 -- start start 2024-09-21T13:34:48.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.091+0000 7f8516762640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102520 0x7f85101974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:48.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.091+0000 7f8516762640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8510197a60 0x7f8510198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:48.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.091+0000 7f8516762640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8510198c80 0x7f8510199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:48.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.091+0000 7f8516762640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8510107bd0 con 0x7f8510102520 2024-09-21T13:34:48.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.091+0000 7f8516762640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8510107a50 con 0x7f8510198c80 2024-09-21T13:34:48.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.091+0000 7f8516762640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f8510107d50 con 0x7f8510197a60 2024-09-21T13:34:48.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f8514cff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8510198c80 0x7f8510199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:48.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f8514cff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8510198c80 0x7f8510199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35720/0 (socket says 172.21.15.162:35720) 2024-09-21T13:34:48.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f8514cff640 1 -- 172.21.15.162:0/1852548342 learned_addr learned my addr 172.21.15.162:0/1852548342 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:34:48.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f850ffff640 1 --2- 172.21.15.162:0/1852548342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102520 0x7f85101974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:48.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f850f7fe640 1 --2- 172.21.15.162:0/1852548342 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8510197a60 0x7f8510198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:48.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f8514cff640 1 -- 172.21.15.162:0/1852548342 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8510197a60 msgr2=0x7f8510198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:48.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f8514cff640 1 --2- 172.21.15.162:0/1852548342 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8510197a60 0x7f8510198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:48.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f8514cff640 1 -- 172.21.15.162:0/1852548342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102520 msgr2=0x7f85101974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:48.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f8514cff640 1 --2- 172.21.15.162:0/1852548342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102520 0x7f85101974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:48.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f8514cff640 1 -- 172.21.15.162:0/1852548342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851019f860 con 0x7f8510198c80 2024-09-21T13:34:48.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f8514cff640 1 --2- 172.21.15.162:0/1852548342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8510198c80 0x7f8510199130 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f850800ba50 tx=0x7f850800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:48.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f850d7fa640 1 -- 172.21.15.162:0/1852548342 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508019070 con 0x7f8510198c80 2024-09-21T13:34:48.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f850d7fa640 1 -- 172.21.15.162:0/1852548342 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f850800cbe0 con 0x7f8510198c80 2024-09-21T13:34:48.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f8516762640 1 -- 172.21.15.162:0/1852548342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851019fb50 con 0x7f8510198c80 2024-09-21T13:34:48.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f850d7fa640 1 -- 172.21.15.162:0/1852548342 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85080075b0 con 0x7f8510198c80 2024-09-21T13:34:48.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.092+0000 7f8516762640 1 -- 172.21.15.162:0/1852548342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85101a0090 con 0x7f8510198c80 2024-09-21T13:34:48.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.093+0000 7f850d7fa640 1 -- 172.21.15.162:0/1852548342 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7f850801c070 con 0x7f8510198c80 2024-09-21T13:34:48.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.093+0000 7f8516762640 1 -- 172.21.15.162:0/1852548342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8510102920 con 0x7f8510198c80 2024-09-21T13:34:48.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.094+0000 7f850d7fa640 1 --2- 172.21.15.162:0/1852548342 >> v2:172.21.15.2:6800/3897423974 conn(0x7f84fc03fd30 0x7f84fc0421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:48.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.094+0000 7f850d7fa640 1 -- 172.21.15.162:0/1852548342 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f8508053920 con 0x7f8510198c80 2024-09-21T13:34:48.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.094+0000 7f850ffff640 1 --2- 172.21.15.162:0/1852548342 >> v2:172.21.15.2:6800/3897423974 conn(0x7f84fc03fd30 0x7f84fc0421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:48.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.094+0000 7f850ffff640 1 --2- 172.21.15.162:0/1852548342 >> v2:172.21.15.2:6800/3897423974 conn(0x7f84fc03fd30 0x7f84fc0421f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f85000096c0 tx=0x7f8500005a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:48.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.099+0000 7f850d7fa640 1 -- 172.21.15.162:0/1852548342 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85080133a0 con 0x7f8510198c80 2024-09-21T13:34:48.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.295+0000 7f8516762640 1 -- 172.21.15.162:0/1852548342 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi002=y;smithi162=x", "target": ["mon-mgr", ""]}) -- 0x7f8510063590 con 0x7f84fc03fd30 2024-09-21T13:34:48.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.301+0000 7f850d7fa640 1 -- 172.21.15.162:0/1852548342 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8510063590 con 0x7f84fc03fd30 2024-09-21T13:34:48.302 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mgr update... 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.303+0000 7f8516762640 1 -- 172.21.15.162:0/1852548342 >> v2:172.21.15.2:6800/3897423974 conn(0x7f84fc03fd30 msgr2=0x7f84fc0421f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.303+0000 7f8516762640 1 --2- 172.21.15.162:0/1852548342 >> v2:172.21.15.2:6800/3897423974 conn(0x7f84fc03fd30 0x7f84fc0421f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f85000096c0 tx=0x7f8500005a40 comp rx=0 tx=0).stop 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.303+0000 7f8516762640 1 -- 172.21.15.162:0/1852548342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8510198c80 msgr2=0x7f8510199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.303+0000 7f8516762640 1 --2- 172.21.15.162:0/1852548342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8510198c80 0x7f8510199130 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f850800ba50 tx=0x7f850800bf10 comp rx=0 tx=0).stop 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.304+0000 7f8516762640 1 -- 172.21.15.162:0/1852548342 shutdown_connections 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.304+0000 7f8516762640 1 --2- 172.21.15.162:0/1852548342 >> v2:172.21.15.2:6800/3897423974 conn(0x7f84fc03fd30 0x7f84fc0421f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.304+0000 7f8516762640 1 --2- 172.21.15.162:0/1852548342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8510198c80 0x7f8510199130 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.304+0000 7f8516762640 1 --2- 172.21.15.162:0/1852548342 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8510197a60 0x7f8510198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.304+0000 7f8516762640 1 --2- 172.21.15.162:0/1852548342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102520 0x7f85101974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.304+0000 7f8516762640 1 -- 172.21.15.162:0/1852548342 >> 172.21.15.162:0/1852548342 conn(0x7f85100fddf0 msgr2=0x7f85100feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.304+0000 7f8516762640 1 -- 172.21.15.162:0/1852548342 shutdown_connections 2024-09-21T13:34:48.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:34:48.304+0000 7f8516762640 1 -- 172.21.15.162:0/1852548342 wait complete. 2024-09-21T13:34:48.938 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:48 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:48.939 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:48 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:48.939 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:48 smithi162 ceph-mon[33046]: Reconfiguring mon.b (monmap changed)... 2024-09-21T13:34:48.939 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:48 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:48.939 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:48 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T13:34:48.939 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:48 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:48.939 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:48 smithi162 ceph-mon[33046]: Reconfiguring daemon mon.b on smithi162 2024-09-21T13:34:48.940 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:48 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:48.965 DEBUG:teuthology.orchestra.run.smithi162:mgr.x> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@mgr.x.service 2024-09-21T13:34:48.967 DEBUG:tasks.cephadm:set 0 configs 2024-09-21T13:34:48.967 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T13:34:48.967 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:34:48.967 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T13:34:48.987 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T13:34:48.988 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-21T13:34:49.046 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T13:34:49.047 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:34:49.047 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 969 Links: 1 2024-09-21T13:34:49.047 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:34:49.047 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T13:34:49.047 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-21 13:34:36.759035120 +0000 2024-09-21T13:34:49.047 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-21 13:29:49.505755522 +0000 2024-09-21T13:34:49.047 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-21 13:29:49.505755522 +0000 2024-09-21T13:34:49.047 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-21 13:29:49.505755522 +0000 2024-09-21T13:34:49.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T13:34:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[40622]: Reconfiguring mon.b (monmap changed)... 2024-09-21T13:34:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T13:34:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:49.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[40622]: Reconfiguring daemon mon.b on smithi162 2024-09-21T13:34:49.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[30076]: Reconfiguring mon.b (monmap changed)... 2024-09-21T13:34:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T13:34:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T13:34:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[30076]: Reconfiguring daemon mon.b on smithi162 2024-09-21T13:34:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:48 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:49.117 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-21T13:34:49.117 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-21T13:34:49.117 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000130093 s, 3.9 MB/s 2024-09-21T13:34:49.119 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T13:34:49.180 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-21T13:34:49.239 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T13:34:49.240 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:34:49.240 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 980 Links: 1 2024-09-21T13:34:49.240 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:34:49.240 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T13:34:49.240 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-21 13:34:36.759035120 +0000 2024-09-21T13:34:49.240 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-21 13:29:49.506755492 +0000 2024-09-21T13:34:49.240 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-21 13:29:49.506755492 +0000 2024-09-21T13:34:49.240 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-21 13:29:49.506755492 +0000 2024-09-21T13:34:49.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T13:34:49.309 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-21T13:34:49.309 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-21T13:34:49.309 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000123809 s, 4.1 MB/s 2024-09-21T13:34:49.310 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T13:34:49.370 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-21T13:34:49.430 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T13:34:49.430 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:34:49.430 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 964 Links: 1 2024-09-21T13:34:49.430 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:34:49.430 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T13:34:49.430 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-21 13:34:36.759035120 +0000 2024-09-21T13:34:49.430 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-21 13:29:49.505755522 +0000 2024-09-21T13:34:49.430 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-21 13:29:49.505755522 +0000 2024-09-21T13:34:49.430 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-21 13:29:49.505755522 +0000 2024-09-21T13:34:49.430 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T13:34:49.499 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-21T13:34:49.499 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-21T13:34:49.499 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000116891 s, 4.4 MB/s 2024-09-21T13:34:49.500 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T13:34:49.560 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-21T13:34:49.618 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T13:34:49.619 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:34:49.619 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 970 Links: 1 2024-09-21T13:34:49.619 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:34:49.619 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T13:34:49.619 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-21 13:34:36.760035097 +0000 2024-09-21T13:34:49.619 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-21 13:29:49.505755522 +0000 2024-09-21T13:34:49.619 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-21 13:29:49.505755522 +0000 2024-09-21T13:34:49.619 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-21 13:29:49.505755522 +0000 2024-09-21T13:34:49.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T13:34:49.687 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-21T13:34:49.687 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-21T13:34:49.687 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000121856 s, 4.2 MB/s 2024-09-21T13:34:49.689 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T13:34:49.748 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:34:49.748 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T13:34:49.765 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T13:34:49.765 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-21T13:34:49.809 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:49 smithi162 ceph-mon[33046]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:49.809 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:49 smithi162 ceph-mon[33046]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi002=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:49.809 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:49 smithi162 ceph-mon[33046]: Saving service mgr spec with placement smithi002=y;smithi162=x;count:2 2024-09-21T13:34:49.823 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T13:34:49.823 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:34:49.823 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 962 Links: 1 2024-09-21T13:34:49.823 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:34:49.823 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T13:34:49.823 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 13:34:27.637154500 +0000 2024-09-21T13:34:49.823 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 13:29:49.485176947 +0000 2024-09-21T13:34:49.824 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 13:29:49.485176947 +0000 2024-09-21T13:34:49.824 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 13:29:49.485176947 +0000 2024-09-21T13:34:49.824 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T13:34:49.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:49 smithi002 ceph-mon[40622]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:49.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:49 smithi002 ceph-mon[40622]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi002=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:49.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:49 smithi002 ceph-mon[40622]: Saving service mgr spec with placement smithi002=y;smithi162=x;count:2 2024-09-21T13:34:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:49 smithi002 ceph-mon[30076]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:49 smithi002 ceph-mon[30076]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi002=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:49 smithi002 ceph-mon[30076]: Saving service mgr spec with placement smithi002=y;smithi162=x;count:2 2024-09-21T13:34:49.888 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T13:34:49.889 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T13:34:49.889 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000252095 s, 2.0 MB/s 2024-09-21T13:34:49.890 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T13:34:49.946 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-21T13:34:50.003 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T13:34:50.003 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:34:50.003 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 978 Links: 1 2024-09-21T13:34:50.003 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:34:50.003 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T13:34:50.003 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 13:34:27.638154479 +0000 2024-09-21T13:34:50.003 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 13:29:49.487176719 +0000 2024-09-21T13:34:50.003 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 13:29:49.487176719 +0000 2024-09-21T13:34:50.003 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 13:29:49.487176719 +0000 2024-09-21T13:34:50.004 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T13:34:50.067 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T13:34:50.067 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T13:34:50.068 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000194142 s, 2.6 MB/s 2024-09-21T13:34:50.069 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T13:34:50.126 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-21T13:34:50.182 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T13:34:50.183 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:34:50.183 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 965 Links: 1 2024-09-21T13:34:50.183 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:34:50.183 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T13:34:50.183 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 13:34:27.638154479 +0000 2024-09-21T13:34:50.183 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 13:29:49.485176947 +0000 2024-09-21T13:34:50.183 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 13:29:49.485176947 +0000 2024-09-21T13:34:50.183 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 13:29:49.485176947 +0000 2024-09-21T13:34:50.183 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T13:34:50.246 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T13:34:50.246 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T13:34:50.246 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000190093 s, 2.7 MB/s 2024-09-21T13:34:50.247 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T13:34:50.303 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-21T13:34:50.359 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T13:34:50.359 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:34:50.359 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 971 Links: 1 2024-09-21T13:34:50.359 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:34:50.359 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T13:34:50.359 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 13:34:27.639154458 +0000 2024-09-21T13:34:50.359 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 13:29:49.486176833 +0000 2024-09-21T13:34:50.359 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 13:29:49.486176833 +0000 2024-09-21T13:34:50.359 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 13:29:49.486176833 +0000 2024-09-21T13:34:50.360 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T13:34:50.427 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T13:34:50.427 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T13:34:50.427 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000170506 s, 3.0 MB/s 2024-09-21T13:34:50.429 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T13:34:50.485 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2024-09-21T13:34:50.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T13:34:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:34:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T13:34:50.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T13:34:50.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T13:34:50.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:50.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:50 smithi162 ceph-mon[33046]: Deploying daemon mgr.x on smithi162 2024-09-21T13:34:51.127 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:51.169 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:51.170 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:51.170 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:51.170 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:51.170 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:51.170 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T13:34:51.170 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T13:34:51.170 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T13:34:51.171 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:51.171 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[30076]: Deploying daemon mgr.x on smithi162 2024-09-21T13:34:51.171 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:51.171 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:51.171 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:51.171 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:51.171 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:51.171 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:51.172 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T13:34:51.172 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T13:34:51.172 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T13:34:51.172 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:51.172 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:50 smithi002 ceph-mon[40622]: Deploying daemon mgr.x on smithi162 2024-09-21T13:34:51.877 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:34:51 smithi162 systemd[1]: Starting Ceph mgr.x for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:34:52.150 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:51 smithi002 ceph-mon[30076]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:52.150 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:51 smithi002 ceph-mon[40622]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:52.171 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:51 smithi162 ceph-mon[33046]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:52.172 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:34:51 smithi162 podman[34679]: 2024-09-21 13:34:51.817816771 +0000 UTC m=+0.015911444 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:34:52.172 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:34:51 smithi162 podman[34679]: 2024-09-21 13:34:51.944537487 +0000 UTC m=+0.142632149 container create bb4dab5e6b7d4553b56d4a1f2d278e5e5e7f7f32376bfd04ac0a4d6c06a75fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T13:34:52.172 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:34:52 smithi162 podman[34679]: 2024-09-21 13:34:52.171395513 +0000 UTC m=+0.369490179 container init bb4dab5e6b7d4553b56d4a1f2d278e5e5e7f7f32376bfd04ac0a4d6c06a75fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T13:34:52.483 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:34:52 smithi162 podman[34679]: 2024-09-21 13:34:52.176205079 +0000 UTC m=+0.374299742 container start bb4dab5e6b7d4553b56d4a1f2d278e5e5e7f7f32376bfd04ac0a4d6c06a75fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:34:52.483 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:34:52 smithi162 ceph-mgr[34718]: -- 172.21.15.162:0/1314460364 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a7b99630e0 con 0x55a7b9941000 2024-09-21T13:34:52.483 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:34:52 smithi162 bash[34679]: bb4dab5e6b7d4553b56d4a1f2d278e5e5e7f7f32376bfd04ac0a4d6c06a75fb8 2024-09-21T13:34:52.483 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:34:52 smithi162 systemd[1]: Started Ceph mgr.x for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:34:53.537 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[40622]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:53.537 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.537 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.537 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.537 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.537 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:53.537 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[30076]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:53.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:53.540 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:34:53.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2024-09-21T13:34:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:53 smithi162 ceph-mon[33046]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:34:54.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:54.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:54.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:54 smithi162 ceph-mon[33046]: Reconfiguring mgr.y (unknown last config time)... 2024-09-21T13:34:54.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T13:34:54.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T13:34:54.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:54.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:54 smithi162 ceph-mon[33046]: Reconfiguring daemon mgr.y on smithi002 2024-09-21T13:34:54.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:54.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:54.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[30076]: Reconfiguring mgr.y (unknown last config time)... 2024-09-21T13:34:54.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T13:34:54.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T13:34:54.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[30076]: Reconfiguring daemon mgr.y on smithi002 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[40622]: Reconfiguring mgr.y (unknown last config time)... 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:54.766 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[40622]: Reconfiguring daemon mgr.y on smithi002 2024-09-21T13:34:54.767 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.849+0000 7f4569508640 1 -- 172.21.15.2:0/1934908921 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4564102a80 msgr2=0x7f4564102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.849+0000 7f4569508640 1 --2- 172.21.15.2:0/1934908921 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4564102a80 0x7f4564102f00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4558009960 tx=0x7f455802a460 comp rx=0 tx=0).stop 2024-09-21T13:34:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.849+0000 7f4569508640 1 -- 172.21.15.2:0/1934908921 shutdown_connections 2024-09-21T13:34:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.849+0000 7f4569508640 1 --2- 172.21.15.2:0/1934908921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4564103440 0x7f4564109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.849+0000 7f4569508640 1 --2- 172.21.15.2:0/1934908921 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4564102a80 0x7f4564102f00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.849+0000 7f4569508640 1 --2- 172.21.15.2:0/1934908921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4564101920 0x7f4564101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.849+0000 7f4569508640 1 -- 172.21.15.2:0/1934908921 >> 172.21.15.2:0/1934908921 conn(0x7f45640fd1d0 msgr2=0x7f45640ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:34:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.849+0000 7f4569508640 1 -- 172.21.15.2:0/1934908921 shutdown_connections 2024-09-21T13:34:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.849+0000 7f4569508640 1 -- 172.21.15.2:0/1934908921 wait complete. 2024-09-21T13:34:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f4569508640 1 Processor -- start 2024-09-21T13:34:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f4569508640 1 -- start start 2024-09-21T13:34:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f4569508640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4564101920 0x7f45641974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f4569508640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4564102a80 0x7f4564197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f4569508640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4564103440 0x7f4564198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f4569508640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f456410cc60 con 0x7f4564102a80 2024-09-21T13:34:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f4569508640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f456410cae0 con 0x7f4564103440 2024-09-21T13:34:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f4569508640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f456410cde0 con 0x7f4564101920 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f4562ffd640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4564101920 0x7f45641974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f45627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4564102a80 0x7f4564197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f4562ffd640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4564101920 0x7f45641974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:32818/0 (socket says 172.21.15.2:32818) 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f4562ffd640 1 -- 172.21.15.2:0/3013849692 learned_addr learned my addr 172.21.15.2:0/3013849692 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.850+0000 7f45637fe640 1 --2- 172.21.15.2:0/3013849692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4564103440 0x7f4564198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f4562ffd640 1 -- 172.21.15.2:0/3013849692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4564103440 msgr2=0x7f4564198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f4562ffd640 1 --2- 172.21.15.2:0/3013849692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4564103440 0x7f4564198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f4562ffd640 1 -- 172.21.15.2:0/3013849692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4564102a80 msgr2=0x7f4564197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f4562ffd640 1 --2- 172.21.15.2:0/3013849692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4564102a80 0x7f4564197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f4562ffd640 1 -- 172.21.15.2:0/3013849692 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4564199020 con 0x7f4564101920 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f45627fc640 1 --2- 172.21.15.2:0/3013849692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4564102a80 0x7f4564197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:34:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f4562ffd640 1 --2- 172.21.15.2:0/3013849692 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4564101920 0x7f45641974f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f455400eb00 tx=0x7f455400ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f454bfff640 1 -- 172.21.15.2:0/3013849692 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455400bb70 con 0x7f4564101920 2024-09-21T13:34:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f454bfff640 1 -- 172.21.15.2:0/3013849692 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f455400bd10 con 0x7f4564101920 2024-09-21T13:34:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f4569508640 1 -- 172.21.15.2:0/3013849692 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4564199310 con 0x7f4564101920 2024-09-21T13:34:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f454bfff640 1 -- 172.21.15.2:0/3013849692 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554004e10 con 0x7f4564101920 2024-09-21T13:34:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.851+0000 7f4569508640 1 -- 172.21.15.2:0/3013849692 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f456406b630 con 0x7f4564101920 2024-09-21T13:34:54.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.852+0000 7f454bfff640 1 -- 172.21.15.2:0/3013849692 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 13) ==== 51862+0+0 (secure 0 0 0) 0x7f4554017410 con 0x7f4564101920 2024-09-21T13:34:54.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.852+0000 7f4569508640 1 -- 172.21.15.2:0/3013849692 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4564101d20 con 0x7f4564101920 2024-09-21T13:34:54.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.852+0000 7f454bfff640 1 --2- 172.21.15.2:0/3013849692 >> v2:172.21.15.2:6800/3897423974 conn(0x7f454c03fae0 0x7f454c041fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:34:54.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.852+0000 7f454bfff640 1 -- 172.21.15.2:0/3013849692 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f4554055be0 con 0x7f4564101920 2024-09-21T13:34:54.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.852+0000 7f45627fc640 1 --2- 172.21.15.2:0/3013849692 >> v2:172.21.15.2:6800/3897423974 conn(0x7f454c03fae0 0x7f454c041fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:34:54.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.853+0000 7f45627fc640 1 --2- 172.21.15.2:0/3013849692 >> v2:172.21.15.2:6800/3897423974 conn(0x7f454c03fae0 0x7f454c041fa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4558000c00 tx=0x7f4558005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:34:54.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:54.857+0000 7f454bfff640 1 -- 172.21.15.2:0/3013849692 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f45540110c0 con 0x7f4564101920 2024-09-21T13:34:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:55.056+0000 7f4569508640 1 -- 172.21.15.2:0/3013849692 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f456406b890 con 0x7f454c03fae0 2024-09-21T13:34:55.723 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[40622]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:55.723 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:34:55.723 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:34:55.723 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:55.723 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:55.723 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:55.723 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:55.723 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[30076]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:55.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:55 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:55 smithi162 ceph-mon[33046]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:55 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:34:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:55 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:34:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:55 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:55 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:55 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:55 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:34:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:55 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:34:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:55 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:34:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:55 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:34:56.768 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:56 smithi002 ceph-mon[30076]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:56.768 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:56 smithi002 ceph-mon[40622]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:56 smithi162 ceph-mon[33046]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:34:57.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:34:57.543+0000 7f454bfff640 1 -- 172.21.15.2:0/3013849692 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mgrmap(e 14) ==== 103141+0+0 (secure 0 0 0) 0x7f455401ec10 con 0x7f4564101920 2024-09-21T13:34:57.796 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[30076]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:57.796 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[30076]: Standby manager daemon x started 2024-09-21T13:34:57.796 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[30076]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T13:34:57.796 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[30076]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T13:34:57.796 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[30076]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T13:34:57.796 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[30076]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T13:34:57.796 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2253462547' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0640c953-1dfe-4a1a-b6cb-18d1dc62aedd"} : dispatch 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0640c953-1dfe-4a1a-b6cb-18d1dc62aedd"} : dispatch 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0640c953-1dfe-4a1a-b6cb-18d1dc62aedd"}]': finished 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[30076]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[40622]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[40622]: Standby manager daemon x started 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[40622]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[40622]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[40622]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[40622]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2253462547' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0640c953-1dfe-4a1a-b6cb-18d1dc62aedd"} : dispatch 2024-09-21T13:34:57.797 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0640c953-1dfe-4a1a-b6cb-18d1dc62aedd"} : dispatch 2024-09-21T13:34:57.798 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0640c953-1dfe-4a1a-b6cb-18d1dc62aedd"}]': finished 2024-09-21T13:34:57.798 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[40622]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T13:34:57.798 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:57 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:34:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:57 smithi162 ceph-mon[33046]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:57 smithi162 ceph-mon[33046]: Standby manager daemon x started 2024-09-21T13:34:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:57 smithi162 ceph-mon[33046]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T13:34:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:57 smithi162 ceph-mon[33046]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T13:34:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:57 smithi162 ceph-mon[33046]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T13:34:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:57 smithi162 ceph-mon[33046]: from='mgr.? 172.21.15.162:0/2736637515' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T13:34:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2253462547' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0640c953-1dfe-4a1a-b6cb-18d1dc62aedd"} : dispatch 2024-09-21T13:34:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0640c953-1dfe-4a1a-b6cb-18d1dc62aedd"} : dispatch 2024-09-21T13:34:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0640c953-1dfe-4a1a-b6cb-18d1dc62aedd"}]': finished 2024-09-21T13:34:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:57 smithi162 ceph-mon[33046]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T13:34:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:57 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:34:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:58 smithi002 ceph-mon[30076]: mgrmap e14: y(active, since 59s), standbys: x 2024-09-21T13:34:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T13:34:58.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2440319006' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:34:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:58 smithi002 ceph-mon[40622]: mgrmap e14: y(active, since 59s), standbys: x 2024-09-21T13:34:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:58 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T13:34:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2440319006' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:34:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:58 smithi162 ceph-mon[33046]: mgrmap e14: y(active, since 59s), standbys: x 2024-09-21T13:34:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:58 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T13:34:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2440319006' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:34:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:34:59 smithi002 ceph-mon[30076]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:59.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:34:59 smithi002 ceph-mon[40622]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:34:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:34:59 smithi162 ceph-mon[33046]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:01.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:01 smithi002 ceph-mon[30076]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:01.694 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:01 smithi002 ceph-mon[40622]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:01 smithi162 ceph-mon[33046]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:03 smithi002 ceph-mon[30076]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:03.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:03 smithi002 ceph-mon[40622]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:03 smithi162 ceph-mon[33046]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:05.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:05 smithi002 ceph-mon[30076]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:05 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T13:35:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:05 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:05 smithi002 ceph-mon[30076]: Deploying daemon osd.0 on smithi002 2024-09-21T13:35:05.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:05 smithi002 ceph-mon[40622]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:05.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:05 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T13:35:05.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:05 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:05.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:05 smithi002 ceph-mon[40622]: Deploying daemon osd.0 on smithi002 2024-09-21T13:35:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:05 smithi162 ceph-mon[33046]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:05 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T13:35:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:05 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:05 smithi162 ceph-mon[33046]: Deploying daemon osd.0 on smithi002 2024-09-21T13:35:07.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:07 smithi002 ceph-mon[30076]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:07.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:07 smithi002 ceph-mon[40622]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:07 smithi162 ceph-mon[33046]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:09.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:09 smithi002 ceph-mon[30076]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:09 smithi002 ceph-mon[40622]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:09 smithi162 ceph-mon[33046]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:11.799 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:11 smithi002 ceph-mon[40622]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:11.799 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:11 smithi002 ceph-mon[30076]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:11.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:11 smithi162 ceph-mon[33046]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:13.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:13 smithi002 ceph-mon[30076]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:13.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:13 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:13.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:13 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:13.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:13 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:13.640 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:13 smithi002 ceph-mon[40622]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:13.641 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:13 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:13.641 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:13 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:13.641 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:13 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:13 smithi162 ceph-mon[33046]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:13 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:13 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:13 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:15.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:15 smithi002 ceph-mon[30076]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:15 smithi002 ceph-mon[40622]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:15 smithi162 ceph-mon[33046]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:16 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:16 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:16 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:16 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:16 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:16 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:16 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:16 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:16 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:16 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:17.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:16 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:17.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:16 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:17.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:16 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:17.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:16 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:17.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:16 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:17 smithi002 ceph-mon[40622]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:17 smithi002 ceph-mon[40622]: from='osd.0 v2:172.21.15.2:6801/1847462361' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T13:35:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:17 smithi002 ceph-mon[40622]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T13:35:17.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:17 smithi002 ceph-mon[30076]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:17.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:17 smithi002 ceph-mon[30076]: from='osd.0 v2:172.21.15.2:6801/1847462361' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T13:35:17.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:17 smithi002 ceph-mon[30076]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T13:35:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:17 smithi162 ceph-mon[33046]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:17 smithi162 ceph-mon[33046]: from='osd.0 v2:172.21.15.2:6801/1847462361' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T13:35:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:17 smithi162 ceph-mon[33046]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T13:35:18.367 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2024-09-21T13:35:18.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.366+0000 7f454bfff640 1 -- 172.21.15.2:0/3013849692 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f456406b890 con 0x7f454c03fae0 2024-09-21T13:35:18.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 -- 172.21.15.2:0/3013849692 >> v2:172.21.15.2:6800/3897423974 conn(0x7f454c03fae0 msgr2=0x7f454c041fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:35:18.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 --2- 172.21.15.2:0/3013849692 >> v2:172.21.15.2:6800/3897423974 conn(0x7f454c03fae0 0x7f454c041fa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4558000c00 tx=0x7f4558005e30 comp rx=0 tx=0).stop 2024-09-21T13:35:18.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 -- 172.21.15.2:0/3013849692 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4564101920 msgr2=0x7f45641974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:35:18.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 --2- 172.21.15.2:0/3013849692 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4564101920 0x7f45641974f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f455400eb00 tx=0x7f455400ef00 comp rx=0 tx=0).stop 2024-09-21T13:35:18.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 -- 172.21.15.2:0/3013849692 shutdown_connections 2024-09-21T13:35:18.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 --2- 172.21.15.2:0/3013849692 >> v2:172.21.15.2:6800/3897423974 conn(0x7f454c03fae0 0x7f454c041fa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:18.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 --2- 172.21.15.2:0/3013849692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4564103440 0x7f4564198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:18.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 --2- 172.21.15.2:0/3013849692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4564102a80 0x7f4564197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:18.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 --2- 172.21.15.2:0/3013849692 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4564101920 0x7f45641974f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:18.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 -- 172.21.15.2:0/3013849692 >> 172.21.15.2:0/3013849692 conn(0x7f45640fd1d0 msgr2=0x7f45640fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:35:18.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 -- 172.21.15.2:0/3013849692 shutdown_connections 2024-09-21T13:35:18.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:18.369+0000 7f4569508640 1 -- 172.21.15.2:0/3013849692 wait complete. 2024-09-21T13:35:18.964 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.0.service 2024-09-21T13:35:18.966 INFO:tasks.cephadm:Deploying osd.1 on smithi002 with /dev/vg_nvme/lv_3... 2024-09-21T13:35:18.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T13:35:19.209 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[40622]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T13:35:19.209 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[40622]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T13:35:19.209 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:19.209 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[40622]: from='osd.0 v2:172.21.15.2:6801/1847462361' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:19.209 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[40622]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[40622]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[30076]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[30076]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[30076]: from='osd.0 v2:172.21.15.2:6801/1847462361' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[30076]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[30076]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:19.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:19.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:19.470 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0[44379]: 2024-09-21T13:35:19.384+0000 7fa8039e4640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T13:35:19.470 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:35:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0[44379]: 2024-09-21T13:35:19.386+0000 7fa7fb803640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:35:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:19 smithi162 ceph-mon[33046]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T13:35:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:19 smithi162 ceph-mon[33046]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T13:35:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:19 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:19 smithi162 ceph-mon[33046]: from='osd.0 v2:172.21.15.2:6801/1847462361' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:19 smithi162 ceph-mon[33046]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:19 smithi162 ceph-mon[33046]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:19 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:19 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:19 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:19.786 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:35:20.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:20 smithi002 ceph-mon[30076]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:35:20.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:20 smithi002 ceph-mon[30076]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T13:35:20.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:20 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:20.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:20 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:20.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:20 smithi002 ceph-mon[30076]: from='osd.0 ' entity='osd.0' 2024-09-21T13:35:20.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:20 smithi002 ceph-mon[40622]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:35:20.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:20 smithi002 ceph-mon[40622]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T13:35:20.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:20 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:20.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:20 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:20.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:20 smithi002 ceph-mon[40622]: from='osd.0 ' entity='osd.0' 2024-09-21T13:35:20.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:20 smithi162 ceph-mon[33046]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:35:20.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:20 smithi162 ceph-mon[33046]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T13:35:20.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:20 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:20.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:20 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:20.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:20 smithi162 ceph-mon[33046]: from='osd.0 ' entity='osd.0' 2024-09-21T13:35:21.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[30076]: purged_snaps scrub starts 2024-09-21T13:35:21.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[30076]: purged_snaps scrub ok 2024-09-21T13:35:21.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:21.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[30076]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:21.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[30076]: osd.0 v2:172.21.15.2:6801/1847462361 boot 2024-09-21T13:35:21.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[30076]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T13:35:21.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:21.483 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[40622]: purged_snaps scrub starts 2024-09-21T13:35:21.483 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[40622]: purged_snaps scrub ok 2024-09-21T13:35:21.483 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:21.483 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[40622]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:21.483 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[40622]: osd.0 v2:172.21.15.2:6801/1847462361 boot 2024-09-21T13:35:21.483 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[40622]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T13:35:21.483 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:21 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:21.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:21 smithi162 ceph-mon[33046]: purged_snaps scrub starts 2024-09-21T13:35:21.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:21 smithi162 ceph-mon[33046]: purged_snaps scrub ok 2024-09-21T13:35:21.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:21 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:21.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:21 smithi162 ceph-mon[33046]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T13:35:21.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:21 smithi162 ceph-mon[33046]: osd.0 v2:172.21.15.2:6801/1847462361 boot 2024-09-21T13:35:21.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:21 smithi162 ceph-mon[33046]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T13:35:21.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:21 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:35:22.527 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:22 smithi002 ceph-mon[30076]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T13:35:22.528 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:22 smithi002 ceph-mon[40622]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T13:35:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:22 smithi162 ceph-mon[33046]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T13:35:23.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[30076]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:23.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[30076]: Detected new or changed devices on smithi002 2024-09-21T13:35:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:35:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi002 to 16068M 2024-09-21T13:35:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[40622]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[40622]: Detected new or changed devices on smithi002 2024-09-21T13:35:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:35:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi002 to 16068M 2024-09-21T13:35:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:23 smithi162 ceph-mon[33046]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:23 smithi162 ceph-mon[33046]: Detected new or changed devices on smithi002 2024-09-21T13:35:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:35:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:23 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi002 to 16068M 2024-09-21T13:35:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:23.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:23.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:24.212 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:35:24.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2024-09-21T13:35:24.514 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:35:24.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.939+0000 7f500c53c640 1 -- 172.21.15.2:0/1021557185 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50041018e0 msgr2=0x7f5004101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:35:24.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.939+0000 7f500c53c640 1 --2- 172.21.15.2:0/1021557185 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50041018e0 0x7f5004101ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5000009960 tx=0x7f500002a460 comp rx=0 tx=0).stop 2024-09-21T13:35:24.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.939+0000 7f500c53c640 1 -- 172.21.15.2:0/1021557185 shutdown_connections 2024-09-21T13:35:24.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.939+0000 7f500c53c640 1 --2- 172.21.15.2:0/1021557185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5004103400 0x7f5004109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:24.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.939+0000 7f500c53c640 1 --2- 172.21.15.2:0/1021557185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5004102a40 0x7f5004102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:24.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.939+0000 7f500c53c640 1 --2- 172.21.15.2:0/1021557185 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50041018e0 0x7f5004101ce0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:24.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.939+0000 7f500c53c640 1 -- 172.21.15.2:0/1021557185 >> 172.21.15.2:0/1021557185 conn(0x7f50040fd1b0 msgr2=0x7f50040ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:35:24.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.939+0000 7f500c53c640 1 -- 172.21.15.2:0/1021557185 shutdown_connections 2024-09-21T13:35:24.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.939+0000 7f500c53c640 1 -- 172.21.15.2:0/1021557185 wait complete. 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500c53c640 1 Processor -- start 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500c53c640 1 -- start start 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500c53c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50041018e0 0x7f500406b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500c53c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5004102a40 0x7f500419d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500c53c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5004103400 0x7f500419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500c53c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f500410cc60 con 0x7f50041018e0 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500c53c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f500410cae0 con 0x7f5004102a40 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500c53c640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f500410cde0 con 0x7f5004103400 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500a2d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50041018e0 0x7f500406b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500a2d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50041018e0 0x7f500406b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59924/0 (socket says 172.21.15.2:59924) 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500a2d8640 1 -- 172.21.15.2:0/3534243120 learned_addr learned my addr 172.21.15.2:0/3534243120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f500aad9640 1 --2- 172.21.15.2:0/3534243120 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5004103400 0x7f500419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:35:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.940+0000 7f5009ad7640 1 --2- 172.21.15.2:0/3534243120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5004102a40 0x7f500419d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f500a2d8640 1 -- 172.21.15.2:0/3534243120 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5004103400 msgr2=0x7f500419f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f500a2d8640 1 --2- 172.21.15.2:0/3534243120 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5004103400 0x7f500419f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f500a2d8640 1 -- 172.21.15.2:0/3534243120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5004102a40 msgr2=0x7f500419d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f500a2d8640 1 --2- 172.21.15.2:0/3534243120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5004102a40 0x7f500419d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f500a2d8640 1 -- 172.21.15.2:0/3534243120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50041a0140 con 0x7f50041018e0 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f500aad9640 1 --2- 172.21.15.2:0/3534243120 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5004103400 0x7f500419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f500a2d8640 1 --2- 172.21.15.2:0/3534243120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50041018e0 0x7f500406b3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5000005ec0 tx=0x7f5000003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f4ffb7fe640 1 -- 172.21.15.2:0/3534243120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500003f070 con 0x7f50041018e0 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f500c53c640 1 -- 172.21.15.2:0/3534243120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50041a03d0 con 0x7f50041018e0 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f4ffb7fe640 1 -- 172.21.15.2:0/3534243120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5000031b30 con 0x7f50041018e0 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f4ffb7fe640 1 -- 172.21.15.2:0/3534243120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000035030 con 0x7f50041018e0 2024-09-21T13:35:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.941+0000 7f500c53c640 1 -- 172.21.15.2:0/3534243120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50041a0900 con 0x7f50041018e0 2024-09-21T13:35:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.942+0000 7f500c53c640 1 -- 172.21.15.2:0/3534243120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5004101ce0 con 0x7f50041018e0 2024-09-21T13:35:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.943+0000 7f4ffb7fe640 1 -- 172.21.15.2:0/3534243120 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 103141+0+0 (secure 0 0 0) 0x7f5000042070 con 0x7f50041018e0 2024-09-21T13:35:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.943+0000 7f4ffb7fe640 1 --2- 172.21.15.2:0/3534243120 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4ff007af90 0x7f4ff007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:35:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.943+0000 7f4ffb7fe640 1 -- 172.21.15.2:0/3534243120 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1541+0+0 (secure 0 0 0) 0x7f50000bd560 con 0x7f50041018e0 2024-09-21T13:35:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.943+0000 7f5009ad7640 1 --2- 172.21.15.2:0/3534243120 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4ff007af90 0x7f4ff007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:35:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.944+0000 7f5009ad7640 1 --2- 172.21.15.2:0/3534243120 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4ff007af90 0x7f4ff007d450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4005fd0 tx=0x7f4ff400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:35:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:24.948+0000 7f4ffb7fe640 1 -- 172.21.15.2:0/3534243120 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5000089e40 con 0x7f50041018e0 2024-09-21T13:35:25.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:25.147+0000 7f500c53c640 1 -- 172.21.15.2:0/3534243120 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5004063590 con 0x7f4ff007af90 2024-09-21T13:35:25.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:25 smithi002 ceph-mon[30076]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:25.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:25 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:35:25.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:25 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:35:25.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:25 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:25.822 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:25 smithi002 ceph-mon[40622]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:25.822 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:25 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:35:25.822 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:25 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:35:25.822 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:25 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:25 smithi162 ceph-mon[33046]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:25 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:35:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:25 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:35:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:25 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:26.798 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:26 smithi002 ceph-mon[30076]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:35:26.798 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:26 smithi002 ceph-mon[40622]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:35:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:26 smithi162 ceph-mon[33046]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:35:27.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:27 smithi002 ceph-mon[30076]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:27.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3040176826' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b42fdd3-2070-4813-aa0b-478d0c046e59"} : dispatch 2024-09-21T13:35:27.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3040176826' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b42fdd3-2070-4813-aa0b-478d0c046e59"}]': finished 2024-09-21T13:35:27.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:27 smithi002 ceph-mon[30076]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T13:35:27.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:27 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:27 smithi002 ceph-mon[40622]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3040176826' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b42fdd3-2070-4813-aa0b-478d0c046e59"} : dispatch 2024-09-21T13:35:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3040176826' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b42fdd3-2070-4813-aa0b-478d0c046e59"}]': finished 2024-09-21T13:35:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:27 smithi002 ceph-mon[40622]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T13:35:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:27 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:27 smithi162 ceph-mon[33046]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3040176826' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b42fdd3-2070-4813-aa0b-478d0c046e59"} : dispatch 2024-09-21T13:35:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3040176826' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b42fdd3-2070-4813-aa0b-478d0c046e59"}]': finished 2024-09-21T13:35:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:27 smithi162 ceph-mon[33046]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T13:35:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:27 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2024683000' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:35:28.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2024683000' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:35:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2024683000' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:35:29.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:29 smithi002 ceph-mon[40622]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:29.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:29 smithi002 ceph-mon[30076]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:29 smithi162 ceph-mon[33046]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:31.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:31 smithi002 ceph-mon[30076]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:31.807 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:31 smithi002 ceph-mon[40622]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:31 smithi162 ceph-mon[33046]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:33.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:33 smithi002 ceph-mon[30076]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:33.806 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:33 smithi002 ceph-mon[40622]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:33 smithi162 ceph-mon[33046]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:35 smithi002 ceph-mon[30076]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:35 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T13:35:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:35 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:35 smithi002 ceph-mon[30076]: Deploying daemon osd.1 on smithi002 2024-09-21T13:35:35.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:35 smithi002 ceph-mon[40622]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:35 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T13:35:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:35 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:35 smithi002 ceph-mon[40622]: Deploying daemon osd.1 on smithi002 2024-09-21T13:35:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:35 smithi162 ceph-mon[33046]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:35 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T13:35:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:35 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:35 smithi162 ceph-mon[33046]: Deploying daemon osd.1 on smithi002 2024-09-21T13:35:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:37 smithi002 ceph-mon[30076]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:37.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:37 smithi002 ceph-mon[40622]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:37.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:37 smithi162 ceph-mon[33046]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:39.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:39 smithi002 ceph-mon[30076]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:39.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:39 smithi002 ceph-mon[40622]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:39 smithi162 ceph-mon[33046]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:41.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:41 smithi002 ceph-mon[30076]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:41 smithi002 ceph-mon[40622]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:41 smithi162 ceph-mon[33046]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:43.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:43 smithi002 ceph-mon[30076]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:43.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:43 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:43.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:43 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:43.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:43 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:43.763 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:43 smithi002 ceph-mon[40622]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:43.763 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:43 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:43.763 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:43 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:43.763 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:43 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:43 smithi162 ceph-mon[33046]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:43 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:43 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:43 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:45.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:45 smithi002 ceph-mon[30076]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:45.631 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:45 smithi002 ceph-mon[40622]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:45 smithi162 ceph-mon[33046]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:47 smithi162 ceph-mon[33046]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[30076]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[40622]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.679+0000 7f4ffb7fe640 1 -- 172.21.15.2:0/3534243120 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5004063590 con 0x7f4ff007af90 2024-09-21T13:35:48.681 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 1 on host 'smithi002' 2024-09-21T13:35:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 -- 172.21.15.2:0/3534243120 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4ff007af90 msgr2=0x7f4ff007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:35:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 --2- 172.21.15.2:0/3534243120 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4ff007af90 0x7f4ff007d450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4005fd0 tx=0x7f4ff400b390 comp rx=0 tx=0).stop 2024-09-21T13:35:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 -- 172.21.15.2:0/3534243120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50041018e0 msgr2=0x7f500406b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:35:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 --2- 172.21.15.2:0/3534243120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50041018e0 0x7f500406b3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5000005ec0 tx=0x7f5000003c10 comp rx=0 tx=0).stop 2024-09-21T13:35:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 -- 172.21.15.2:0/3534243120 shutdown_connections 2024-09-21T13:35:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 --2- 172.21.15.2:0/3534243120 >> v2:172.21.15.2:6800/3897423974 conn(0x7f4ff007af90 0x7f4ff007d450 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 --2- 172.21.15.2:0/3534243120 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5004103400 0x7f500419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 --2- 172.21.15.2:0/3534243120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5004102a40 0x7f500419d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 --2- 172.21.15.2:0/3534243120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50041018e0 0x7f500406b3c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 -- 172.21.15.2:0/3534243120 >> 172.21.15.2:0/3534243120 conn(0x7f50040fd1b0 msgr2=0x7f50040fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:35:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 -- 172.21.15.2:0/3534243120 shutdown_connections 2024-09-21T13:35:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:48.682+0000 7f500c53c640 1 -- 172.21.15.2:0/3534243120 wait complete. 2024-09-21T13:35:49.280 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[30076]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:49.281 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[30076]: from='osd.1 v2:172.21.15.2:6805/2166392982' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T13:35:49.281 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[30076]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T13:35:49.281 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:49.281 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:49.281 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:49.281 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[40622]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:49.281 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[40622]: from='osd.1 v2:172.21.15.2:6805/2166392982' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T13:35:49.281 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[40622]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T13:35:49.281 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:49.282 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:49.282 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:49.310 DEBUG:teuthology.orchestra.run.smithi002:osd.1> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.1.service 2024-09-21T13:35:49.313 INFO:tasks.cephadm:Deploying osd.2 on smithi002 with /dev/vg_nvme/lv_2... 2024-09-21T13:35:49.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T13:35:49.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:49 smithi162 ceph-mon[33046]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:49.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:49 smithi162 ceph-mon[33046]: from='osd.1 v2:172.21.15.2:6805/2166392982' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T13:35:49.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:49 smithi162 ceph-mon[33046]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T13:35:49.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:35:49.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:49.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:50.060 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:35:50.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:50 smithi162 ceph-mon[33046]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T13:35:50.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:50 smithi162 ceph-mon[33046]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T13:35:50.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:50.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:50 smithi162 ceph-mon[33046]: from='osd.1 v2:172.21.15.2:6805/2166392982' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:50.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:50 smithi162 ceph-mon[33046]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:50.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-mon[30076]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T13:35:50.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-mon[30076]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T13:35:50.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:50.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-mon[30076]: from='osd.1 v2:172.21.15.2:6805/2166392982' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:50.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-mon[30076]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:50.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-mon[40622]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T13:35:50.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-mon[40622]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T13:35:50.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:50.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-mon[40622]: from='osd.1 v2:172.21.15.2:6805/2166392982' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:50.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-mon[40622]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:35:50.601 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1[50496]: 2024-09-21T13:35:50.191+0000 7f52bbbfe640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T13:35:50.601 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:35:50 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1[50496]: 2024-09-21T13:35:50.194+0000 7f52b7a25640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:35:51.420 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:51 smithi002 ceph-mon[40622]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:51.420 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:51 smithi002 ceph-mon[40622]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:35:51.420 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:51 smithi002 ceph-mon[40622]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T13:35:51.421 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:51 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:51.421 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:51 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:51.421 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:51 smithi002 ceph-mon[30076]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:51.421 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:51 smithi002 ceph-mon[30076]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:35:51.421 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:51 smithi002 ceph-mon[30076]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T13:35:51.421 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:51 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:51.421 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:51 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:51.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:51 smithi162 ceph-mon[33046]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:51.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:51 smithi162 ceph-mon[33046]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:35:51.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:51 smithi162 ceph-mon[33046]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T13:35:51.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:51 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:51.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:51 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:52.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:52 smithi002 ceph-mon[30076]: purged_snaps scrub starts 2024-09-21T13:35:52.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:52 smithi002 ceph-mon[30076]: purged_snaps scrub ok 2024-09-21T13:35:52.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:52 smithi002 ceph-mon[30076]: osd.1 v2:172.21.15.2:6805/2166392982 boot 2024-09-21T13:35:52.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:52 smithi002 ceph-mon[30076]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T13:35:52.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:52 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:52.455 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:52 smithi002 ceph-mon[40622]: purged_snaps scrub starts 2024-09-21T13:35:52.455 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:52 smithi002 ceph-mon[40622]: purged_snaps scrub ok 2024-09-21T13:35:52.455 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:52 smithi002 ceph-mon[40622]: osd.1 v2:172.21.15.2:6805/2166392982 boot 2024-09-21T13:35:52.455 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:52 smithi002 ceph-mon[40622]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T13:35:52.456 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:52 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:52.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:52 smithi162 ceph-mon[33046]: purged_snaps scrub starts 2024-09-21T13:35:52.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:52 smithi162 ceph-mon[33046]: purged_snaps scrub ok 2024-09-21T13:35:52.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:52 smithi162 ceph-mon[33046]: osd.1 v2:172.21.15.2:6805/2166392982 boot 2024-09-21T13:35:52.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:52 smithi162 ceph-mon[33046]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T13:35:52.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:52 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:35:53.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[30076]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:53.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[30076]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T13:35:53.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:53.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:53.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:35:53.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:35:53.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:53.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:53.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:53.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:53.352 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[40622]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:53.352 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[40622]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T13:35:53.352 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:53.352 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:53.352 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:35:53.352 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:35:53.352 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:53.352 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:53.352 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:53.352 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:53.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:53 smithi162 ceph-mon[33046]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T13:35:53.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:53 smithi162 ceph-mon[33046]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T13:35:53.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:53.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:53.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:35:53.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:35:53.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:53.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:53.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:35:53.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:35:54.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:54 smithi002 ceph-mon[30076]: Detected new or changed devices on smithi002 2024-09-21T13:35:54.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:54 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi002 to 8034M 2024-09-21T13:35:54.469 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:54 smithi002 ceph-mon[40622]: Detected new or changed devices on smithi002 2024-09-21T13:35:54.469 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:54 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi002 to 8034M 2024-09-21T13:35:54.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:54 smithi162 ceph-mon[33046]: Detected new or changed devices on smithi002 2024-09-21T13:35:54.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:54 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi002 to 8034M 2024-09-21T13:35:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:35:54.789 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2024-09-21T13:35:55.045 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:35:55.445 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:55 smithi002 ceph-mon[40622]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:35:55.445 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:55 smithi002 ceph-mon[30076]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:35:55.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:55 smithi162 ceph-mon[33046]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:35:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.532+0000 7f28e5681640 1 -- 172.21.15.2:0/2392626979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0103440 msgr2=0x7f28e0109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:35:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.532+0000 7f28e5681640 1 --2- 172.21.15.2:0/2392626979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0103440 0x7f28e0109dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009c10 tx=0x7f28d802a6e0 comp rx=0 tx=0).stop 2024-09-21T13:35:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.532+0000 7f28e5681640 1 -- 172.21.15.2:0/2392626979 shutdown_connections 2024-09-21T13:35:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.532+0000 7f28e5681640 1 --2- 172.21.15.2:0/2392626979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0103440 0x7f28e0109dc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.532+0000 7f28e5681640 1 --2- 172.21.15.2:0/2392626979 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f28e0102a80 0x7f28e0102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.532+0000 7f28e5681640 1 --2- 172.21.15.2:0/2392626979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e0101920 0x7f28e0101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.532+0000 7f28e5681640 1 -- 172.21.15.2:0/2392626979 >> 172.21.15.2:0/2392626979 conn(0x7f28e00fd1d0 msgr2=0x7f28e00ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.532+0000 7f28e5681640 1 -- 172.21.15.2:0/2392626979 shutdown_connections 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28e5681640 1 -- 172.21.15.2:0/2392626979 wait complete. 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28e5681640 1 Processor -- start 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28e5681640 1 -- start start 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28e5681640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f28e0101920 0x7f28e01056e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28e5681640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e0102a80 0x7f28e0103f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28e5681640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0103440 0x7f28e0104490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28e5681640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28e010cc30 con 0x7f28e0103440 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28e5681640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28e010cab0 con 0x7f28e0102a80 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28e5681640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f28e010cdb0 con 0x7f28e0101920 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28deffd640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f28e0101920 0x7f28e01056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28deffd640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f28e0101920 0x7f28e01056e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:40204/0 (socket says 172.21.15.2:40204) 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28deffd640 1 -- 172.21.15.2:0/3873568258 learned_addr learned my addr 172.21.15.2:0/3873568258 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:35:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.533+0000 7f28df7fe640 1 --2- 172.21.15.2:0/3873568258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0103440 0x7f28e0104490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28d7fff640 1 --2- 172.21.15.2:0/3873568258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e0102a80 0x7f28e0103f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28deffd640 1 -- 172.21.15.2:0/3873568258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e0102a80 msgr2=0x7f28e0103f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28deffd640 1 --2- 172.21.15.2:0/3873568258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e0102a80 0x7f28e0103f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28deffd640 1 -- 172.21.15.2:0/3873568258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0103440 msgr2=0x7f28e0104490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28deffd640 1 --2- 172.21.15.2:0/3873568258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0103440 0x7f28e0104490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28deffd640 1 -- 172.21.15.2:0/3873568258 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e0104d50 con 0x7f28e0101920 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28df7fe640 1 --2- 172.21.15.2:0/3873568258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0103440 0x7f28e0104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28deffd640 1 --2- 172.21.15.2:0/3873568258 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f28e0101920 0x7f28e01056e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f28d000d950 tx=0x7f28d000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28dcff9640 1 -- 172.21.15.2:0/3873568258 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0017070 con 0x7f28e0101920 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28dcff9640 1 -- 172.21.15.2:0/3873568258 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f28d0009c30 con 0x7f28e0101920 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28dcff9640 1 -- 172.21.15.2:0/3873568258 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d000f620 con 0x7f28e0101920 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28e5681640 1 -- 172.21.15.2:0/3873568258 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e01a2600 con 0x7f28e0101920 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.534+0000 7f28e5681640 1 -- 172.21.15.2:0/3873568258 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e01a2b60 con 0x7f28e0101920 2024-09-21T13:35:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.535+0000 7f28e5681640 1 -- 172.21.15.2:0/3873568258 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e0101d20 con 0x7f28e0101920 2024-09-21T13:35:55.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.536+0000 7f28dcff9640 1 -- 172.21.15.2:0/3873568258 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 14) ==== 103141+0+0 (secure 0 0 0) 0x7f28d0010460 con 0x7f28e0101920 2024-09-21T13:35:55.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.537+0000 7f28dcff9640 1 --2- 172.21.15.2:0/3873568258 >> v2:172.21.15.2:6800/3897423974 conn(0x7f28cc07af90 0x7f28cc07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:35:55.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.537+0000 7f28d7fff640 1 --2- 172.21.15.2:0/3873568258 >> v2:172.21.15.2:6800/3897423974 conn(0x7f28cc07af90 0x7f28cc07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:35:55.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.537+0000 7f28dcff9640 1 -- 172.21.15.2:0/3873568258 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 1833+0+0 (secure 0 0 0) 0x7f28d009cb40 con 0x7f28e0101920 2024-09-21T13:35:55.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.537+0000 7f28d7fff640 1 --2- 172.21.15.2:0/3873568258 >> v2:172.21.15.2:6800/3897423974 conn(0x7f28cc07af90 0x7f28cc07d450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009530 tx=0x7f28c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:35:55.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.541+0000 7f28dcff9640 1 -- 172.21.15.2:0/3873568258 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28d0069380 con 0x7f28e0101920 2024-09-21T13:35:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:35:55.740+0000 7f28e5681640 1 -- 172.21.15.2:0/3873568258 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f28e002e840 con 0x7f28cc07af90 2024-09-21T13:35:56.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:56 smithi002 ceph-mon[30076]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:35:56.457 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:56 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:35:56.457 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:56 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:35:56.457 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:56 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:56.457 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:56 smithi002 ceph-mon[40622]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:35:56.457 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:56 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:35:56.457 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:56 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:35:56.457 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:56 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:56.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:56 smithi162 ceph-mon[33046]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:35:56.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:56 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:35:56.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:56 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:35:56.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:56 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:35:57.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:57 smithi002 ceph-mon[30076]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:35:57.335 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:57 smithi002 ceph-mon[40622]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:35:57.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:57 smithi162 ceph-mon[33046]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:35:58.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1057649858' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0a2b34c3-05ed-4d0d-9552-6656b9fe2419"} : dispatch 2024-09-21T13:35:58.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0a2b34c3-05ed-4d0d-9552-6656b9fe2419"} : dispatch 2024-09-21T13:35:58.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a2b34c3-05ed-4d0d-9552-6656b9fe2419"}]': finished 2024-09-21T13:35:58.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:58 smithi162 ceph-mon[33046]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T13:35:58.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:58 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:35:58.492 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1057649858' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0a2b34c3-05ed-4d0d-9552-6656b9fe2419"} : dispatch 2024-09-21T13:35:58.492 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0a2b34c3-05ed-4d0d-9552-6656b9fe2419"} : dispatch 2024-09-21T13:35:58.492 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a2b34c3-05ed-4d0d-9552-6656b9fe2419"}]': finished 2024-09-21T13:35:58.492 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:58 smithi002 ceph-mon[30076]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T13:35:58.492 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:35:58.492 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1057649858' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0a2b34c3-05ed-4d0d-9552-6656b9fe2419"} : dispatch 2024-09-21T13:35:58.492 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0a2b34c3-05ed-4d0d-9552-6656b9fe2419"} : dispatch 2024-09-21T13:35:58.492 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a2b34c3-05ed-4d0d-9552-6656b9fe2419"}]': finished 2024-09-21T13:35:58.492 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:58 smithi002 ceph-mon[40622]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T13:35:58.493 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:58 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:35:59.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:59 smithi162 ceph-mon[33046]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:35:59.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:35:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1123752346' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:35:59.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:59 smithi002 ceph-mon[30076]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:35:59.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:35:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1123752346' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:35:59.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:59 smithi002 ceph-mon[40622]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:35:59.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:35:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1123752346' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:36:01.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:01 smithi162 ceph-mon[33046]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:01.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:01 smithi002 ceph-mon[30076]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:01.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:01 smithi002 ceph-mon[40622]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:03.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:03 smithi002 ceph-mon[30076]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:03.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:03 smithi002 ceph-mon[40622]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:03.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:03 smithi162 ceph-mon[33046]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:05.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:05 smithi162 ceph-mon[33046]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:05.505 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:05 smithi002 ceph-mon[30076]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:05.505 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:05 smithi002 ceph-mon[40622]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:06.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:06 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T13:36:06.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:06 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:06.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:06 smithi162 ceph-mon[33046]: Deploying daemon osd.2 on smithi002 2024-09-21T13:36:06.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:06 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T13:36:06.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:06 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:06.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:06 smithi002 ceph-mon[30076]: Deploying daemon osd.2 on smithi002 2024-09-21T13:36:06.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:06 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T13:36:06.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:06 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:06.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:06 smithi002 ceph-mon[40622]: Deploying daemon osd.2 on smithi002 2024-09-21T13:36:07.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:07 smithi162 ceph-mon[33046]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:07.527 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:07 smithi002 ceph-mon[30076]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:07.528 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:07 smithi002 ceph-mon[40622]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:09.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:09 smithi002 ceph-mon[30076]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:09.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:09 smithi002 ceph-mon[40622]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:09.485 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:09 smithi162 ceph-mon[33046]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:11.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:11 smithi162 ceph-mon[33046]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:11.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:11 smithi002 ceph-mon[40622]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:11.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:11 smithi002 ceph-mon[30076]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:13.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:13 smithi162 ceph-mon[33046]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:13.591 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:13 smithi002 ceph-mon[30076]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:13.591 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:13 smithi002 ceph-mon[40622]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:14.573 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:14.573 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:14.573 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:14.573 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:14 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:14.573 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:14 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:14.574 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:14 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:14 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:14 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:14 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:15.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:15 smithi002 ceph-mon[30076]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:15.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:15 smithi002 ceph-mon[40622]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:16.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:15 smithi162 ceph-mon[33046]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:18.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[30076]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:18.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:18.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:18.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:18.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:18.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:18.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[40622]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:18.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:18.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:18.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:18.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:18.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:17 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:17 smithi162 ceph-mon[33046]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:17 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:17 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:17 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:17 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:17 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:18.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:18 smithi002 ceph-mon[30076]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T13:36:18.844 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:18 smithi002 ceph-mon[40622]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T13:36:19.174 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 2 on host 'smithi002' 2024-09-21T13:36:19.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.172+0000 7f28dcff9640 1 -- 172.21.15.2:0/3873568258 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f28e002e840 con 0x7f28cc07af90 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 -- 172.21.15.2:0/3873568258 >> v2:172.21.15.2:6800/3897423974 conn(0x7f28cc07af90 msgr2=0x7f28cc07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 --2- 172.21.15.2:0/3873568258 >> v2:172.21.15.2:6800/3897423974 conn(0x7f28cc07af90 0x7f28cc07d450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009530 tx=0x7f28c8009260 comp rx=0 tx=0).stop 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 -- 172.21.15.2:0/3873568258 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f28e0101920 msgr2=0x7f28e01056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 --2- 172.21.15.2:0/3873568258 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f28e0101920 0x7f28e01056e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f28d000d950 tx=0x7f28d000de10 comp rx=0 tx=0).stop 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 -- 172.21.15.2:0/3873568258 shutdown_connections 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 --2- 172.21.15.2:0/3873568258 >> v2:172.21.15.2:6800/3897423974 conn(0x7f28cc07af90 0x7f28cc07d450 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 --2- 172.21.15.2:0/3873568258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0103440 0x7f28e0104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 --2- 172.21.15.2:0/3873568258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e0102a80 0x7f28e0103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 --2- 172.21.15.2:0/3873568258 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f28e0101920 0x7f28e01056e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 -- 172.21.15.2:0/3873568258 >> 172.21.15.2:0/3873568258 conn(0x7f28e00fd1d0 msgr2=0x7f28e006bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 -- 172.21.15.2:0/3873568258 shutdown_connections 2024-09-21T13:36:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:19.175+0000 7f28e5681640 1 -- 172.21.15.2:0/3873568258 wait complete. 2024-09-21T13:36:19.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:18 smithi162 ceph-mon[33046]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T13:36:19.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[30076]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:19.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[30076]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T13:36:19.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[30076]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T13:36:19.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[30076]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[40622]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[40622]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[40622]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[40622]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:19.941 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:19 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:19.971 DEBUG:teuthology.orchestra.run.smithi002:osd.2> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.2.service 2024-09-21T13:36:19.974 INFO:tasks.cephadm:Deploying osd.3 on smithi002 with /dev/vg_nvme/lv_1... 2024-09-21T13:36:19.974 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T13:36:20.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:19 smithi162 ceph-mon[33046]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:20.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:19 smithi162 ceph-mon[33046]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T13:36:20.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:19 smithi162 ceph-mon[33046]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T13:36:20.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:19 smithi162 ceph-mon[33046]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:36:20.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:19 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:20.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:19 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:20.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:19 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:20.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:19 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:36:21.011 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:20 smithi002 ceph-mon[30076]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:36:21.012 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:20 smithi002 ceph-mon[30076]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T13:36:21.012 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:20 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:21.012 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:20 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:21.012 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:20 smithi002 ceph-mon[40622]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:36:21.012 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:20 smithi002 ceph-mon[40622]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T13:36:21.012 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:20 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:21.012 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:20 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:21.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:20 smithi162 ceph-mon[33046]: from='osd.2 v2:172.21.15.2:6809/3095985277' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:36:21.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:20 smithi162 ceph-mon[33046]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T13:36:21.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:20 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:21.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:20 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:21.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[30076]: purged_snaps scrub starts 2024-09-21T13:36:21.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[30076]: purged_snaps scrub ok 2024-09-21T13:36:21.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[30076]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:21.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:21.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[30076]: osd.2 v2:172.21.15.2:6809/3095985277 boot 2024-09-21T13:36:21.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[30076]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T13:36:21.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:21.970 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[40622]: purged_snaps scrub starts 2024-09-21T13:36:21.970 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[40622]: purged_snaps scrub ok 2024-09-21T13:36:21.970 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[40622]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:21.971 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:21.971 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[40622]: osd.2 v2:172.21.15.2:6809/3095985277 boot 2024-09-21T13:36:21.971 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[40622]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T13:36:21.971 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:21 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:22.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:21 smithi162 ceph-mon[33046]: purged_snaps scrub starts 2024-09-21T13:36:22.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:21 smithi162 ceph-mon[33046]: purged_snaps scrub ok 2024-09-21T13:36:22.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:21 smithi162 ceph-mon[33046]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T13:36:22.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:21 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:22.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:21 smithi162 ceph-mon[33046]: osd.2 v2:172.21.15.2:6809/3095985277 boot 2024-09-21T13:36:22.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:21 smithi162 ceph-mon[33046]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T13:36:22.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:21 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:36:23.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:22 smithi002 ceph-mon[30076]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T13:36:23.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:22 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:36:23.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:22 smithi002 ceph-mon[40622]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T13:36:23.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:22 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:36:23.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:22 smithi162 ceph-mon[33046]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T13:36:23.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:22 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:36:23.949 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59963]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T13:36:23.949 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59963]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:23.949 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:23.949 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59963]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:23.949 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:23.949 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T13:36:23.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T13:36:23.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:36:23.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:23.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:23.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:23.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:23.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:23.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:23.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:23.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:23.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:23.951 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:23.952 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59957]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T13:36:23.952 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59957]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:23.952 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:23.952 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59957]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:23.952 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59960]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T13:36:23.952 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59960]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:23.952 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:23.952 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59960]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:24.060 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:24.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:24.202 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59966]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T13:36:24.202 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59966]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:24.202 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:24.202 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59966]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:24.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59979]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T13:36:24.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59979]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:24.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:24.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59979]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:24.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59985]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T13:36:24.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59985]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:24.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:24.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59985]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:24.203 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59997]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T13:36:24.203 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59997]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:24.204 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:24.204 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59997]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:24.204 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[60000]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T13:36:24.204 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[60000]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:24.204 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[60000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:24.204 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[60000]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:24.204 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59969]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T13:36:24.204 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59969]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:24.204 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:24.204 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:36:23 smithi002 sudo[59969]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:24.204 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59973]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T13:36:24.204 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59973]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:24.205 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:24.205 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:36:24 smithi002 sudo[59973]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 sudo[35162]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T13:36:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 sudo[35162]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 sudo[35162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 sudo[35162]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 sudo[35165]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T13:36:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 sudo[35165]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T13:36:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 sudo[35165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T13:36:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 sudo[35165]: pam_unix(sudo:session): session closed for user root 2024-09-21T13:36:25.068 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: Detected new or changed devices on smithi002 2024-09-21T13:36:25.068 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi002 to 5356M 2024-09-21T13:36:25.068 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T13:36:25.068 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:36:25.069 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:36:25.070 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:36:25.070 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[40622]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T13:36:25.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: Detected new or changed devices on smithi002 2024-09-21T13:36:25.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi002 to 5356M 2024-09-21T13:36:25.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T13:36:25.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T13:36:25.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:25.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T13:36:25.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T13:36:25.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:36:25.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:36:25.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:24 smithi002 ceph-mon[30076]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T13:36:25.072 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:36:25.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi002:vg_nvme/lv_1 2024-09-21T13:36:25.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: Detected new or changed devices on smithi002 2024-09-21T13:36:25.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi002 to 5356M 2024-09-21T13:36:25.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:36:25.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T13:36:25.235 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:25.235 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T13:36:25.235 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:36:25.235 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:36:25.235 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:36:25.235 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:24 smithi162 ceph-mon[33046]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T13:36:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:36:25.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.835+0000 7fc5193cb640 1 -- 172.21.15.2:0/3496373378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc514108730 msgr2=0x7fc51410abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:36:25.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.835+0000 7fc5193cb640 1 --2- 172.21.15.2:0/3496373378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc514108730 0x7fc51410abf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009910 tx=0x7fc50c02a3f0 comp rx=0 tx=0).stop 2024-09-21T13:36:25.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.835+0000 7fc5193cb640 1 -- 172.21.15.2:0/3496373378 shutdown_connections 2024-09-21T13:36:25.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.835+0000 7fc5193cb640 1 --2- 172.21.15.2:0/3496373378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc514108730 0x7fc51410abf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.835+0000 7fc5193cb640 1 --2- 172.21.15.2:0/3496373378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc514105b80 0x7fc514107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.835+0000 7fc5193cb640 1 --2- 172.21.15.2:0/3496373378 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fc51406c030 0x7fc5141055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.835+0000 7fc5193cb640 1 -- 172.21.15.2:0/3496373378 >> 172.21.15.2:0/3496373378 conn(0x7fc5140fd200 msgr2=0x7fc5140ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.835+0000 7fc5193cb640 1 -- 172.21.15.2:0/3496373378 shutdown_connections 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.835+0000 7fc5193cb640 1 -- 172.21.15.2:0/3496373378 wait complete. 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.836+0000 7fc5193cb640 1 Processor -- start 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.836+0000 7fc5193cb640 1 -- start start 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.836+0000 7fc5193cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc51406c030 0x7fc514102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.836+0000 7fc5193cb640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fc514105b80 0x7fc514101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.836+0000 7fc5193cb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc514108730 0x7fc514101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.836+0000 7fc5193cb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc51410dd50 con 0x7fc51406c030 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.836+0000 7fc5193cb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc51410dbd0 con 0x7fc514108730 2024-09-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.836+0000 7fc5193cb640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fc51410ded0 con 0x7fc514105b80 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc5127fc640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fc514105b80 0x7fc514101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc5127fc640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fc514105b80 0x7fc514101590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:46232/0 (socket says 172.21.15.2:46232) 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc5127fc640 1 -- 172.21.15.2:0/1617021091 learned_addr learned my addr 172.21.15.2:0/1617021091 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc512ffd640 1 --2- 172.21.15.2:0/1617021091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc51406c030 0x7fc514102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc5137fe640 1 --2- 172.21.15.2:0/1617021091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc514108730 0x7fc514101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc5127fc640 1 -- 172.21.15.2:0/1617021091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc514108730 msgr2=0x7fc514101ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc5127fc640 1 --2- 172.21.15.2:0/1617021091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc514108730 0x7fc514101ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc5127fc640 1 -- 172.21.15.2:0/1617021091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc51406c030 msgr2=0x7fc514102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc5127fc640 1 --2- 172.21.15.2:0/1617021091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc51406c030 0x7fc514102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc5127fc640 1 -- 172.21.15.2:0/1617021091 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc514102390 con 0x7fc514105b80 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc512ffd640 1 --2- 172.21.15.2:0/1617021091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc51406c030 0x7fc514102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc5127fc640 1 --2- 172.21.15.2:0/1617021091 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fc514105b80 0x7fc514101590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc50800ea80 tx=0x7fc50800ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:36:25.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc4fbfff640 1 -- 172.21.15.2:0/1617021091 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50800ce40 con 0x7fc514105b80 2024-09-21T13:36:25.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc5193cb640 1 -- 172.21.15.2:0/1617021091 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5141a2630 con 0x7fc514105b80 2024-09-21T13:36:25.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.837+0000 7fc4fbfff640 1 -- 172.21.15.2:0/1617021091 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fc5080118f0 con 0x7fc514105b80 2024-09-21T13:36:25.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.838+0000 7fc5193cb640 1 -- 172.21.15.2:0/1617021091 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5141a2b90 con 0x7fc514105b80 2024-09-21T13:36:25.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.838+0000 7fc4fbfff640 1 -- 172.21.15.2:0/1617021091 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50801a980 con 0x7fc514105b80 2024-09-21T13:36:25.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.839+0000 7fc5193cb640 1 -- 172.21.15.2:0/1617021091 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc51410e4f0 con 0x7fc514105b80 2024-09-21T13:36:25.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.839+0000 7fc4fbfff640 1 -- 172.21.15.2:0/1617021091 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7fc508011470 con 0x7fc514105b80 2024-09-21T13:36:25.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.840+0000 7fc4fbfff640 1 --2- 172.21.15.2:0/1617021091 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc4fc07b020 0x7fc4fc07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:36:25.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.840+0000 7fc4fbfff640 1 -- 172.21.15.2:0/1617021091 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 2511+0+0 (secure 0 0 0) 0x7fc50809d810 con 0x7fc514105b80 2024-09-21T13:36:25.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.840+0000 7fc512ffd640 1 --2- 172.21.15.2:0/1617021091 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc4fc07b020 0x7fc4fc07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:36:25.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.840+0000 7fc512ffd640 1 --2- 172.21.15.2:0/1617021091 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc4fc07b020 0x7fc4fc07d4e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5040095f0 tx=0x7fc504005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:36:25.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:25.845+0000 7fc4fbfff640 1 -- 172.21.15.2:0/1617021091 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc508016030 con 0x7fc514105b80 2024-09-21T13:36:26.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:26.048+0000 7fc5193cb640 1 -- 172.21.15.2:0/1617021091 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc51402e7f0 con 0x7fc4fc07b020 2024-09-21T13:36:26.050 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:25 smithi002 ceph-mon[30076]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:26.050 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:25 smithi002 ceph-mon[30076]: osdmap e22: 3 total, 3 up, 3 in 2024-09-21T13:36:26.050 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:25 smithi002 ceph-mon[30076]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-21T13:36:26.050 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:25 smithi002 ceph-mon[40622]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:26.050 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:25 smithi002 ceph-mon[40622]: osdmap e22: 3 total, 3 up, 3 in 2024-09-21T13:36:26.050 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:25 smithi002 ceph-mon[40622]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-21T13:36:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:25 smithi162 ceph-mon[33046]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:25 smithi162 ceph-mon[33046]: osdmap e22: 3 total, 3 up, 3 in 2024-09-21T13:36:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:25 smithi162 ceph-mon[33046]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-21T13:36:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:26 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:36:27.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:26 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:36:27.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:26 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:27.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:26 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:36:27.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:26 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:36:27.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:26 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:27.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:26 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:36:27.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:26 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:36:27.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:26 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:28.060 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:27 smithi002 ceph-mon[30076]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:36:28.060 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:27 smithi002 ceph-mon[30076]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:28.061 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:27 smithi002 ceph-mon[40622]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:36:28.061 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:27 smithi002 ceph-mon[40622]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:28.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:27 smithi162 ceph-mon[33046]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:36:28.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:27 smithi162 ceph-mon[33046]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:29.021 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2991489163' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4149f0d3-5d3e-4b2b-8112-533db72dba23"} : dispatch 2024-09-21T13:36:29.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4149f0d3-5d3e-4b2b-8112-533db72dba23"} : dispatch 2024-09-21T13:36:29.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4149f0d3-5d3e-4b2b-8112-533db72dba23"}]': finished 2024-09-21T13:36:29.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:28 smithi002 ceph-mon[30076]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T13:36:29.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:28 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:29.022 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2991489163' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4149f0d3-5d3e-4b2b-8112-533db72dba23"} : dispatch 2024-09-21T13:36:29.022 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4149f0d3-5d3e-4b2b-8112-533db72dba23"} : dispatch 2024-09-21T13:36:29.022 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4149f0d3-5d3e-4b2b-8112-533db72dba23"}]': finished 2024-09-21T13:36:29.022 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:28 smithi002 ceph-mon[40622]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T13:36:29.022 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:28 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2991489163' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4149f0d3-5d3e-4b2b-8112-533db72dba23"} : dispatch 2024-09-21T13:36:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4149f0d3-5d3e-4b2b-8112-533db72dba23"} : dispatch 2024-09-21T13:36:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4149f0d3-5d3e-4b2b-8112-533db72dba23"}]': finished 2024-09-21T13:36:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:28 smithi162 ceph-mon[33046]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T13:36:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:28 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:29 smithi002 ceph-mon[30076]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2965595152' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:36:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:29 smithi002 ceph-mon[40622]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2965595152' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:36:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:29 smithi162 ceph-mon[33046]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2965595152' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:36:32.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:31 smithi002 ceph-mon[30076]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:32.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:31 smithi002 ceph-mon[40622]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:31 smithi162 ceph-mon[33046]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:33.930 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:33 smithi002 ceph-mon[30076]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:33.931 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:33 smithi002 ceph-mon[40622]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:34.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:33 smithi162 ceph-mon[33046]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:36.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:35 smithi002 ceph-mon[30076]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:36.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:35 smithi002 ceph-mon[40622]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:36.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:35 smithi162 ceph-mon[33046]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:36 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T13:36:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:36 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:36.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:36 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T13:36:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:36 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:37.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:36 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T13:36:37.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:36 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:37.983 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:37 smithi002 ceph-mon[30076]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:37.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:37 smithi002 ceph-mon[30076]: Deploying daemon osd.3 on smithi002 2024-09-21T13:36:37.984 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:37 smithi002 ceph-mon[40622]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:37.984 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:37 smithi002 ceph-mon[40622]: Deploying daemon osd.3 on smithi002 2024-09-21T13:36:38.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:37 smithi162 ceph-mon[33046]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:38.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:37 smithi162 ceph-mon[33046]: Deploying daemon osd.3 on smithi002 2024-09-21T13:36:39.908 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:39 smithi002 ceph-mon[30076]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:39.909 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:39 smithi002 ceph-mon[40622]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:40.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:39 smithi162 ceph-mon[33046]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:41 smithi002 ceph-mon[30076]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:42.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:41 smithi002 ceph-mon[40622]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:42.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:41 smithi162 ceph-mon[33046]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:43.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:43 smithi002 ceph-mon[30076]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:43.895 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:43 smithi002 ceph-mon[40622]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:44.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:43 smithi162 ceph-mon[33046]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:45.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:45.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:45.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:45.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:46.029 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:45 smithi002 ceph-mon[30076]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:46.030 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:45 smithi002 ceph-mon[40622]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:46.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:45 smithi162 ceph-mon[33046]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[30076]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[40622]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:48.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:47 smithi162 ceph-mon[33046]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:48.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:48.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:48.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:48.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:48.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.698+0000 7fc4fbfff640 1 -- 172.21.15.2:0/1617021091 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc51402e7f0 con 0x7fc4fc07b020 2024-09-21T13:36:49.699 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 3 on host 'smithi002' 2024-09-21T13:36:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.700+0000 7fc5193cb640 1 -- 172.21.15.2:0/1617021091 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc4fc07b020 msgr2=0x7fc4fc07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:36:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.700+0000 7fc5193cb640 1 --2- 172.21.15.2:0/1617021091 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc4fc07b020 0x7fc4fc07d4e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5040095f0 tx=0x7fc504005f90 comp rx=0 tx=0).stop 2024-09-21T13:36:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.700+0000 7fc5193cb640 1 -- 172.21.15.2:0/1617021091 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fc514105b80 msgr2=0x7fc514101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:36:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.700+0000 7fc5193cb640 1 --2- 172.21.15.2:0/1617021091 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fc514105b80 0x7fc514101590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc50800ea80 tx=0x7fc50800ef40 comp rx=0 tx=0).stop 2024-09-21T13:36:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.700+0000 7fc5193cb640 1 -- 172.21.15.2:0/1617021091 shutdown_connections 2024-09-21T13:36:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.700+0000 7fc5193cb640 1 --2- 172.21.15.2:0/1617021091 >> v2:172.21.15.2:6800/3897423974 conn(0x7fc4fc07b020 0x7fc4fc07d4e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.700+0000 7fc5193cb640 1 --2- 172.21.15.2:0/1617021091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc514108730 0x7fc514101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.700+0000 7fc5193cb640 1 --2- 172.21.15.2:0/1617021091 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fc514105b80 0x7fc514101590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.700+0000 7fc5193cb640 1 --2- 172.21.15.2:0/1617021091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc51406c030 0x7fc514102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.700+0000 7fc5193cb640 1 -- 172.21.15.2:0/1617021091 >> 172.21.15.2:0/1617021091 conn(0x7fc5140fd200 msgr2=0x7fc514103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:36:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.701+0000 7fc5193cb640 1 -- 172.21.15.2:0/1617021091 shutdown_connections 2024-09-21T13:36:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:36:49.701+0000 7fc5193cb640 1 -- 172.21.15.2:0/1617021091 wait complete. 2024-09-21T13:36:50.077 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[30076]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:50.077 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[30076]: from='osd.3 v2:172.21.15.2:6813/2270199396' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T13:36:50.077 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[30076]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T13:36:50.077 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:50.077 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:50.077 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:50.077 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[40622]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:50.077 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[40622]: from='osd.3 v2:172.21.15.2:6813/2270199396' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T13:36:50.077 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[40622]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T13:36:50.077 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:50.078 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:50.078 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:49 smithi162 ceph-mon[33046]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:49 smithi162 ceph-mon[33046]: from='osd.3 v2:172.21.15.2:6813/2270199396' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T13:36:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:49 smithi162 ceph-mon[33046]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T13:36:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:36:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:50.454 DEBUG:teuthology.orchestra.run.smithi002:osd.3> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.3.service 2024-09-21T13:36:50.456 INFO:tasks.cephadm:Deploying osd.4 on smithi162 with /dev/vg_nvme/lv_4... 2024-09-21T13:36:50.456 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T13:36:50.710 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:36:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[30076]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T13:36:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[30076]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T13:36:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[30076]: from='osd.3 v2:172.21.15.2:6813/2270199396' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:36:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:51.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[30076]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:36:51.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[30076]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:36:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[40622]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T13:36:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[40622]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T13:36:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[40622]: from='osd.3 v2:172.21.15.2:6813/2270199396' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:36:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[40622]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:36:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:50 smithi002 ceph-mon[40622]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:36:51.142 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:50 smithi162 ceph-mon[33046]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T13:36:51.142 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:50 smithi162 ceph-mon[33046]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T13:36:51.142 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:50 smithi162 ceph-mon[33046]: from='osd.3 v2:172.21.15.2:6813/2270199396' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:36:51.142 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:50 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:51.142 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:50 smithi162 ceph-mon[33046]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-21T13:36:51.142 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:50 smithi162 ceph-mon[33046]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-21T13:36:51.475 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3[62290]: 2024-09-21T13:36:51.106+0000 7fef81b3c640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T13:36:51.475 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3[62290]: 2024-09-21T13:36:51.109+0000 7fef7995b640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:36:52.047 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:51 smithi162 ceph-mon[33046]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:52.047 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:51 smithi162 ceph-mon[33046]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T13:36:52.047 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:51 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:52.047 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:51 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:52.048 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:51 smithi162 ceph-mon[33046]: from='osd.3 ' entity='osd.3' 2024-09-21T13:36:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-mon[30076]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-mon[30076]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T13:36:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-mon[30076]: from='osd.3 ' entity='osd.3' 2024-09-21T13:36:52.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-mon[40622]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-mon[40622]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T13:36:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:51 smithi002 ceph-mon[40622]: from='osd.3 ' entity='osd.3' 2024-09-21T13:36:53.068 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:52 smithi162 ceph-mon[33046]: purged_snaps scrub starts 2024-09-21T13:36:53.068 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:52 smithi162 ceph-mon[33046]: purged_snaps scrub ok 2024-09-21T13:36:53.068 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:52 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:53.068 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:52 smithi162 ceph-mon[33046]: osd.3 v2:172.21.15.2:6813/2270199396 boot 2024-09-21T13:36:53.068 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:52 smithi162 ceph-mon[33046]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T13:36:53.068 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:52 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[30076]: purged_snaps scrub starts 2024-09-21T13:36:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[30076]: purged_snaps scrub ok 2024-09-21T13:36:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[30076]: osd.3 v2:172.21.15.2:6813/2270199396 boot 2024-09-21T13:36:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[30076]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T13:36:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[40622]: purged_snaps scrub starts 2024-09-21T13:36:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[40622]: purged_snaps scrub ok 2024-09-21T13:36:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[40622]: osd.3 v2:172.21.15.2:6813/2270199396 boot 2024-09-21T13:36:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[40622]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T13:36:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:52 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:36:53.364 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:36:53.388 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2024-09-21T13:36:53.629 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:36:54.057 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:54.057 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T13:36:54.057 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.058 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.058 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.058 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.058 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.058 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.058 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.058 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:54.058 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:54.058 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.055+0000 7f74a043d640 1 -- 172.21.15.162:0/2494111837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7498101e40 msgr2=0x7f7498102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:36:54.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.055+0000 7f74a043d640 1 --2- 172.21.15.162:0/2494111837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7498101e40 0x7f7498102240 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7490009900 tx=0x7f749002a410 comp rx=0 tx=0).stop 2024-09-21T13:36:54.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.055+0000 7f74a043d640 1 -- 172.21.15.162:0/2494111837 shutdown_connections 2024-09-21T13:36:54.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.055+0000 7f74a043d640 1 --2- 172.21.15.162:0/2494111837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7498103400 0x7f7498109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:54.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.055+0000 7f74a043d640 1 --2- 172.21.15.162:0/2494111837 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7498102860 0x7f7498102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.055+0000 7f74a043d640 1 --2- 172.21.15.162:0/2494111837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7498101e40 0x7f7498102240 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.055+0000 7f74a043d640 1 -- 172.21.15.162:0/2494111837 >> 172.21.15.162:0/2494111837 conn(0x7f74980fc940 msgr2=0x7f74980feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:36:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.056+0000 7f74a043d640 1 -- 172.21.15.162:0/2494111837 shutdown_connections 2024-09-21T13:36:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.056+0000 7f74a043d640 1 -- 172.21.15.162:0/2494111837 wait complete. 2024-09-21T13:36:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.056+0000 7f74a043d640 1 Processor -- start 2024-09-21T13:36:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.056+0000 7f74a043d640 1 -- start start 2024-09-21T13:36:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.056+0000 7f74a043d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7498101e40 0x7f749810c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:36:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.056+0000 7f74a043d640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7498102860 0x7f749810a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:36:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.056+0000 7f74a043d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7498103400 0x7f749810af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:36:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.056+0000 7f74a043d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f749810de30 con 0x7f7498103400 2024-09-21T13:36:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.056+0000 7f74a043d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f749810dcb0 con 0x7f7498101e40 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.056+0000 7f74a043d640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f749810dfb0 con 0x7f7498102860 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.056+0000 7f749e1d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7498101e40 0x7f749810c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f749e1d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7498101e40 0x7f749810c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41072/0 (socket says 172.21.15.162:41072) 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f749e1d9640 1 -- 172.21.15.162:0/2145072202 learned_addr learned my addr 172.21.15.162:0/2145072202 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f749e9da640 1 --2- 172.21.15.162:0/2145072202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7498103400 0x7f749810af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f749d9d8640 1 --2- 172.21.15.162:0/2145072202 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7498102860 0x7f749810a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f749e1d9640 1 -- 172.21.15.162:0/2145072202 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7498102860 msgr2=0x7f749810a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f749e1d9640 1 --2- 172.21.15.162:0/2145072202 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7498102860 0x7f749810a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f749e1d9640 1 -- 172.21.15.162:0/2145072202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7498103400 msgr2=0x7f749810af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f749e1d9640 1 --2- 172.21.15.162:0/2145072202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7498103400 0x7f749810af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f749e1d9640 1 -- 172.21.15.162:0/2145072202 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749810b7f0 con 0x7f7498101e40 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f749e9da640 1 --2- 172.21.15.162:0/2145072202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7498103400 0x7f749810af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f749e1d9640 1 --2- 172.21.15.162:0/2145072202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7498101e40 0x7f749810c180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7490006010 tx=0x7f7490032cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:36:54.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f74977fe640 1 -- 172.21.15.162:0/2145072202 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749003f030 con 0x7f7498101e40 2024-09-21T13:36:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f74977fe640 1 -- 172.21.15.162:0/2145072202 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7490005480 con 0x7f7498101e40 2024-09-21T13:36:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f74a043d640 1 -- 172.21.15.162:0/2145072202 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74981a2640 con 0x7f7498101e40 2024-09-21T13:36:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f74977fe640 1 -- 172.21.15.162:0/2145072202 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7490035070 con 0x7f7498101e40 2024-09-21T13:36:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.057+0000 7f74a043d640 1 -- 172.21.15.162:0/2145072202 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74981a2b70 con 0x7f7498101e40 2024-09-21T13:36:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.058+0000 7f74a043d640 1 -- 172.21.15.162:0/2145072202 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7498102240 con 0x7f7498101e40 2024-09-21T13:36:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.059+0000 7f74977fe640 1 -- 172.21.15.162:0/2145072202 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7f7490042030 con 0x7f7498101e40 2024-09-21T13:36:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.059+0000 7f74977fe640 1 --2- 172.21.15.162:0/2145072202 >> v2:172.21.15.2:6800/3897423974 conn(0x7f748007b020 0x7f748007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:36:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.059+0000 7f74977fe640 1 -- 172.21.15.162:0/2145072202 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 2803+0+0 (secure 0 0 0) 0x7f74900bde80 con 0x7f7498101e40 2024-09-21T13:36:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.060+0000 7f749d9d8640 1 --2- 172.21.15.162:0/2145072202 >> v2:172.21.15.2:6800/3897423974 conn(0x7f748007b020 0x7f748007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:36:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.060+0000 7f749d9d8640 1 --2- 172.21.15.162:0/2145072202 >> v2:172.21.15.2:6800/3897423974 conn(0x7f748007b020 0x7f748007d4e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f749806b450 tx=0x7f748c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:36:54.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.064+0000 7f74977fe640 1 -- 172.21.15.162:0/2145072202 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7490085db0 con 0x7f7498101e40 2024-09-21T13:36:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T13:36:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T13:36:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T13:36:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T13:36:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:36:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:36:54.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:36:54.253+0000 7f74a043d640 1 -- 172.21.15.162:0/2145072202 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7498063590 con 0x7f748007b020 2024-09-21T13:36:54.924 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:54 smithi162 ceph-mon[33046]: Detected new or changed devices on smithi002 2024-09-21T13:36:54.924 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:54 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi002 to 4017M 2024-09-21T13:36:54.924 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:36:54.924 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:36:54.924 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:54 smithi002 ceph-mon[40622]: Detected new or changed devices on smithi002 2024-09-21T13:36:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:54 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi002 to 4017M 2024-09-21T13:36:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:36:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:36:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:54 smithi002 ceph-mon[30076]: Detected new or changed devices on smithi002 2024-09-21T13:36:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:54 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi002 to 4017M 2024-09-21T13:36:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:36:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:36:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:36:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:55 smithi002 ceph-mon[30076]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:36:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:55 smithi002 ceph-mon[30076]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:36:56.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:55 smithi002 ceph-mon[40622]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:36:56.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:55 smithi002 ceph-mon[40622]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:36:56.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:55 smithi162 ceph-mon[33046]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:36:56.193 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:55 smithi162 ceph-mon[33046]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:36:57.098 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/3946837572' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21be965a-204b-4793-9f70-7929714c63d9"} : dispatch 2024-09-21T13:36:57.098 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21be965a-204b-4793-9f70-7929714c63d9"} : dispatch 2024-09-21T13:36:57.098 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21be965a-204b-4793-9f70-7929714c63d9"}]': finished 2024-09-21T13:36:57.098 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:56 smithi162 ceph-mon[33046]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T13:36:57.098 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:56 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:36:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/3946837572' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21be965a-204b-4793-9f70-7929714c63d9"} : dispatch 2024-09-21T13:36:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21be965a-204b-4793-9f70-7929714c63d9"} : dispatch 2024-09-21T13:36:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21be965a-204b-4793-9f70-7929714c63d9"}]': finished 2024-09-21T13:36:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:56 smithi002 ceph-mon[30076]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T13:36:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:56 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:36:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/3946837572' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21be965a-204b-4793-9f70-7929714c63d9"} : dispatch 2024-09-21T13:36:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21be965a-204b-4793-9f70-7929714c63d9"} : dispatch 2024-09-21T13:36:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21be965a-204b-4793-9f70-7929714c63d9"}]': finished 2024-09-21T13:36:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:56 smithi002 ceph-mon[40622]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T13:36:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:56 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:36:58.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:57 smithi162 ceph-mon[33046]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:36:58.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/1659443518' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:36:58.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:57 smithi002 ceph-mon[40622]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:36:58.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/1659443518' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:36:58.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:57 smithi002 ceph-mon[30076]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:36:58.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/1659443518' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:37:00.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:36:59 smithi162 ceph-mon[33046]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:00.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:36:59 smithi002 ceph-mon[30076]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:00.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:36:59 smithi002 ceph-mon[40622]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:01.909 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:01 smithi162 ceph-mon[33046]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:02.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:01 smithi002 ceph-mon[40622]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:02.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:01 smithi002 ceph-mon[30076]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:03 smithi162 ceph-mon[33046]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:03 smithi002 ceph-mon[30076]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:04.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:03 smithi002 ceph-mon[40622]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:05.201 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:04 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T13:37:05.202 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:04 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:05.202 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:04 smithi162 ceph-mon[33046]: Deploying daemon osd.4 on smithi162 2024-09-21T13:37:05.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:04 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T13:37:05.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:04 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:05.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:04 smithi002 ceph-mon[30076]: Deploying daemon osd.4 on smithi162 2024-09-21T13:37:05.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:04 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T13:37:05.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:04 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:05.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:04 smithi002 ceph-mon[40622]: Deploying daemon osd.4 on smithi162 2024-09-21T13:37:06.040 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:05 smithi162 ceph-mon[33046]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:05 smithi002 ceph-mon[30076]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:05 smithi002 ceph-mon[40622]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:08.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:07 smithi162 ceph-mon[33046]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:07 smithi002 ceph-mon[30076]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:07 smithi002 ceph-mon[40622]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:10.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:09 smithi162 ceph-mon[33046]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:10.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:09 smithi002 ceph-mon[30076]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:10.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:09 smithi002 ceph-mon[40622]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:11 smithi162 ceph-mon[33046]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:11 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:11 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:11 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:12.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:11 smithi002 ceph-mon[40622]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:12.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:11 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:12.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:11 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:12.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:11 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:12.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:11 smithi002 ceph-mon[30076]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:12.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:11 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:12.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:11 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:12.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:11 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:14.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:13 smithi002 ceph-mon[30076]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:14.153 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:13 smithi002 ceph-mon[40622]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:13 smithi162 ceph-mon[33046]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:15.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:15 smithi162 ceph-mon[33046]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:15.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:15 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:15.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:15 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:15.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:15 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:15.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:15 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:15.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:15 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:15.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[30076]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:15.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:15.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:15.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:15.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:15.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:15.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[40622]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:15.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:15.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:15.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:15.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:15.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:15 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:16.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.766+0000 7f74977fe640 1 -- 172.21.15.162:0/2145072202 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7498063590 con 0x7f748007b020 2024-09-21T13:37:16.767 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 4 on host 'smithi162' 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.768+0000 7f74a043d640 1 -- 172.21.15.162:0/2145072202 >> v2:172.21.15.2:6800/3897423974 conn(0x7f748007b020 msgr2=0x7f748007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.768+0000 7f74a043d640 1 --2- 172.21.15.162:0/2145072202 >> v2:172.21.15.2:6800/3897423974 conn(0x7f748007b020 0x7f748007d4e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f749806b450 tx=0x7f748c008040 comp rx=0 tx=0).stop 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.768+0000 7f74a043d640 1 -- 172.21.15.162:0/2145072202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7498101e40 msgr2=0x7f749810c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.768+0000 7f74a043d640 1 --2- 172.21.15.162:0/2145072202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7498101e40 0x7f749810c180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7490006010 tx=0x7f7490032cc0 comp rx=0 tx=0).stop 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.768+0000 7f74a043d640 1 -- 172.21.15.162:0/2145072202 shutdown_connections 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.768+0000 7f74a043d640 1 --2- 172.21.15.162:0/2145072202 >> v2:172.21.15.2:6800/3897423974 conn(0x7f748007b020 0x7f748007d4e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.768+0000 7f74a043d640 1 --2- 172.21.15.162:0/2145072202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7498103400 0x7f749810af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.768+0000 7f74a043d640 1 --2- 172.21.15.162:0/2145072202 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7498102860 0x7f749810a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.768+0000 7f74a043d640 1 --2- 172.21.15.162:0/2145072202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7498101e40 0x7f749810c180 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.768+0000 7f74a043d640 1 -- 172.21.15.162:0/2145072202 >> 172.21.15.162:0/2145072202 conn(0x7f74980fc940 msgr2=0x7f74980fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.768+0000 7f74a043d640 1 -- 172.21.15.162:0/2145072202 shutdown_connections 2024-09-21T13:37:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:16.769+0000 7f74a043d640 1 -- 172.21.15.162:0/2145072202 wait complete. 2024-09-21T13:37:17.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:17 smithi162 ceph-mon[33046]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:17.319 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:17 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:17.319 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:17 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:17.319 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:17 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:17.319 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:17 smithi162 ceph-mon[33046]: from='osd.4 v2:172.21.15.162:6800/2284803610' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T13:37:17.319 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:17 smithi162 ceph-mon[33046]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T13:37:17.354 DEBUG:teuthology.orchestra.run.smithi162:osd.4> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.4.service 2024-09-21T13:37:17.356 INFO:tasks.cephadm:Deploying osd.5 on smithi162 with /dev/vg_nvme/lv_3... 2024-09-21T13:37:17.356 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T13:37:17.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[30076]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:17.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:17.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:17.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:17.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[30076]: from='osd.4 v2:172.21.15.162:6800/2284803610' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T13:37:17.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[30076]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T13:37:17.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[40622]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:17.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:17.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:17.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:17.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[40622]: from='osd.4 v2:172.21.15.162:6800/2284803610' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T13:37:17.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:17 smithi002 ceph-mon[40622]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T13:37:18.002 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:37:18.962 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:18 smithi162 ceph-mon[33046]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T13:37:18.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:18 smithi162 ceph-mon[33046]: from='osd.4 v2:172.21.15.162:6800/2284803610' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:18.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:18 smithi162 ceph-mon[33046]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T13:37:18.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:18 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:18.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:18 smithi162 ceph-mon[33046]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:18.963 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:37:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:37:18.770+0000 7fddfc96e640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T13:37:18.963 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:37:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:37:18.775+0000 7fddf8795640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:37:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:18 smithi002 ceph-mon[30076]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T13:37:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:18 smithi002 ceph-mon[30076]: from='osd.4 v2:172.21.15.162:6800/2284803610' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:18 smithi002 ceph-mon[30076]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T13:37:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:18 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:18 smithi002 ceph-mon[30076]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:19.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:18 smithi002 ceph-mon[40622]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T13:37:19.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:18 smithi002 ceph-mon[40622]: from='osd.4 v2:172.21.15.162:6800/2284803610' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:19.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:18 smithi002 ceph-mon[40622]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T13:37:19.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:18 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:19.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:18 smithi002 ceph-mon[40622]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:19 smithi162 ceph-mon[33046]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:19 smithi162 ceph-mon[33046]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:37:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:19 smithi162 ceph-mon[33046]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T13:37:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:19 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:19 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:19 smithi162 ceph-mon[33046]: osd.4 v2:172.21.15.162:6800/2284803610 boot 2024-09-21T13:37:20.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[30076]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:20.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[30076]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:37:20.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[30076]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T13:37:20.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:20.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:20.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[30076]: osd.4 v2:172.21.15.162:6800/2284803610 boot 2024-09-21T13:37:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[40622]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-21T13:37:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[40622]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:37:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[40622]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T13:37:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:19 smithi002 ceph-mon[40622]: osd.4 v2:172.21.15.162:6800/2284803610 boot 2024-09-21T13:37:20.952 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:20 smithi162 ceph-mon[33046]: purged_snaps scrub starts 2024-09-21T13:37:20.952 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:20 smithi162 ceph-mon[33046]: purged_snaps scrub ok 2024-09-21T13:37:20.952 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:20 smithi162 ceph-mon[33046]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T13:37:20.952 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:20 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:20.953 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:20 smithi162 ceph-mon[33046]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T13:37:20.955 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:37:20.981 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2024-09-21T13:37:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:20 smithi002 ceph-mon[40622]: purged_snaps scrub starts 2024-09-21T13:37:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:20 smithi002 ceph-mon[40622]: purged_snaps scrub ok 2024-09-21T13:37:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:20 smithi002 ceph-mon[40622]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T13:37:21.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:20 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:21.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:20 smithi002 ceph-mon[40622]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T13:37:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:20 smithi002 ceph-mon[30076]: purged_snaps scrub starts 2024-09-21T13:37:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:20 smithi002 ceph-mon[30076]: purged_snaps scrub ok 2024-09-21T13:37:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:20 smithi002 ceph-mon[30076]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T13:37:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:20 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:37:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:20 smithi002 ceph-mon[30076]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T13:37:21.722 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:37:21.845 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:21 smithi162 ceph-mon[33046]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:21.845 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:21 smithi162 ceph-mon[33046]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T13:37:22.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:21 smithi002 ceph-mon[30076]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:22.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:21 smithi002 ceph-mon[30076]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T13:37:22.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:21 smithi002 ceph-mon[40622]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:21 smithi002 ceph-mon[40622]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T13:37:22.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.237+0000 7fa664fee640 1 -- 172.21.15.162:0/710420042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa660102850 msgr2=0x7fa660102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:37:22.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.237+0000 7fa664fee640 1 --2- 172.21.15.162:0/710420042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa660102850 0x7fa660102cd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa648009900 tx=0x7fa64802a3f0 comp rx=0 tx=0).stop 2024-09-21T13:37:22.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.237+0000 7fa664fee640 1 -- 172.21.15.162:0/710420042 shutdown_connections 2024-09-21T13:37:22.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.237+0000 7fa664fee640 1 --2- 172.21.15.162:0/710420042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6601033f0 0x7fa660109ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:22.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.237+0000 7fa664fee640 1 --2- 172.21.15.162:0/710420042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa660102850 0x7fa660102cd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:22.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.237+0000 7fa664fee640 1 --2- 172.21.15.162:0/710420042 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa660101ec0 0x7fa6601022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:22.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.237+0000 7fa664fee640 1 -- 172.21.15.162:0/710420042 >> 172.21.15.162:0/710420042 conn(0x7fa6600fc940 msgr2=0x7fa6600fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:37:22.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.237+0000 7fa664fee640 1 -- 172.21.15.162:0/710420042 shutdown_connections 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.237+0000 7fa664fee640 1 -- 172.21.15.162:0/710420042 wait complete. 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.238+0000 7fa664fee640 1 Processor -- start 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.238+0000 7fa664fee640 1 -- start start 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.238+0000 7fa664fee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa660101ec0 0x7fa6601983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.238+0000 7fa664fee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa660102850 0x7fa660198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.238+0000 7fa664fee640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa6601033f0 0x7fa660199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.238+0000 7fa664fee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa66010cc70 con 0x7fa660101ec0 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.238+0000 7fa664fee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa66010caf0 con 0x7fa660102850 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.238+0000 7fa664fee640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fa66010cdf0 con 0x7fa6601033f0 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.238+0000 7fa657fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa660102850 0x7fa660198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa657fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa660102850 0x7fa660198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:53808/0 (socket says 172.21.15.162:53808) 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa657fff640 1 -- 172.21.15.162:0/386384924 learned_addr learned my addr 172.21.15.162:0/386384924 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa65e59c640 1 --2- 172.21.15.162:0/386384924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa660101ec0 0x7fa6601983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:37:22.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa65ed9d640 1 --2- 172.21.15.162:0/386384924 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa6601033f0 0x7fa660199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:37:22.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa657fff640 1 -- 172.21.15.162:0/386384924 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa6601033f0 msgr2=0x7fa660199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:37:22.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa657fff640 1 --2- 172.21.15.162:0/386384924 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa6601033f0 0x7fa660199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:22.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa657fff640 1 -- 172.21.15.162:0/386384924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa660101ec0 msgr2=0x7fa6601983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:37:22.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa657fff640 1 --2- 172.21.15.162:0/386384924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa660101ec0 0x7fa6601983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:22.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa657fff640 1 -- 172.21.15.162:0/386384924 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa660199f10 con 0x7fa660102850 2024-09-21T13:37:22.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa65ed9d640 1 --2- 172.21.15.162:0/386384924 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa6601033f0 0x7fa660199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:37:22.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa657fff640 1 --2- 172.21.15.162:0/386384924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa660102850 0x7fa660198a30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa648006010 tx=0x7fa6480052b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:37:22.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa6577fe640 1 -- 172.21.15.162:0/386384924 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64803f070 con 0x7fa660102850 2024-09-21T13:37:22.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa664fee640 1 -- 172.21.15.162:0/386384924 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66019a1a0 con 0x7fa660102850 2024-09-21T13:37:22.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa6577fe640 1 -- 172.21.15.162:0/386384924 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fa6480054d0 con 0x7fa660102850 2024-09-21T13:37:22.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa6577fe640 1 -- 172.21.15.162:0/386384924 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648035030 con 0x7fa660102850 2024-09-21T13:37:22.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.239+0000 7fa664fee640 1 -- 172.21.15.162:0/386384924 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6601a0710 con 0x7fa660102850 2024-09-21T13:37:22.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.240+0000 7fa664fee640 1 -- 172.21.15.162:0/386384924 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6601022c0 con 0x7fa660102850 2024-09-21T13:37:22.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.241+0000 7fa6577fe640 1 -- 172.21.15.162:0/386384924 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7fa648042070 con 0x7fa660102850 2024-09-21T13:37:22.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.241+0000 7fa6577fe640 1 --2- 172.21.15.162:0/386384924 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa64c07b020 0x7fa64c07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:37:22.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.242+0000 7fa6577fe640 1 -- 172.21.15.162:0/386384924 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3205+0+0 (secure 0 0 0) 0x7fa6480be3f0 con 0x7fa660102850 2024-09-21T13:37:22.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.242+0000 7fa65e59c640 1 --2- 172.21.15.162:0/386384924 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa64c07b020 0x7fa64c07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:37:22.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.242+0000 7fa65e59c640 1 --2- 172.21.15.162:0/386384924 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa64c07b020 0x7fa64c07d4e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa65000abe0 tx=0x7fa65000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:37:22.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.246+0000 7fa6577fe640 1 -- 172.21.15.162:0/386384924 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa648086190 con 0x7fa660102850 2024-09-21T13:37:22.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:22.436+0000 7fa664fee640 1 -- 172.21.15.162:0/386384924 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa66002e880 con 0x7fa64c07b020 2024-09-21T13:37:23.037 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:22 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:37:23.037 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:22 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:37:23.038 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:22 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:22 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:37:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:22 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:37:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:22 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:22 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:37:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:22 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:37:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:22 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:23 smithi162 ceph-mon[33046]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:23 smithi162 ceph-mon[33046]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:37:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:23 smithi162 ceph-mon[33046]: Detected new or changed devices on smithi162 2024-09-21T13:37:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:37:23.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:23 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T13:37:23.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:23.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:23.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:23.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[40622]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[40622]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:37:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[40622]: Detected new or changed devices on smithi162 2024-09-21T13:37:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:37:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T13:37:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:24.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[30076]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:24.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[30076]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:37:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[30076]: Detected new or changed devices on smithi162 2024-09-21T13:37:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:37:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T13:37:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:25 smithi162 ceph-mon[33046]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T13:37:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/335840779' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "399a3f0f-876c-4ea2-abbc-799384e1ebb7"} : dispatch 2024-09-21T13:37:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "399a3f0f-876c-4ea2-abbc-799384e1ebb7"} : dispatch 2024-09-21T13:37:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "399a3f0f-876c-4ea2-abbc-799384e1ebb7"}]': finished 2024-09-21T13:37:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:25 smithi162 ceph-mon[33046]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T13:37:26.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:25 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:26.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/1372566357' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:37:26.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[30076]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T13:37:26.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/335840779' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "399a3f0f-876c-4ea2-abbc-799384e1ebb7"} : dispatch 2024-09-21T13:37:26.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "399a3f0f-876c-4ea2-abbc-799384e1ebb7"} : dispatch 2024-09-21T13:37:26.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "399a3f0f-876c-4ea2-abbc-799384e1ebb7"}]': finished 2024-09-21T13:37:26.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[30076]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T13:37:26.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:26.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/1372566357' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:37:26.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[40622]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T13:37:26.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/335840779' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "399a3f0f-876c-4ea2-abbc-799384e1ebb7"} : dispatch 2024-09-21T13:37:26.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "399a3f0f-876c-4ea2-abbc-799384e1ebb7"} : dispatch 2024-09-21T13:37:26.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "399a3f0f-876c-4ea2-abbc-799384e1ebb7"}]': finished 2024-09-21T13:37:26.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[40622]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T13:37:26.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:26.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/1372566357' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:37:28.201 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:27 smithi162 ceph-mon[33046]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T13:37:28.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:27 smithi002 ceph-mon[30076]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T13:37:28.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:27 smithi002 ceph-mon[40622]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T13:37:30.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:29 smithi162 ceph-mon[33046]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T13:37:30.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:29 smithi002 ceph-mon[30076]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T13:37:30.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:29 smithi002 ceph-mon[40622]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T13:37:32.189 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:31 smithi162 ceph-mon[33046]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-21T13:37:32.189 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:31 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T13:37:32.189 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:31 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:32.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:31 smithi002 ceph-mon[30076]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-21T13:37:32.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:31 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T13:37:32.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:31 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:32.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:31 smithi002 ceph-mon[40622]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-21T13:37:32.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:31 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T13:37:32.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:31 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:33.055 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:32 smithi162 ceph-mon[33046]: Deploying daemon osd.5 on smithi162 2024-09-21T13:37:33.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:32 smithi002 ceph-mon[30076]: Deploying daemon osd.5 on smithi162 2024-09-21T13:37:33.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:32 smithi002 ceph-mon[40622]: Deploying daemon osd.5 on smithi162 2024-09-21T13:37:34.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:33 smithi162 ceph-mon[33046]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T13:37:34.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:33 smithi002 ceph-mon[30076]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T13:37:34.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:33 smithi002 ceph-mon[40622]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T13:37:36.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:35 smithi162 ceph-mon[33046]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:36.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:35 smithi002 ceph-mon[30076]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:36.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:35 smithi002 ceph-mon[40622]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:38.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:37 smithi162 ceph-mon[33046]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:38.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:37 smithi002 ceph-mon[30076]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:38.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:37 smithi002 ceph-mon[40622]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:40.146 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:39 smithi162 ceph-mon[33046]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:40.146 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:39 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:40.146 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:39 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:40.146 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:39 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:40.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:39 smithi002 ceph-mon[30076]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:40.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:39 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:40.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:39 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:40.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:39 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:40.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:39 smithi002 ceph-mon[40622]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:40.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:39 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:40.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:39 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:40.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:39 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:42.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:41 smithi162 ceph-mon[33046]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:42.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:41 smithi002 ceph-mon[30076]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:42.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:41 smithi002 ceph-mon[40622]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:43.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[40622]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:43.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:43.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:43.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:43.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:43.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:43.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[30076]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:43.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:43.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:43.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:43.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:43.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:43 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:43 smithi162 ceph-mon[33046]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:43 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:43 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:43 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:43 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:43 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:44.906 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 5 on host 'smithi162' 2024-09-21T13:37:44.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.904+0000 7fa6577fe640 1 -- 172.21.15.162:0/386384924 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa66002e880 con 0x7fa64c07b020 2024-09-21T13:37:44.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 -- 172.21.15.162:0/386384924 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa64c07b020 msgr2=0x7fa64c07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:37:44.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 --2- 172.21.15.162:0/386384924 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa64c07b020 0x7fa64c07d4e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa65000abe0 tx=0x7fa65000a2d0 comp rx=0 tx=0).stop 2024-09-21T13:37:44.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 -- 172.21.15.162:0/386384924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa660102850 msgr2=0x7fa660198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:37:44.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 --2- 172.21.15.162:0/386384924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa660102850 0x7fa660198a30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa648006010 tx=0x7fa6480052b0 comp rx=0 tx=0).stop 2024-09-21T13:37:44.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 -- 172.21.15.162:0/386384924 shutdown_connections 2024-09-21T13:37:44.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 --2- 172.21.15.162:0/386384924 >> v2:172.21.15.2:6800/3897423974 conn(0x7fa64c07b020 0x7fa64c07d4e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:44.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 --2- 172.21.15.162:0/386384924 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa6601033f0 0x7fa660199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:44.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 --2- 172.21.15.162:0/386384924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa660102850 0x7fa660198a30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:44.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 --2- 172.21.15.162:0/386384924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa660101ec0 0x7fa6601983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:44.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 -- 172.21.15.162:0/386384924 >> 172.21.15.162:0/386384924 conn(0x7fa6600fc940 msgr2=0x7fa660101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:37:44.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 -- 172.21.15.162:0/386384924 shutdown_connections 2024-09-21T13:37:44.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:44.907+0000 7fa664fee640 1 -- 172.21.15.162:0/386384924 wait complete. 2024-09-21T13:37:45.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[30076]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:45.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[30076]: from='osd.5 v2:172.21.15.162:6804/309339656' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T13:37:45.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[30076]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T13:37:45.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:45.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:45.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:45.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[40622]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:45.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[40622]: from='osd.5 v2:172.21.15.162:6804/309339656' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T13:37:45.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[40622]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T13:37:45.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:45.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:45.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:45 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:45.627 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:45 smithi162 ceph-mon[33046]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:45.627 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:45 smithi162 ceph-mon[33046]: from='osd.5 v2:172.21.15.162:6804/309339656' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T13:37:45.627 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:45 smithi162 ceph-mon[33046]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T13:37:45.627 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:45 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:37:45.627 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:45 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:45.627 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:45 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:45.664 DEBUG:teuthology.orchestra.run.smithi162:osd.5> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.5.service 2024-09-21T13:37:45.666 INFO:tasks.cephadm:Deploying osd.6 on smithi162 with /dev/vg_nvme/lv_2... 2024-09-21T13:37:45.666 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T13:37:46.372 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:37:46.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:46 smithi162 ceph-mon[33046]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T13:37:46.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:46 smithi162 ceph-mon[33046]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T13:37:46.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:46 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:46.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:46 smithi162 ceph-mon[33046]: from='osd.5 v2:172.21.15.162:6804/309339656' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:46.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:46 smithi162 ceph-mon[33046]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:46.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:46 smithi002 ceph-mon[40622]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T13:37:46.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:46 smithi002 ceph-mon[40622]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T13:37:46.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:46 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:46.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:46 smithi002 ceph-mon[40622]: from='osd.5 v2:172.21.15.162:6804/309339656' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:46.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:46 smithi002 ceph-mon[40622]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:46.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:46 smithi002 ceph-mon[30076]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T13:37:46.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:46 smithi002 ceph-mon[30076]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T13:37:46.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:46 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:46.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:46 smithi002 ceph-mon[30076]: from='osd.5 v2:172.21.15.162:6804/309339656' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:46.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:46 smithi002 ceph-mon[30076]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:37:46.885 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:37:46 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:37:46.732+0000 7fc0f1e03640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T13:37:46.885 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:37:46 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:37:46.736+0000 7fc0e9c22640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:37:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[30076]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[30076]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:37:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[30076]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T13:37:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[30076]: from='osd.5 ' entity='osd.5' 2024-09-21T13:37:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[40622]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[40622]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:37:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[40622]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T13:37:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:47.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:47 smithi002 ceph-mon[40622]: from='osd.5 ' entity='osd.5' 2024-09-21T13:37:47.615 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:47 smithi162 ceph-mon[33046]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:47.615 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:47 smithi162 ceph-mon[33046]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:37:47.615 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:47 smithi162 ceph-mon[33046]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T13:37:47.615 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:47.615 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:47.615 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:47 smithi162 ceph-mon[33046]: from='osd.5 ' entity='osd.5' 2024-09-21T13:37:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:48 smithi162 ceph-mon[33046]: purged_snaps scrub starts 2024-09-21T13:37:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:48 smithi162 ceph-mon[33046]: purged_snaps scrub ok 2024-09-21T13:37:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:48 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:48 smithi162 ceph-mon[33046]: osd.5 v2:172.21.15.162:6804/309339656 boot 2024-09-21T13:37:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:48 smithi162 ceph-mon[33046]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T13:37:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:48 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:48.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:48 smithi162 ceph-mon[33046]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T13:37:48.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[40622]: purged_snaps scrub starts 2024-09-21T13:37:48.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[40622]: purged_snaps scrub ok 2024-09-21T13:37:48.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:48.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[40622]: osd.5 v2:172.21.15.162:6804/309339656 boot 2024-09-21T13:37:48.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[40622]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T13:37:48.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:48.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[40622]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T13:37:48.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[30076]: purged_snaps scrub starts 2024-09-21T13:37:48.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[30076]: purged_snaps scrub ok 2024-09-21T13:37:48.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:48.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[30076]: osd.5 v2:172.21.15.162:6804/309339656 boot 2024-09-21T13:37:48.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[30076]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T13:37:48.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:37:48.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:48 smithi002 ceph-mon[30076]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T13:37:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: Detected new or changed devices on smithi162 2024-09-21T13:37:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:37:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:37:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T13:37:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[40622]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T13:37:50.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:50.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: Detected new or changed devices on smithi162 2024-09-21T13:37:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:37:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:37:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T13:37:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:49 smithi002 ceph-mon[30076]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T13:37:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T13:37:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: Detected new or changed devices on smithi162 2024-09-21T13:37:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:37:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:37:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T13:37:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:37:50.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:37:50.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:49 smithi162 ceph-mon[33046]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T13:37:50.580 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:37:50.606 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2024-09-21T13:37:50.850 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:37:51.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.289+0000 7f01419b5640 1 -- 172.21.15.162:0/387860455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f013c104520 msgr2=0x7f013c10aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:37:51.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.289+0000 7f01419b5640 1 --2- 172.21.15.162:0/387860455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f013c104520 0x7f013c10aea0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0134009cd0 tx=0x7f013402a8e0 comp rx=0 tx=0).stop 2024-09-21T13:37:51.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.289+0000 7f01419b5640 1 -- 172.21.15.162:0/387860455 shutdown_connections 2024-09-21T13:37:51.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.289+0000 7f01419b5640 1 --2- 172.21.15.162:0/387860455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f013c104520 0x7f013c10aea0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:51.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.289+0000 7f01419b5640 1 --2- 172.21.15.162:0/387860455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f013c103b60 0x7f013c103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:51.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.289+0000 7f01419b5640 1 --2- 172.21.15.162:0/387860455 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f013c102a00 0x7f013c102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:51.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.289+0000 7f01419b5640 1 -- 172.21.15.162:0/387860455 >> 172.21.15.162:0/387860455 conn(0x7f013c0fe2f0 msgr2=0x7f013c100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:37:51.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.289+0000 7f01419b5640 1 -- 172.21.15.162:0/387860455 shutdown_connections 2024-09-21T13:37:51.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.289+0000 7f01419b5640 1 -- 172.21.15.162:0/387860455 wait complete. 2024-09-21T13:37:51.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f01419b5640 1 Processor -- start 2024-09-21T13:37:51.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f01419b5640 1 -- start start 2024-09-21T13:37:51.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f01419b5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f013c102a00 0x7f013c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:37:51.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f01419b5640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f013c103b60 0x7f013c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:37:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f01419b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f013c104520 0x7f013c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:37:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f01419b5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f013c10dd30 con 0x7f013c104520 2024-09-21T13:37:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f01419b5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f013c10dbb0 con 0x7f013c102a00 2024-09-21T13:37:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f01419b5640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f013c10deb0 con 0x7f013c103b60 2024-09-21T13:37:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f013affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f013c102a00 0x7f013c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:37:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f013affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f013c102a00 0x7f013c1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46132/0 (socket says 172.21.15.162:46132) 2024-09-21T13:37:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f013affd640 1 -- 172.21.15.162:0/3109429178 learned_addr learned my addr 172.21.15.162:0/3109429178 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:37:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f013a7fc640 1 --2- 172.21.15.162:0/3109429178 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f013c103b60 0x7f013c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:37:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.290+0000 7f013b7fe640 1 --2- 172.21.15.162:0/3109429178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f013c104520 0x7f013c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f013affd640 1 -- 172.21.15.162:0/3109429178 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f013c103b60 msgr2=0x7f013c198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f013affd640 1 --2- 172.21.15.162:0/3109429178 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f013c103b60 0x7f013c198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f013affd640 1 -- 172.21.15.162:0/3109429178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f013c104520 msgr2=0x7f013c199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f013affd640 1 --2- 172.21.15.162:0/3109429178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f013c104520 0x7f013c199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f013affd640 1 -- 172.21.15.162:0/3109429178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c199fd0 con 0x7f013c102a00 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f013b7fe640 1 --2- 172.21.15.162:0/3109429178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f013c104520 0x7f013c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f013affd640 1 --2- 172.21.15.162:0/3109429178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f013c102a00 0x7f013c1984a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f012c00e9f0 tx=0x7f012c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f01409b3640 1 -- 172.21.15.162:0/3109429178 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c00cd80 con 0x7f013c102a00 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f01419b5640 1 -- 172.21.15.162:0/3109429178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013c19a2c0 con 0x7f013c102a00 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f01409b3640 1 -- 172.21.15.162:0/3109429178 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f012c0054a0 con 0x7f013c102a00 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f01409b3640 1 -- 172.21.15.162:0/3109429178 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c010430 con 0x7f013c102a00 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.291+0000 7f01419b5640 1 -- 172.21.15.162:0/3109429178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013c1a09a0 con 0x7f013c102a00 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.292+0000 7f01419b5640 1 -- 172.21.15.162:0/3109429178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f013c102e00 con 0x7f013c102a00 2024-09-21T13:37:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.293+0000 7f01409b3640 1 -- 172.21.15.162:0/3109429178 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7f012c005020 con 0x7f013c102a00 2024-09-21T13:37:51.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.293+0000 7f01409b3640 1 --2- 172.21.15.162:0/3109429178 >> v2:172.21.15.2:6800/3897423974 conn(0x7f012807b020 0x7f012807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:37:51.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.293+0000 7f01409b3640 1 -- 172.21.15.162:0/3109429178 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3497+0+0 (secure 0 0 0) 0x7f012c09dbe0 con 0x7f013c102a00 2024-09-21T13:37:51.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.293+0000 7f013a7fc640 1 --2- 172.21.15.162:0/3109429178 >> v2:172.21.15.2:6800/3897423974 conn(0x7f012807b020 0x7f012807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:37:51.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.294+0000 7f013a7fc640 1 --2- 172.21.15.162:0/3109429178 >> v2:172.21.15.2:6800/3897423974 conn(0x7f012807b020 0x7f012807d4e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0124009bd0 tx=0x7f0124005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:37:51.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.297+0000 7f01409b3640 1 -- 172.21.15.162:0/3109429178 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f012c065920 con 0x7f013c102a00 2024-09-21T13:37:51.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:37:51.486+0000 7f01419b5640 1 -- 172.21.15.162:0/3109429178 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f013c02e7b0 con 0x7f012807b020 2024-09-21T13:37:52.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:51 smithi162 ceph-mon[33046]: pgmap v145: 1 pgs: 1 peering; 0 B data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:37:52.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:51 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:37:52.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:51 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:37:52.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:51 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:51 smithi002 ceph-mon[30076]: pgmap v145: 1 pgs: 1 peering; 0 B data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:37:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:51 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:37:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:51 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:37:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:51 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:51 smithi002 ceph-mon[40622]: pgmap v145: 1 pgs: 1 peering; 0 B data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:37:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:51 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:37:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:51 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:37:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:51 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:37:52.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:52 smithi162 ceph-mon[33046]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:37:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:52 smithi002 ceph-mon[30076]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:37:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:52 smithi002 ceph-mon[40622]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:37:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[30076]: pgmap v146: 1 pgs: 1 peering; 0 B data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:37:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/2481068309' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b698a992-5f48-4c67-829c-814bf21c67c0"} : dispatch 2024-09-21T13:37:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b698a992-5f48-4c67-829c-814bf21c67c0"} : dispatch 2024-09-21T13:37:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b698a992-5f48-4c67-829c-814bf21c67c0"}]': finished 2024-09-21T13:37:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[30076]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T13:37:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:37:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[40622]: pgmap v146: 1 pgs: 1 peering; 0 B data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:37:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/2481068309' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b698a992-5f48-4c67-829c-814bf21c67c0"} : dispatch 2024-09-21T13:37:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b698a992-5f48-4c67-829c-814bf21c67c0"} : dispatch 2024-09-21T13:37:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b698a992-5f48-4c67-829c-814bf21c67c0"}]': finished 2024-09-21T13:37:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[40622]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T13:37:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:53 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:37:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:53 smithi162 ceph-mon[33046]: pgmap v146: 1 pgs: 1 peering; 0 B data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:37:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/2481068309' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b698a992-5f48-4c67-829c-814bf21c67c0"} : dispatch 2024-09-21T13:37:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b698a992-5f48-4c67-829c-814bf21c67c0"} : dispatch 2024-09-21T13:37:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b698a992-5f48-4c67-829c-814bf21c67c0"}]': finished 2024-09-21T13:37:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:53 smithi162 ceph-mon[33046]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T13:37:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:53 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:37:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/2668781257' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:37:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/2668781257' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:37:55.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/2668781257' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:37:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:55 smithi002 ceph-mon[30076]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:37:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:55 smithi002 ceph-mon[40622]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:37:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:55 smithi162 ceph-mon[33046]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:37:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:57 smithi002 ceph-mon[30076]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:37:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:57 smithi002 ceph-mon[40622]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:37:58.101 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:57 smithi162 ceph-mon[33046]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:37:59 smithi002 ceph-mon[30076]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:37:59 smithi002 ceph-mon[40622]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:00.117 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:37:59 smithi162 ceph-mon[33046]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:01 smithi162 ceph-mon[33046]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:01 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T13:38:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:01 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:01 smithi002 ceph-mon[30076]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:01 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T13:38:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:01 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:01 smithi002 ceph-mon[40622]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:01 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T13:38:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:01 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:03.041 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:02 smithi162 ceph-mon[33046]: Deploying daemon osd.6 on smithi162 2024-09-21T13:38:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:02 smithi002 ceph-mon[30076]: Deploying daemon osd.6 on smithi162 2024-09-21T13:38:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:02 smithi002 ceph-mon[40622]: Deploying daemon osd.6 on smithi162 2024-09-21T13:38:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:03 smithi002 ceph-mon[30076]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:04.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:03 smithi002 ceph-mon[40622]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:04.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:03 smithi162 ceph-mon[33046]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:06.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:05 smithi162 ceph-mon[33046]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:05 smithi002 ceph-mon[30076]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:05 smithi002 ceph-mon[40622]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:07.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:07 smithi162 ceph-mon[33046]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:07 smithi002 ceph-mon[30076]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:07 smithi002 ceph-mon[40622]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:08 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:08 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:08 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:08 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:08 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:09.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:08 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:09.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:08 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:09.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:08 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:09.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:08 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:09 smithi162 ceph-mon[33046]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:10.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:09 smithi002 ceph-mon[30076]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:10.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:09 smithi002 ceph-mon[40622]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:11 smithi162 ceph-mon[33046]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:11 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:11 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:11 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:11 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:11 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[30076]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:12.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:12.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[40622]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:12.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:12.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:12.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:12.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:12.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:11 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:14.144 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:13 smithi162 ceph-mon[33046]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:14.144 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:13 smithi162 ceph-mon[33046]: from='osd.6 v2:172.21.15.162:6808/1212984287' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T13:38:14.144 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:13 smithi162 ceph-mon[33046]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T13:38:14.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.189+0000 7f01409b3640 1 -- 172.21.15.162:0/3109429178 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f013c02e7b0 con 0x7f012807b020 2024-09-21T13:38:14.190 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 6 on host 'smithi162' 2024-09-21T13:38:14.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.192+0000 7f01419b5640 1 -- 172.21.15.162:0/3109429178 >> v2:172.21.15.2:6800/3897423974 conn(0x7f012807b020 msgr2=0x7f012807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:14.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.192+0000 7f01419b5640 1 --2- 172.21.15.162:0/3109429178 >> v2:172.21.15.2:6800/3897423974 conn(0x7f012807b020 0x7f012807d4e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0124009bd0 tx=0x7f0124005f90 comp rx=0 tx=0).stop 2024-09-21T13:38:14.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.192+0000 7f01419b5640 1 -- 172.21.15.162:0/3109429178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f013c102a00 msgr2=0x7f013c1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:14.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.192+0000 7f01419b5640 1 --2- 172.21.15.162:0/3109429178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f013c102a00 0x7f013c1984a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f012c00e9f0 tx=0x7f012c00edf0 comp rx=0 tx=0).stop 2024-09-21T13:38:14.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.192+0000 7f01419b5640 1 -- 172.21.15.162:0/3109429178 shutdown_connections 2024-09-21T13:38:14.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.192+0000 7f01419b5640 1 --2- 172.21.15.162:0/3109429178 >> v2:172.21.15.2:6800/3897423974 conn(0x7f012807b020 0x7f012807d4e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:14.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.192+0000 7f01419b5640 1 --2- 172.21.15.162:0/3109429178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f013c104520 0x7f013c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:14.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.192+0000 7f01419b5640 1 --2- 172.21.15.162:0/3109429178 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f013c103b60 0x7f013c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:14.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.192+0000 7f01419b5640 1 --2- 172.21.15.162:0/3109429178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f013c102a00 0x7f013c1984a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:14.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.192+0000 7f01419b5640 1 -- 172.21.15.162:0/3109429178 >> 172.21.15.162:0/3109429178 conn(0x7f013c0fe2f0 msgr2=0x7f013c0ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:14.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.193+0000 7f01419b5640 1 -- 172.21.15.162:0/3109429178 shutdown_connections 2024-09-21T13:38:14.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:14.193+0000 7f01419b5640 1 -- 172.21.15.162:0/3109429178 wait complete. 2024-09-21T13:38:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:13 smithi002 ceph-mon[30076]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:13 smithi002 ceph-mon[30076]: from='osd.6 v2:172.21.15.162:6808/1212984287' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T13:38:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:13 smithi002 ceph-mon[30076]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T13:38:14.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:13 smithi002 ceph-mon[40622]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:13 smithi002 ceph-mon[40622]: from='osd.6 v2:172.21.15.162:6808/1212984287' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T13:38:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:13 smithi002 ceph-mon[40622]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T13:38:14.827 DEBUG:teuthology.orchestra.run.smithi162:osd.6> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.6.service 2024-09-21T13:38:14.830 INFO:tasks.cephadm:Deploying osd.7 on smithi162 with /dev/vg_nvme/lv_1... 2024-09-21T13:38:14.830 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T13:38:15.174 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:14 smithi162 ceph-mon[33046]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T13:38:15.175 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:14 smithi162 ceph-mon[33046]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T13:38:15.175 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:14 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:15.175 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:14 smithi162 ceph-mon[33046]: from='osd.6 v2:172.21.15.162:6808/1212984287' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:15.175 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:14 smithi162 ceph-mon[33046]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:15.175 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:14 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:15.175 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:14 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:15.175 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:14 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:15.175 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:38:14 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:38:14.884+0000 7f5ab5330640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T13:38:15.175 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:38:14 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:38:14.889+0000 7f5ab1157640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:38:15.251 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[30076]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T13:38:15.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[30076]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T13:38:15.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:15.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[30076]: from='osd.6 v2:172.21.15.162:6808/1212984287' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:15.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[30076]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:15.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:15.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:15.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:15.252 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[40622]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T13:38:15.252 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[40622]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T13:38:15.253 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:15.253 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[40622]: from='osd.6 v2:172.21.15.162:6808/1212984287' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:15.253 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[40622]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:15.253 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:15.253 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:15.253 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:14 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:15.998 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:38:16.220 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:15 smithi162 ceph-mon[33046]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:16.220 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:15 smithi162 ceph-mon[33046]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:38:16.220 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:15 smithi162 ceph-mon[33046]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T13:38:16.220 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:15 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:16.220 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:15 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:16.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:15 smithi002 ceph-mon[30076]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:16.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:15 smithi002 ceph-mon[30076]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:38:16.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:15 smithi002 ceph-mon[30076]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T13:38:16.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:15 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:16.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:15 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:16.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:15 smithi002 ceph-mon[40622]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:16.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:15 smithi002 ceph-mon[40622]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:38:16.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:15 smithi002 ceph-mon[40622]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T13:38:16.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:15 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:16.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:15 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:17.143 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:16 smithi162 ceph-mon[33046]: purged_snaps scrub starts 2024-09-21T13:38:17.143 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:16 smithi162 ceph-mon[33046]: purged_snaps scrub ok 2024-09-21T13:38:17.143 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:16 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:17.143 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:16 smithi162 ceph-mon[33046]: osd.6 v2:172.21.15.162:6808/1212984287 boot 2024-09-21T13:38:17.143 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:16 smithi162 ceph-mon[33046]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T13:38:17.143 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:16 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:17.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[30076]: purged_snaps scrub starts 2024-09-21T13:38:17.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[30076]: purged_snaps scrub ok 2024-09-21T13:38:17.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:17.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[30076]: osd.6 v2:172.21.15.162:6808/1212984287 boot 2024-09-21T13:38:17.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[30076]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T13:38:17.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:17.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[40622]: purged_snaps scrub starts 2024-09-21T13:38:17.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[40622]: purged_snaps scrub ok 2024-09-21T13:38:17.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:17.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[40622]: osd.6 v2:172.21.15.162:6808/1212984287 boot 2024-09-21T13:38:17.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[40622]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T13:38:17.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:16 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:38:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:17 smithi162 ceph-mon[33046]: pgmap v162: 1 pgs: 1 remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:17 smithi162 ceph-mon[33046]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T13:38:18.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:17 smithi002 ceph-mon[40622]: pgmap v162: 1 pgs: 1 remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:18.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:17 smithi002 ceph-mon[40622]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T13:38:18.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:17 smithi002 ceph-mon[30076]: pgmap v162: 1 pgs: 1 remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T13:38:18.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:17 smithi002 ceph-mon[30076]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T13:38:19.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:18 smithi162 ceph-mon[33046]: osdmap e45: 7 total, 7 up, 7 in 2024-09-21T13:38:19.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:18 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:18 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:18 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:19.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:18 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:19.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:18 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:19.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:18 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:18 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:19.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:18 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:19.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:18 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[40622]: osdmap e45: 7 total, 7 up, 7 in 2024-09-21T13:38:19.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[30076]: osdmap e45: 7 total, 7 up, 7 in 2024-09-21T13:38:19.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.352 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.352 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:19.352 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:19.352 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:19.352 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.352 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:19.352 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:19.352 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:18 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:19.767 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T13:38:19.793 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2024-09-21T13:38:20.041 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:38:20.161 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:19 smithi162 ceph-mon[33046]: Detected new or changed devices on smithi162 2024-09-21T13:38:20.161 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:19 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T13:38:20.161 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:19 smithi162 ceph-mon[33046]: pgmap v165: 1 pgs: 1 remapped; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:20.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:19 smithi002 ceph-mon[40622]: Detected new or changed devices on smithi162 2024-09-21T13:38:20.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:19 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T13:38:20.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:19 smithi002 ceph-mon[40622]: pgmap v165: 1 pgs: 1 remapped; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:20.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:19 smithi002 ceph-mon[30076]: Detected new or changed devices on smithi162 2024-09-21T13:38:20.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:19 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T13:38:20.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:19 smithi002 ceph-mon[30076]: pgmap v165: 1 pgs: 1 remapped; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:20.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.466+0000 7fe916766640 1 -- 172.21.15.162:0/985276176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe910103b70 msgr2=0x7fe910103ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:20.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.466+0000 7fe916766640 1 --2- 172.21.15.162:0/985276176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe910103b70 0x7fe910103ff0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8009930 tx=0x7fe8f802a420 comp rx=0 tx=0).stop 2024-09-21T13:38:20.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.466+0000 7fe916766640 1 -- 172.21.15.162:0/985276176 shutdown_connections 2024-09-21T13:38:20.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.466+0000 7fe916766640 1 --2- 172.21.15.162:0/985276176 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe910104530 0x7fe91010aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:20.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.466+0000 7fe916766640 1 --2- 172.21.15.162:0/985276176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe910103b70 0x7fe910103ff0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:20.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.466+0000 7fe916766640 1 --2- 172.21.15.162:0/985276176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe910102a10 0x7fe910102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:20.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.466+0000 7fe916766640 1 -- 172.21.15.162:0/985276176 >> 172.21.15.162:0/985276176 conn(0x7fe9100fe2c0 msgr2=0x7fe910100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.466+0000 7fe916766640 1 -- 172.21.15.162:0/985276176 shutdown_connections 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.466+0000 7fe916766640 1 -- 172.21.15.162:0/985276176 wait complete. 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.466+0000 7fe916766640 1 Processor -- start 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.466+0000 7fe916766640 1 -- start start 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe916766640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe910102a10 0x7fe910198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe916766640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe910103b70 0x7fe910198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe916766640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe910104530 0x7fe910199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe916766640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe91010ddb0 con 0x7fe910104530 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe916766640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe91010dc30 con 0x7fe910103b70 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe916766640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fe91010df30 con 0x7fe910102a10 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe910103b70 0x7fe910198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe910103b70 0x7fe910198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:33016/0 (socket says 172.21.15.162:33016) 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe90f7fe640 1 -- 172.21.15.162:0/4093876113 learned_addr learned my addr 172.21.15.162:0/4093876113 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:38:20.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe90ffff640 1 --2- 172.21.15.162:0/4093876113 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe910102a10 0x7fe910198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe914d03640 1 --2- 172.21.15.162:0/4093876113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe910104530 0x7fe910199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe90f7fe640 1 -- 172.21.15.162:0/4093876113 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe910102a10 msgr2=0x7fe910198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe90f7fe640 1 --2- 172.21.15.162:0/4093876113 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe910102a10 0x7fe910198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe90f7fe640 1 -- 172.21.15.162:0/4093876113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe910104530 msgr2=0x7fe910199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe90f7fe640 1 --2- 172.21.15.162:0/4093876113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe910104530 0x7fe910199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe90f7fe640 1 -- 172.21.15.162:0/4093876113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91019a030 con 0x7fe910103b70 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.467+0000 7fe90f7fe640 1 --2- 172.21.15.162:0/4093876113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe910103b70 0x7fe910198b50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8005ec0 tx=0x7fe8f8003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.468+0000 7fe90d7fa640 1 -- 172.21.15.162:0/4093876113 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f803f070 con 0x7fe910103b70 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.468+0000 7fe90d7fa640 1 -- 172.21.15.162:0/4093876113 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fe8f803bcf0 con 0x7fe910103b70 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.468+0000 7fe916766640 1 -- 172.21.15.162:0/4093876113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91019a2c0 con 0x7fe910103b70 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.468+0000 7fe90d7fa640 1 -- 172.21.15.162:0/4093876113 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8035030 con 0x7fe910103b70 2024-09-21T13:38:20.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.468+0000 7fe916766640 1 -- 172.21.15.162:0/4093876113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9101a0a00 con 0x7fe910103b70 2024-09-21T13:38:20.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.469+0000 7fe916766640 1 -- 172.21.15.162:0/4093876113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe910102e10 con 0x7fe910103b70 2024-09-21T13:38:20.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.469+0000 7fe90d7fa640 1 -- 172.21.15.162:0/4093876113 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7fe8f8042070 con 0x7fe910103b70 2024-09-21T13:38:20.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.470+0000 7fe90d7fa640 1 --2- 172.21.15.162:0/4093876113 >> v2:172.21.15.2:6800/3897423974 conn(0x7fe8fc07b020 0x7fe8fc07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:20.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.470+0000 7fe90d7fa640 1 -- 172.21.15.162:0/4093876113 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 3789+0+0 (secure 0 0 0) 0x7fe8f80be0b0 con 0x7fe910103b70 2024-09-21T13:38:20.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.470+0000 7fe90ffff640 1 --2- 172.21.15.162:0/4093876113 >> v2:172.21.15.2:6800/3897423974 conn(0x7fe8fc07b020 0x7fe8fc07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:20.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.471+0000 7fe90ffff640 1 --2- 172.21.15.162:0/4093876113 >> v2:172.21.15.2:6800/3897423974 conn(0x7fe8fc07b020 0x7fe8fc07d4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe90000bbe0 tx=0x7fe90000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:20.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.474+0000 7fe90d7fa640 1 -- 172.21.15.162:0/4093876113 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8f808a070 con 0x7fe910103b70 2024-09-21T13:38:20.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:20.663+0000 7fe916766640 1 -- 172.21.15.162:0/4093876113 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe91002e890 con 0x7fe8fc07b020 2024-09-21T13:38:21.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:20 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:38:21.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:20 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:38:21.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:20 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:21.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:20 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:38:21.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:20 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:38:21.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:20 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:21.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:20 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T13:38:21.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:20 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T13:38:21.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:20 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:22.201 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:21 smithi162 ceph-mon[33046]: pgmap v166: 1 pgs: 1 remapped; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:22.201 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:21 smithi162 ceph-mon[33046]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:38:22.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:21 smithi002 ceph-mon[30076]: pgmap v166: 1 pgs: 1 remapped; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:22.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:21 smithi002 ceph-mon[30076]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:38:22.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:21 smithi002 ceph-mon[40622]: pgmap v166: 1 pgs: 1 remapped; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:22.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:21 smithi002 ceph-mon[40622]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:38:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:23 smithi162 ceph-mon[33046]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/2110858672' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4609ec1b-c176-4d2e-a3b3-d8feca508e5f"} : dispatch 2024-09-21T13:38:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4609ec1b-c176-4d2e-a3b3-d8feca508e5f"} : dispatch 2024-09-21T13:38:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4609ec1b-c176-4d2e-a3b3-d8feca508e5f"}]': finished 2024-09-21T13:38:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:23 smithi162 ceph-mon[33046]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T13:38:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:23 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/3558279333' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:38:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[30076]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/2110858672' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4609ec1b-c176-4d2e-a3b3-d8feca508e5f"} : dispatch 2024-09-21T13:38:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4609ec1b-c176-4d2e-a3b3-d8feca508e5f"} : dispatch 2024-09-21T13:38:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4609ec1b-c176-4d2e-a3b3-d8feca508e5f"}]': finished 2024-09-21T13:38:24.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[30076]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T13:38:24.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:24.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/3558279333' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:38:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[40622]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/2110858672' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4609ec1b-c176-4d2e-a3b3-d8feca508e5f"} : dispatch 2024-09-21T13:38:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4609ec1b-c176-4d2e-a3b3-d8feca508e5f"} : dispatch 2024-09-21T13:38:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4609ec1b-c176-4d2e-a3b3-d8feca508e5f"}]': finished 2024-09-21T13:38:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[40622]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T13:38:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/3558279333' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T13:38:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:25 smithi162 ceph-mon[33046]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T13:38:26.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:25 smithi002 ceph-mon[30076]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T13:38:26.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:25 smithi002 ceph-mon[40622]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T13:38:28.172 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:27 smithi162 ceph-mon[33046]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T13:38:28.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:27 smithi002 ceph-mon[30076]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T13:38:28.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:27 smithi002 ceph-mon[40622]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T13:38:30.176 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:29 smithi162 ceph-mon[33046]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T13:38:30.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:29 smithi002 ceph-mon[30076]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T13:38:30.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:29 smithi002 ceph-mon[40622]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T13:38:31.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:30 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T13:38:31.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:30 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:31.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:30 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T13:38:31.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:30 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:31.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:30 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T13:38:31.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:30 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:32.145 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:31 smithi162 ceph-mon[33046]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T13:38:32.145 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:31 smithi162 ceph-mon[33046]: Deploying daemon osd.7 on smithi162 2024-09-21T13:38:32.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:31 smithi002 ceph-mon[30076]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T13:38:32.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:31 smithi002 ceph-mon[30076]: Deploying daemon osd.7 on smithi162 2024-09-21T13:38:32.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:31 smithi002 ceph-mon[40622]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T13:38:32.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:31 smithi002 ceph-mon[40622]: Deploying daemon osd.7 on smithi162 2024-09-21T13:38:33.150 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:32 smithi162 ceph-mon[33046]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:33.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:32 smithi002 ceph-mon[30076]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:33.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:32 smithi002 ceph-mon[40622]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:35.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:35 smithi162 ceph-mon[33046]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:35.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:35 smithi002 ceph-mon[30076]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:35.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:35 smithi002 ceph-mon[40622]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:37.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:37 smithi162 ceph-mon[33046]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:37.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:37 smithi002 ceph-mon[30076]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:37.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:37 smithi002 ceph-mon[40622]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:39.462 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:39 smithi162 ceph-mon[33046]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:39.463 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:39 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:39.463 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:39 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:39.463 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:39 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:39.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:39 smithi002 ceph-mon[30076]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:39.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:39 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:39.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:39 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:39.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:39 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:39.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:39 smithi002 ceph-mon[40622]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:39.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:39 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:39.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:39 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:39.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:39 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:41.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:41 smithi162 ceph-mon[33046]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:41.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:41 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:41.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:41 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:41.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:41 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:41.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:41 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:41.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:41 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:41.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[30076]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:41.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:41.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:41.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:41.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:41.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:41.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[40622]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:41.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:41.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:41.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:41.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:41.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:41 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:43.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:43 smithi162 ceph-mon[33046]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:43.558 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 7 on host 'smithi162' 2024-09-21T13:38:43.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.556+0000 7fe90d7fa640 1 -- 172.21.15.162:0/4093876113 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe91002e890 con 0x7fe8fc07b020 2024-09-21T13:38:43.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 -- 172.21.15.162:0/4093876113 >> v2:172.21.15.2:6800/3897423974 conn(0x7fe8fc07b020 msgr2=0x7fe8fc07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:43.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 --2- 172.21.15.162:0/4093876113 >> v2:172.21.15.2:6800/3897423974 conn(0x7fe8fc07b020 0x7fe8fc07d4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe90000bbe0 tx=0x7fe90000b390 comp rx=0 tx=0).stop 2024-09-21T13:38:43.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 -- 172.21.15.162:0/4093876113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe910103b70 msgr2=0x7fe910198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:43.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 --2- 172.21.15.162:0/4093876113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe910103b70 0x7fe910198b50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8005ec0 tx=0x7fe8f8003cd0 comp rx=0 tx=0).stop 2024-09-21T13:38:43.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 -- 172.21.15.162:0/4093876113 shutdown_connections 2024-09-21T13:38:43.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 --2- 172.21.15.162:0/4093876113 >> v2:172.21.15.2:6800/3897423974 conn(0x7fe8fc07b020 0x7fe8fc07d4e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:43.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 --2- 172.21.15.162:0/4093876113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe910104530 0x7fe910199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:43.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 --2- 172.21.15.162:0/4093876113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe910103b70 0x7fe910198b50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:43.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 --2- 172.21.15.162:0/4093876113 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe910102a10 0x7fe910198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:43.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 -- 172.21.15.162:0/4093876113 >> 172.21.15.162:0/4093876113 conn(0x7fe9100fe2c0 msgr2=0x7fe9100ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:43.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 -- 172.21.15.162:0/4093876113 shutdown_connections 2024-09-21T13:38:43.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:43.559+0000 7fe916766640 1 -- 172.21.15.162:0/4093876113 wait complete. 2024-09-21T13:38:43.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:43 smithi002 ceph-mon[30076]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:43.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:43 smithi002 ceph-mon[40622]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:44.138 DEBUG:teuthology.orchestra.run.smithi162:osd.7> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.7.service 2024-09-21T13:38:44.141 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-09-21T13:38:44.141 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T13:38:44.399 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:38:44.451 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:44 smithi162 ceph-mon[33046]: from='osd.7 v2:172.21.15.162:6812/4048001305' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T13:38:44.451 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:44 smithi162 ceph-mon[33046]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T13:38:44.451 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:44.451 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:44.451 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:44 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:44.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:44 smithi002 ceph-mon[30076]: from='osd.7 v2:172.21.15.162:6812/4048001305' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T13:38:44.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:44 smithi002 ceph-mon[30076]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T13:38:44.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:44.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:44.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:44 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:44.521 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:44 smithi002 ceph-mon[40622]: from='osd.7 v2:172.21.15.162:6812/4048001305' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T13:38:44.521 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:44 smithi002 ceph-mon[40622]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T13:38:44.521 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:44.521 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:44.521 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:44 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:45.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.988+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/3892424537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc38103b70 msgr2=0x7fcc38103ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.988+0000 7fcc3d6ae640 1 --2- 172.21.15.2:0/3892424537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc38103b70 0x7fcc38103ff0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009890 tx=0x7fcc2c02a380 comp rx=0 tx=0).stop 2024-09-21T13:38:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.988+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/3892424537 shutdown_connections 2024-09-21T13:38:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.988+0000 7fcc3d6ae640 1 --2- 172.21.15.2:0/3892424537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc38104530 0x7fcc3810aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.988+0000 7fcc3d6ae640 1 --2- 172.21.15.2:0/3892424537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc38103b70 0x7fcc38103ff0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.988+0000 7fcc3d6ae640 1 --2- 172.21.15.2:0/3892424537 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fcc38102a10 0x7fcc38102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.988+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/3892424537 >> 172.21.15.2:0/3892424537 conn(0x7fcc380fe2c0 msgr2=0x7fcc38100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.988+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/3892424537 shutdown_connections 2024-09-21T13:38:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.988+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/3892424537 wait complete. 2024-09-21T13:38:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.989+0000 7fcc3d6ae640 1 Processor -- start 2024-09-21T13:38:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.989+0000 7fcc3d6ae640 1 -- start start 2024-09-21T13:38:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.989+0000 7fcc3d6ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc38102a10 0x7fcc381984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.989+0000 7fcc3d6ae640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fcc38103b70 0x7fcc38198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.989+0000 7fcc3d6ae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc38104530 0x7fcc38199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.989+0000 7fcc3d6ae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3810dd20 con 0x7fcc38102a10 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.989+0000 7fcc3d6ae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3810dba0 con 0x7fcc38104530 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.989+0000 7fcc3d6ae640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3810dea0 con 0x7fcc38103b70 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc367fc640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fcc38103b70 0x7fcc38198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc36ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc38102a10 0x7fcc381984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc367fc640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fcc38103b70 0x7fcc38198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:57654/0 (socket says 172.21.15.2:57654) 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc367fc640 1 -- 172.21.15.2:0/338661480 learned_addr learned my addr 172.21.15.2:0/338661480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc377fe640 1 --2- 172.21.15.2:0/338661480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc38104530 0x7fcc38199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc36ffd640 1 -- 172.21.15.2:0/338661480 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fcc38103b70 msgr2=0x7fcc38198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc36ffd640 1 --2- 172.21.15.2:0/338661480 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fcc38103b70 0x7fcc38198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc36ffd640 1 -- 172.21.15.2:0/338661480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc38104530 msgr2=0x7fcc38199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:45.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc36ffd640 1 --2- 172.21.15.2:0/338661480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc38104530 0x7fcc38199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc36ffd640 1 -- 172.21.15.2:0/338661480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3819a010 con 0x7fcc38102a10 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc36ffd640 1 --2- 172.21.15.2:0/338661480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc38102a10 0x7fcc381984e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcc28005fd0 tx=0x7fcc2800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc1ffff640 1 -- 172.21.15.2:0/338661480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800cd00 con 0x7fcc38102a10 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc1ffff640 1 -- 172.21.15.2:0/338661480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fcc280044a0 con 0x7fcc38102a10 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/338661480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3819a300 con 0x7fcc38102a10 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc1ffff640 1 -- 172.21.15.2:0/338661480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28010430 con 0x7fcc38102a10 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.990+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/338661480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc38075550 con 0x7fcc38102a10 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.991+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/338661480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc38102e10 con 0x7fcc38102a10 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.992+0000 7fcc1ffff640 1 -- 172.21.15.2:0/338661480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7fcc28004020 con 0x7fcc38102a10 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.993+0000 7fcc1ffff640 1 --2- 172.21.15.2:0/338661480 >> v2:172.21.15.2:6800/3897423974 conn(0x7fcc2007b020 0x7fcc2007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.993+0000 7fcc367fc640 1 --2- 172.21.15.2:0/338661480 >> v2:172.21.15.2:6800/3897423974 conn(0x7fcc2007b020 0x7fcc2007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.993+0000 7fcc1ffff640 1 -- 172.21.15.2:0/338661480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 3925+0+0 (secure 0 0 0) 0x7fcc2809db30 con 0x7fcc38102a10 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.993+0000 7fcc367fc640 1 --2- 172.21.15.2:0/338661480 >> v2:172.21.15.2:6800/3897423974 conn(0x7fcc2007b020 0x7fcc2007d4e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0095f0 tx=0x7fcc2c005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:44.997+0000 7fcc1ffff640 1 -- 172.21.15.2:0/338661480 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcc28009510 con 0x7fcc38102a10 2024-09-21T13:38:45.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.187+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/338661480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fcc3802e700 con 0x7fcc38102a10 2024-09-21T13:38:45.189 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:38:45.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.188+0000 7fcc1ffff640 1 -- 172.21.15.2:0/338661480 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v47) ==== 74+0+130 (secure 0 0 0) 0x7fcc280699c0 con 0x7fcc38102a10 2024-09-21T13:38:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.190+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/338661480 >> v2:172.21.15.2:6800/3897423974 conn(0x7fcc2007b020 msgr2=0x7fcc2007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.190+0000 7fcc3d6ae640 1 --2- 172.21.15.2:0/338661480 >> v2:172.21.15.2:6800/3897423974 conn(0x7fcc2007b020 0x7fcc2007d4e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0095f0 tx=0x7fcc2c005c90 comp rx=0 tx=0).stop 2024-09-21T13:38:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.191+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/338661480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc38102a10 msgr2=0x7fcc381984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.191+0000 7fcc3d6ae640 1 --2- 172.21.15.2:0/338661480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc38102a10 0x7fcc381984e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcc28005fd0 tx=0x7fcc2800ee50 comp rx=0 tx=0).stop 2024-09-21T13:38:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.191+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/338661480 shutdown_connections 2024-09-21T13:38:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.191+0000 7fcc3d6ae640 1 --2- 172.21.15.2:0/338661480 >> v2:172.21.15.2:6800/3897423974 conn(0x7fcc2007b020 0x7fcc2007d4e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.191+0000 7fcc3d6ae640 1 --2- 172.21.15.2:0/338661480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc38104530 0x7fcc38199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.191+0000 7fcc3d6ae640 1 --2- 172.21.15.2:0/338661480 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fcc38103b70 0x7fcc38198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.191+0000 7fcc3d6ae640 1 --2- 172.21.15.2:0/338661480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc38102a10 0x7fcc381984e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.191+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/338661480 >> 172.21.15.2:0/338661480 conn(0x7fcc380fe2c0 msgr2=0x7fcc380ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.191+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/338661480 shutdown_connections 2024-09-21T13:38:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:45.191+0000 7fcc3d6ae640 1 -- 172.21.15.2:0/338661480 wait complete. 2024-09-21T13:38:45.307 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:45 smithi162 ceph-mon[33046]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:45.307 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:45 smithi162 ceph-mon[33046]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T13:38:45.307 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:45 smithi162 ceph-mon[33046]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T13:38:45.307 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:45 smithi162 ceph-mon[33046]: from='osd.7 v2:172.21.15.162:6812/4048001305' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:45.307 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:45 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:45.307 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:45 smithi162 ceph-mon[33046]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:45.308 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:45 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/338661480' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T13:38:45.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[30076]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:45.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[30076]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T13:38:45.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[30076]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T13:38:45.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[30076]: from='osd.7 v2:172.21.15.162:6812/4048001305' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:45.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:45.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[30076]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:45.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/338661480' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T13:38:45.517 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[40622]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:45.517 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[40622]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T13:38:45.517 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[40622]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T13:38:45.517 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[40622]: from='osd.7 v2:172.21.15.162:6812/4048001305' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:45.517 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:45.517 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[40622]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T13:38:45.517 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:45 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/338661480' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T13:38:45.898 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:38:45 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:38:45.675+0000 7f6c90a8e640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T13:38:45.898 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:38:45 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:38:45.683+0000 7f6c888ad640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:38:45.932 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":47,"num_osds":8,"num_up_osds":7,"osd_up_since":1726925895,"num_in_osds":8,"osd_in_since":1726925902,"num_remapped_pgs":0} 2024-09-21T13:38:46.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:46 smithi002 ceph-mon[30076]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:38:46.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:46 smithi002 ceph-mon[30076]: osdmap e48: 8 total, 7 up, 8 in 2024-09-21T13:38:46.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:46 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:46.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:46 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:46.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:46 smithi002 ceph-mon[30076]: from='osd.7 ' entity='osd.7' 2024-09-21T13:38:46.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:46 smithi002 ceph-mon[40622]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:38:46.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:46 smithi002 ceph-mon[40622]: osdmap e48: 8 total, 7 up, 8 in 2024-09-21T13:38:46.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:46 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:46.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:46 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:46.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:46 smithi002 ceph-mon[40622]: from='osd.7 ' entity='osd.7' 2024-09-21T13:38:46.672 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:46 smithi162 ceph-mon[33046]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T13:38:46.672 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:46 smithi162 ceph-mon[33046]: osdmap e48: 8 total, 7 up, 8 in 2024-09-21T13:38:46.672 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:46 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:46.672 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:46 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:46.672 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:46 smithi162 ceph-mon[33046]: from='osd.7 ' entity='osd.7' 2024-09-21T13:38:46.933 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T13:38:47.210 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:38:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: purged_snaps scrub starts 2024-09-21T13:38:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: purged_snaps scrub ok 2024-09-21T13:38:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: osd.7 v2:172.21.15.162:6812/4048001305 boot 2024-09-21T13:38:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T13:38:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:47.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:47.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:47.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:47 smithi162 ceph-mon[33046]: osdmap e50: 8 total, 8 up, 8 in 2024-09-21T13:38:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: purged_snaps scrub starts 2024-09-21T13:38:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: purged_snaps scrub ok 2024-09-21T13:38:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:47.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: osd.7 v2:172.21.15.162:6812/4048001305 boot 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:47.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[30076]: osdmap e50: 8 total, 8 up, 8 in 2024-09-21T13:38:47.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: purged_snaps scrub starts 2024-09-21T13:38:47.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: purged_snaps scrub ok 2024-09-21T13:38:47.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T13:38:47.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: osd.7 v2:172.21.15.162:6812/4048001305 boot 2024-09-21T13:38:47.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T13:38:47.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:38:47.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T13:38:47.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:47.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:47.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:47.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:47 smithi002 ceph-mon[40622]: osdmap e50: 8 total, 8 up, 8 in 2024-09-21T13:38:47.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.803+0000 7efe1ca7c640 1 -- 172.21.15.2:0/855083290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe18102a40 msgr2=0x7efe18102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:47.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.803+0000 7efe1ca7c640 1 --2- 172.21.15.2:0/855083290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe18102a40 0x7efe18102ec0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efe00009930 tx=0x7efe0002a420 comp rx=0 tx=0).stop 2024-09-21T13:38:47.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.803+0000 7efe1ca7c640 1 -- 172.21.15.2:0/855083290 shutdown_connections 2024-09-21T13:38:47.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.803+0000 7efe1ca7c640 1 --2- 172.21.15.2:0/855083290 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7efe18103400 0x7efe18109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:47.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.803+0000 7efe1ca7c640 1 --2- 172.21.15.2:0/855083290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe18102a40 0x7efe18102ec0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:47.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.803+0000 7efe1ca7c640 1 --2- 172.21.15.2:0/855083290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe181018e0 0x7efe18101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:47.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.803+0000 7efe1ca7c640 1 -- 172.21.15.2:0/855083290 >> 172.21.15.2:0/855083290 conn(0x7efe180fd1b0 msgr2=0x7efe180ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:47.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.803+0000 7efe1ca7c640 1 -- 172.21.15.2:0/855083290 shutdown_connections 2024-09-21T13:38:47.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.803+0000 7efe1ca7c640 1 -- 172.21.15.2:0/855083290 wait complete. 2024-09-21T13:38:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.804+0000 7efe1ca7c640 1 Processor -- start 2024-09-21T13:38:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.804+0000 7efe1ca7c640 1 -- start start 2024-09-21T13:38:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.804+0000 7efe1ca7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe181018e0 0x7efe1806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.804+0000 7efe1ca7c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe18102a40 0x7efe1819d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.804+0000 7efe1ca7c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7efe18103400 0x7efe1819f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.804+0000 7efe1ca7c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efe1810ccd0 con 0x7efe181018e0 2024-09-21T13:38:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.804+0000 7efe1ca7c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe1810cb50 con 0x7efe18102a40 2024-09-21T13:38:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.804+0000 7efe1ca7c640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7efe1810ce50 con 0x7efe18103400 2024-09-21T13:38:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe1659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe181018e0 0x7efe1806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe1659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe181018e0 0x7efe1806b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39780/0 (socket says 172.21.15.2:39780) 2024-09-21T13:38:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe1659c640 1 -- 172.21.15.2:0/714743529 learned_addr learned my addr 172.21.15.2:0/714743529 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe16d9d640 1 --2- 172.21.15.2:0/714743529 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7efe18103400 0x7efe1819f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe15d9b640 1 --2- 172.21.15.2:0/714743529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe18102a40 0x7efe1819d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe1659c640 1 -- 172.21.15.2:0/714743529 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7efe18103400 msgr2=0x7efe1819f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe1659c640 1 --2- 172.21.15.2:0/714743529 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7efe18103400 0x7efe1819f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe1659c640 1 -- 172.21.15.2:0/714743529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe18102a40 msgr2=0x7efe1819d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe1659c640 1 --2- 172.21.15.2:0/714743529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe18102a40 0x7efe1819d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe1659c640 1 -- 172.21.15.2:0/714743529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe181a0140 con 0x7efe181018e0 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe16d9d640 1 --2- 172.21.15.2:0/714743529 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7efe18103400 0x7efe1819f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe1659c640 1 --2- 172.21.15.2:0/714743529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe181018e0 0x7efe1806b420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe0800b4a0 tx=0x7efe0800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe0f7fe640 1 -- 172.21.15.2:0/714743529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe08015020 con 0x7efe181018e0 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe0f7fe640 1 -- 172.21.15.2:0/714743529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7efe08011cb0 con 0x7efe181018e0 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe1ca7c640 1 -- 172.21.15.2:0/714743529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe181a0430 con 0x7efe181018e0 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe0f7fe640 1 -- 172.21.15.2:0/714743529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe08010cd0 con 0x7efe181018e0 2024-09-21T13:38:47.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.805+0000 7efe1ca7c640 1 -- 172.21.15.2:0/714743529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe181a0a40 con 0x7efe181018e0 2024-09-21T13:38:47.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.807+0000 7efe1ca7c640 1 -- 172.21.15.2:0/714743529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe18101ce0 con 0x7efe181018e0 2024-09-21T13:38:47.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.807+0000 7efe0f7fe640 1 -- 172.21.15.2:0/714743529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7efe08018020 con 0x7efe181018e0 2024-09-21T13:38:47.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.808+0000 7efe0f7fe640 1 --2- 172.21.15.2:0/714743529 >> v2:172.21.15.2:6800/3897423974 conn(0x7efe0407b020 0x7efe0407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:47.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.808+0000 7efe0f7fe640 1 -- 172.21.15.2:0/714743529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4081+0+0 (secure 0 0 0) 0x7efe0809d030 con 0x7efe181018e0 2024-09-21T13:38:47.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.808+0000 7efe15d9b640 1 --2- 172.21.15.2:0/714743529 >> v2:172.21.15.2:6800/3897423974 conn(0x7efe0407b020 0x7efe0407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.809+0000 7efe15d9b640 1 --2- 172.21.15.2:0/714743529 >> v2:172.21.15.2:6800/3897423974 conn(0x7efe0407b020 0x7efe0407d4e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe00005750 tx=0x7efe00005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:47.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:47.812+0000 7efe0f7fe640 1 -- 172.21.15.2:0/714743529 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efe0801f020 con 0x7efe181018e0 2024-09-21T13:38:48.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.000+0000 7efe1ca7c640 1 -- 172.21.15.2:0/714743529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7efe1802e8a0 con 0x7efe181018e0 2024-09-21T13:38:48.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.001+0000 7efe0f7fe640 1 -- 172.21.15.2:0/714743529 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v50) ==== 74+0+130 (secure 0 0 0) 0x7efe0806d020 con 0x7efe181018e0 2024-09-21T13:38:48.003 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:38:48.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 -- 172.21.15.2:0/714743529 >> v2:172.21.15.2:6800/3897423974 conn(0x7efe0407b020 msgr2=0x7efe0407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:48.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 --2- 172.21.15.2:0/714743529 >> v2:172.21.15.2:6800/3897423974 conn(0x7efe0407b020 0x7efe0407d4e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe00005750 tx=0x7efe00005a20 comp rx=0 tx=0).stop 2024-09-21T13:38:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 -- 172.21.15.2:0/714743529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe181018e0 msgr2=0x7efe1806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 --2- 172.21.15.2:0/714743529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe181018e0 0x7efe1806b420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe0800b4a0 tx=0x7efe0800b8a0 comp rx=0 tx=0).stop 2024-09-21T13:38:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 -- 172.21.15.2:0/714743529 shutdown_connections 2024-09-21T13:38:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 --2- 172.21.15.2:0/714743529 >> v2:172.21.15.2:6800/3897423974 conn(0x7efe0407b020 0x7efe0407d4e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 --2- 172.21.15.2:0/714743529 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7efe18103400 0x7efe1819f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 --2- 172.21.15.2:0/714743529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe18102a40 0x7efe1819d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 --2- 172.21.15.2:0/714743529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe181018e0 0x7efe1806b420 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 -- 172.21.15.2:0/714743529 >> 172.21.15.2:0/714743529 conn(0x7efe180fd1b0 msgr2=0x7efe180fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 -- 172.21.15.2:0/714743529 shutdown_connections 2024-09-21T13:38:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:48.004+0000 7efe1ca7c640 1 -- 172.21.15.2:0/714743529 wait complete. 2024-09-21T13:38:48.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:48 smithi002 ceph-mon[30076]: Detected new or changed devices on smithi162 2024-09-21T13:38:48.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:48 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T13:38:48.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/714743529' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T13:38:48.315 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:48 smithi002 ceph-mon[40622]: Detected new or changed devices on smithi162 2024-09-21T13:38:48.316 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:48 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T13:38:48.316 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/714743529' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T13:38:48.696 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1726925926,"num_in_osds":8,"osd_in_since":1726925902,"num_remapped_pgs":0} 2024-09-21T13:38:48.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T13:38:48.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:48 smithi162 ceph-mon[33046]: Detected new or changed devices on smithi162 2024-09-21T13:38:48.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:48 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T13:38:48.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/714743529' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T13:38:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:38:49.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:49 smithi002 ceph-mon[30076]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 440 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:49.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:49 smithi002 ceph-mon[30076]: osdmap e51: 8 total, 8 up, 8 in 2024-09-21T13:38:49.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:49 smithi002 ceph-mon[40622]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 440 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:49.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:49 smithi002 ceph-mon[40622]: osdmap e51: 8 total, 8 up, 8 in 2024-09-21T13:38:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.653+0000 7f5a57b8c640 1 -- 172.21.15.2:0/3362078717 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5a501045d0 msgr2=0x7f5a5010cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.653+0000 7f5a57b8c640 1 --2- 172.21.15.2:0/3362078717 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5a501045d0 0x7f5a5010cac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009900 tx=0x7f5a4402a410 comp rx=0 tx=0).stop 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.653+0000 7f5a57b8c640 1 -- 172.21.15.2:0/3362078717 shutdown_connections 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.653+0000 7f5a57b8c640 1 --2- 172.21.15.2:0/3362078717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a5010d110 0x7f5a5010f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.653+0000 7f5a57b8c640 1 --2- 172.21.15.2:0/3362078717 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5a501045d0 0x7f5a5010cac0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.653+0000 7f5a57b8c640 1 --2- 172.21.15.2:0/3362078717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50103cb0 0x7f5a50104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.653+0000 7f5a57b8c640 1 -- 172.21.15.2:0/3362078717 >> 172.21.15.2:0/3362078717 conn(0x7f5a500fd710 msgr2=0x7f5a500ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.653+0000 7f5a57b8c640 1 -- 172.21.15.2:0/3362078717 shutdown_connections 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.653+0000 7f5a57b8c640 1 -- 172.21.15.2:0/3362078717 wait complete. 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a57b8c640 1 Processor -- start 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a57b8c640 1 -- start start 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a57b8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50103cb0 0x7f5a50198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a57b8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a501045d0 0x7f5a50198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a57b8c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5a5010d110 0x7f5a5019e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a57b8c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5a50112490 con 0x7f5a50103cb0 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a57b8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a50112310 con 0x7f5a501045d0 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a57b8c640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f5a50112610 con 0x7f5a5010d110 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a55928640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50103cb0 0x7f5a50198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a56129640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5a5010d110 0x7f5a5019e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a55928640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50103cb0 0x7f5a50198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39794/0 (socket says 172.21.15.2:39794) 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a55928640 1 -- 172.21.15.2:0/620557571 learned_addr learned my addr 172.21.15.2:0/620557571 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a55127640 1 --2- 172.21.15.2:0/620557571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a501045d0 0x7f5a50198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a56129640 1 -- 172.21.15.2:0/620557571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a501045d0 msgr2=0x7f5a50198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a56129640 1 --2- 172.21.15.2:0/620557571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a501045d0 0x7f5a50198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a56129640 1 -- 172.21.15.2:0/620557571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50103cb0 msgr2=0x7f5a50198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a56129640 1 --2- 172.21.15.2:0/620557571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50103cb0 0x7f5a50198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.654+0000 7f5a56129640 1 -- 172.21.15.2:0/620557571 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5019eac0 con 0x7f5a5010d110 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.655+0000 7f5a55928640 1 --2- 172.21.15.2:0/620557571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50103cb0 0x7f5a50198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.655+0000 7f5a56129640 1 --2- 172.21.15.2:0/620557571 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5a5010d110 0x7f5a5019e2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800b410 tx=0x7f5a4800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.655+0000 7f5a4effd640 1 -- 172.21.15.2:0/620557571 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48015020 con 0x7f5a5010d110 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.655+0000 7f5a4effd640 1 -- 172.21.15.2:0/620557571 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5a48011cb0 con 0x7f5a5010d110 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.655+0000 7f5a4effd640 1 -- 172.21.15.2:0/620557571 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48010cb0 con 0x7f5a5010d110 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.655+0000 7f5a57b8c640 1 -- 172.21.15.2:0/620557571 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5019edb0 con 0x7f5a5010d110 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.655+0000 7f5a57b8c640 1 -- 172.21.15.2:0/620557571 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a501a5470 con 0x7f5a5010d110 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.656+0000 7f5a57b8c640 1 -- 172.21.15.2:0/620557571 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a50104090 con 0x7f5a5010d110 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.657+0000 7f5a4effd640 1 -- 172.21.15.2:0/620557571 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7f5a48018020 con 0x7f5a5010d110 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.657+0000 7f5a4effd640 1 --2- 172.21.15.2:0/620557571 >> v2:172.21.15.2:6800/3897423974 conn(0x7f5a3807b020 0x7f5a3807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.658+0000 7f5a55928640 1 --2- 172.21.15.2:0/620557571 >> v2:172.21.15.2:6800/3897423974 conn(0x7f5a3807b020 0x7f5a3807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.658+0000 7f5a4effd640 1 -- 172.21.15.2:0/620557571 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(51..51 src has 1..51) ==== 4081+0+0 (secure 0 0 0) 0x7f5a4809cf30 con 0x7f5a5010d110 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.658+0000 7f5a55928640 1 --2- 172.21.15.2:0/620557571 >> v2:172.21.15.2:6800/3897423974 conn(0x7f5a3807b020 0x7f5a3807d4e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000e810 tx=0x7f5a40009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.662+0000 7f5a4effd640 1 -- 172.21.15.2:0/620557571 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a4801f020 con 0x7f5a5010d110 2024-09-21T13:38:49.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:49 smithi162 ceph-mon[33046]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 440 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:49.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:49 smithi162 ceph-mon[33046]: osdmap e51: 8 total, 8 up, 8 in 2024-09-21T13:38:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.851+0000 7f5a57b8c640 1 -- 172.21.15.2:0/620557571 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a50107890 con 0x7f5a5010d110 2024-09-21T13:38:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.852+0000 7f5a4effd640 1 -- 172.21.15.2:0/620557571 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+11490 (secure 0 0 0) 0x7f5a48068dc0 con 0x7f5a5010d110 2024-09-21T13:38:49.853 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:38:49.853 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":51,"fsid":"e6144070-781d-11ef-baf6-efdc52797490","created":"2024-09-21T13:33:08.087818+0000","modified":"2024-09-21T13:38:48.235064+0000","last_up_change":"2024-09-21T13:38:46.225842+0000","last_in_change":"2024-09-21T13:38:22.929302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T13:36:22.563835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0640c953-1dfe-4a1a-b6cb-18d1dc62aedd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6801","nonce":1847462361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1847462361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1847462361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6803","nonce":1847462361}]},"public_addr":"172.21.15.2:6801/1847462361","cluster_addr":"172.21.15.2:6802/1847462361","heartbeat_back_addr":"172.21.15.2:6804/1847462361","heartbeat_front_addr":"172.21.15.2:6803/1847462361","state":["exists","up"]},{"osd":1,"uuid":"0b42fdd3-2070-4813-aa0b-478d0c046e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6805","nonce":2166392982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2166392982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":2166392982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":2166392982}]},"public_addr":"172.21.15.2:6805/2166392982","cluster_addr":"172.21.15.2:6806/2166392982","heartbeat_back_addr":"172.21.15.2:6808/2166392982","heartbeat_front_addr":"172.21.15.2:6807/2166392982","state":["exists","up"]},{"osd":2,"uuid":"0a2b34c3-05ed-4d0d-9552-6656b9fe2419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6809","nonce":3095985277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3095985277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3095985277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6811","nonce":3095985277}]},"public_addr":"172.21.15.2:6809/3095985277","cluster_addr":"172.21.15.2:6810/3095985277","heartbeat_back_addr":"172.21.15.2:6812/3095985277","heartbeat_front_addr":"172.21.15.2:6811/3095985277","state":["exists","up"]},{"osd":3,"uuid":"4149f0d3-5d3e-4b2b-8112-533db72dba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6813","nonce":2270199396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2270199396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2270199396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":2270199396}]},"public_addr":"172.21.15.2:6813/2270199396","cluster_addr":"172.21.15.2:6814/2270199396","heartbeat_back_addr":"172.21.15.2:6816/2270199396","heartbeat_front_addr":"172.21.15.2:6815/2270199396","state":["exists","up"]},{"osd":4,"uuid":"21be965a-204b-4793-9f70-7929714c63d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2284803610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6801","nonce":2284803610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2284803610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2284803610}]},"public_addr":"172.21.15.162:6800/2284803610","cluster_addr":"172.21.15.162:6801/2284803610","heartbeat_back_addr":"172.21.15.162:6803/2284803610","heartbeat_front_addr":"172.21.15.162:6802/2284803610","state":["exists","up"]},{"osd":5,"uuid":"399a3f0f-876c-4ea2-abbc-799384e1ebb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":309339656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6805","nonce":309339656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":309339656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":309339656}]},"public_addr":"172.21.15.162:6804/309339656","cluster_addr":"172.21.15.162:6805/309339656","heartbeat_back_addr":"172.21.15.162:6807/309339656","heartbeat_front_addr":"172.21.15.162:6806/309339656","state":["exists","up"]},{"osd":6,"uuid":"b698a992-5f48-4c67-829c-814bf21c67c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1212984287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":1212984287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6811","nonce":1212984287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1212984287}]},"public_addr":"172.21.15.162:6808/1212984287","cluster_addr":"172.21.15.162:6809/1212984287","heartbeat_back_addr":"172.21.15.162:6811/1212984287","heartbeat_front_addr":"172.21.15.162:6810/1212984287","state":["exists","up"]},{"osd":7,"uuid":"4609ec1b-c176-4d2e-a3b3-d8feca508e5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4048001305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4048001305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6815","nonce":4048001305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4048001305}]},"public_addr":"172.21.15.162:6812/4048001305","cluster_addr":"172.21.15.162:6813/4048001305","heartbeat_back_addr":"172.21.15.162:6815/4048001305","heartbeat_front_addr":"172.21.15.162:6814/4048001305","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:35:18.527645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:35:49.353335+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:36:19.657138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:36:50.314490+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:37:18.009418+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:37:45.529771+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:38:14.768579+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:38:44.326049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/2286006400":"2024-09-22T13:33:58.101702+0000","172.21.15.2:6800/2044640733":"2024-09-22T13:33:58.101702+0000","172.21.15.2:0/2236300066":"2024-09-22T13:33:58.101702+0000","172.21.15.2:0/1818679566":"2024-09-22T13:33:58.101702+0000","172.21.15.2:0/1740908995":"2024-09-22T13:33:31.065333+0000","172.21.15.2:6800/3091351943":"2024-09-22T13:33:31.065333+0000","172.21.15.2:0/2919667121":"2024-09-22T13:33:31.065333+0000","172.21.15.2:0/1659939686":"2024-09-22T13:33:31.065333+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T13:38:49.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 -- 172.21.15.2:0/620557571 >> v2:172.21.15.2:6800/3897423974 conn(0x7f5a3807b020 msgr2=0x7f5a3807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:49.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 --2- 172.21.15.2:0/620557571 >> v2:172.21.15.2:6800/3897423974 conn(0x7f5a3807b020 0x7f5a3807d4e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000e810 tx=0x7f5a40009500 comp rx=0 tx=0).stop 2024-09-21T13:38:49.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 -- 172.21.15.2:0/620557571 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5a5010d110 msgr2=0x7f5a5019e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:49.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 --2- 172.21.15.2:0/620557571 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5a5010d110 0x7f5a5019e2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800b410 tx=0x7f5a4800b8d0 comp rx=0 tx=0).stop 2024-09-21T13:38:49.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 -- 172.21.15.2:0/620557571 shutdown_connections 2024-09-21T13:38:49.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 --2- 172.21.15.2:0/620557571 >> v2:172.21.15.2:6800/3897423974 conn(0x7f5a3807b020 0x7f5a3807d4e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:49.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 --2- 172.21.15.2:0/620557571 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5a5010d110 0x7f5a5019e2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:49.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 --2- 172.21.15.2:0/620557571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a501045d0 0x7f5a50198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:49.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 --2- 172.21.15.2:0/620557571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50103cb0 0x7f5a50198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:49.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 -- 172.21.15.2:0/620557571 >> 172.21.15.2:0/620557571 conn(0x7f5a500fd710 msgr2=0x7f5a50104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:49.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 -- 172.21.15.2:0/620557571 shutdown_connections 2024-09-21T13:38:49.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:49.854+0000 7f5a57b8c640 1 -- 172.21.15.2:0/620557571 wait complete. 2024-09-21T13:38:50.540 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/620557571' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T13:38:50.540 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/620557571' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T13:38:50.571 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T13:36:22.563835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T13:38:50.572 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T13:38:50.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/620557571' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T13:38:50.827 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:38:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.296+0000 7f6f83299640 1 -- 172.21.15.2:0/1492605239 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6f7c108030 msgr2=0x7f6f7c10e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.296+0000 7f6f83299640 1 --2- 172.21.15.2:0/1492605239 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6f7c108030 0x7f6f7c10e830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009be0 tx=0x7f6f7402a6c0 comp rx=0 tx=0).stop 2024-09-21T13:38:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.296+0000 7f6f83299640 1 -- 172.21.15.2:0/1492605239 shutdown_connections 2024-09-21T13:38:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.296+0000 7f6f83299640 1 --2- 172.21.15.2:0/1492605239 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6f7c108030 0x7f6f7c10e830 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.296+0000 7f6f83299640 1 --2- 172.21.15.2:0/1492605239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f7c1076b0 0x7f6f7c107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.296+0000 7f6f83299640 1 --2- 172.21.15.2:0/1492605239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f7c101ca0 0x7f6f7c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.296+0000 7f6f83299640 1 -- 172.21.15.2:0/1492605239 >> 172.21.15.2:0/1492605239 conn(0x7f6f7c0fd710 msgr2=0x7f6f7c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f83299640 1 -- 172.21.15.2:0/1492605239 shutdown_connections 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f83299640 1 -- 172.21.15.2:0/1492605239 wait complete. 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f83299640 1 Processor -- start 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f83299640 1 -- start start 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f83299640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6f7c101ca0 0x7f6f7c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f83299640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f7c1076b0 0x7f6f7c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f83299640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f7c108030 0x7f6f7c19e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f83299640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c1113c0 con 0x7f6f7c1076b0 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f83299640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c111240 con 0x7f6f7c108030 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f83299640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7c111540 con 0x7f6f7c101ca0 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f81035640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6f7c101ca0 0x7f6f7c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f80834640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f7c1076b0 0x7f6f7c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f81035640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6f7c101ca0 0x7f6f7c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:36618/0 (socket says 172.21.15.2:36618) 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.297+0000 7f6f81035640 1 -- 172.21.15.2:0/2701048261 learned_addr learned my addr 172.21.15.2:0/2701048261 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f81035640 1 -- 172.21.15.2:0/2701048261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f7c108030 msgr2=0x7f6f7c19e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f81035640 1 --2- 172.21.15.2:0/2701048261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f7c108030 0x7f6f7c19e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f81035640 1 -- 172.21.15.2:0/2701048261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f7c1076b0 msgr2=0x7f6f7c198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f81035640 1 --2- 172.21.15.2:0/2701048261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f7c1076b0 0x7f6f7c198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f81035640 1 -- 172.21.15.2:0/2701048261 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c19ea20 con 0x7f6f7c101ca0 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f80834640 1 --2- 172.21.15.2:0/2701048261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f7c1076b0 0x7f6f7c198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f81035640 1 --2- 172.21.15.2:0/2701048261 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6f7c101ca0 0x7f6f7c198970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800e9c0 tx=0x7f6f7800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f727fc640 1 -- 172.21.15.2:0/2701048261 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800cde0 con 0x7f6f7c101ca0 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f727fc640 1 -- 172.21.15.2:0/2701048261 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f6f780035f0 con 0x7f6f7c101ca0 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f83299640 1 -- 172.21.15.2:0/2701048261 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7c19ed10 con 0x7f6f7c101ca0 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f727fc640 1 -- 172.21.15.2:0/2701048261 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f780044a0 con 0x7f6f7c101ca0 2024-09-21T13:38:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.298+0000 7f6f83299640 1 -- 172.21.15.2:0/2701048261 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f7c1a55a0 con 0x7f6f7c101ca0 2024-09-21T13:38:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.299+0000 7f6f83299640 1 -- 172.21.15.2:0/2701048261 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f7c102080 con 0x7f6f7c101ca0 2024-09-21T13:38:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.300+0000 7f6f727fc640 1 -- 172.21.15.2:0/2701048261 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7f6f78004000 con 0x7f6f7c101ca0 2024-09-21T13:38:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.300+0000 7f6f727fc640 1 --2- 172.21.15.2:0/2701048261 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6f6807b020 0x7f6f6807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.300+0000 7f6f727fc640 1 -- 172.21.15.2:0/2701048261 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(51..51 src has 1..51) ==== 4081+0+0 (secure 0 0 0) 0x7f6f7809dcf0 con 0x7f6f7c101ca0 2024-09-21T13:38:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.300+0000 7f6f80834640 1 --2- 172.21.15.2:0/2701048261 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6f6807b020 0x7f6f6807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.301+0000 7f6f80834640 1 --2- 172.21.15.2:0/2701048261 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6f6807b020 0x7f6f6807d4e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c101140 tx=0x7f6f6c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.305+0000 7f6f727fc640 1 -- 172.21.15.2:0/2701048261 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f780a2070 con 0x7f6f7c101ca0 2024-09-21T13:38:51.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.492+0000 7f6f83299640 1 -- 172.21.15.2:0/2701048261 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6f7c10ae20 con 0x7f6f7c101ca0 2024-09-21T13:38:51.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:51 smithi002 ceph-mon[30076]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 440 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:51.493 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:51 smithi002 ceph-mon[40622]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 440 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:51.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.493+0000 7f6f727fc640 1 -- 172.21.15.2:0/2701048261 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7f6f780657a0 con 0x7f6f7c101ca0 2024-09-21T13:38:51.494 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-21T13:38:51.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 -- 172.21.15.2:0/2701048261 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6f6807b020 msgr2=0x7f6f6807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:51.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 --2- 172.21.15.2:0/2701048261 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6f6807b020 0x7f6f6807d4e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c101140 tx=0x7f6f6c00b390 comp rx=0 tx=0).stop 2024-09-21T13:38:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 -- 172.21.15.2:0/2701048261 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6f7c101ca0 msgr2=0x7f6f7c198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 --2- 172.21.15.2:0/2701048261 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6f7c101ca0 0x7f6f7c198970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800e9c0 tx=0x7f6f7800ee80 comp rx=0 tx=0).stop 2024-09-21T13:38:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 -- 172.21.15.2:0/2701048261 shutdown_connections 2024-09-21T13:38:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 --2- 172.21.15.2:0/2701048261 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6f6807b020 0x7f6f6807d4e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 --2- 172.21.15.2:0/2701048261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f7c108030 0x7f6f7c19e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 --2- 172.21.15.2:0/2701048261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f7c1076b0 0x7f6f7c198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 --2- 172.21.15.2:0/2701048261 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6f7c101ca0 0x7f6f7c198970 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 -- 172.21.15.2:0/2701048261 >> 172.21.15.2:0/2701048261 conn(0x7f6f7c0fd710 msgr2=0x7f6f7c06b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 -- 172.21.15.2:0/2701048261 shutdown_connections 2024-09-21T13:38:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:38:51.495+0000 7f6f83299640 1 -- 172.21.15.2:0/2701048261 wait complete. 2024-09-21T13:38:51.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:51 smithi162 ceph-mon[33046]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 440 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:52.333 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi002 2024-09-21T13:38:52.334 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch apply rgw foo.a --placement '1;smithi002=foo.a' 2024-09-21T13:38:52.595 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:38:52.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2701048261' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T13:38:52.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2701048261' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T13:38:52.715 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2701048261' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T13:38:53.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.066+0000 7f8a05af0640 1 -- 172.21.15.162:0/2511808434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0006b520 msgr2=0x7f8a00107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:53.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.066+0000 7f8a05af0640 1 --2- 172.21.15.162:0/2511808434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0006b520 0x7f8a00107a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009900 tx=0x7f89f002a410 comp rx=0 tx=0).stop 2024-09-21T13:38:53.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.066+0000 7f8a05af0640 1 -- 172.21.15.162:0/2511808434 shutdown_connections 2024-09-21T13:38:53.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.066+0000 7f8a05af0640 1 --2- 172.21.15.162:0/2511808434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a0010a930 0x7f8a0010cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:53.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.066+0000 7f8a05af0640 1 --2- 172.21.15.162:0/2511808434 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8a00107f80 0x7f8a0010a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:53.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.066+0000 7f8a05af0640 1 --2- 172.21.15.162:0/2511808434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0006b520 0x7f8a00107a40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:53.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.067+0000 7f8a05af0640 1 -- 172.21.15.162:0/2511808434 >> 172.21.15.162:0/2511808434 conn(0x7f8a000fd1b0 msgr2=0x7f8a000ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:53.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.067+0000 7f8a05af0640 1 -- 172.21.15.162:0/2511808434 shutdown_connections 2024-09-21T13:38:53.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.067+0000 7f8a05af0640 1 -- 172.21.15.162:0/2511808434 wait complete. 2024-09-21T13:38:53.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.067+0000 7f8a05af0640 1 Processor -- start 2024-09-21T13:38:53.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.067+0000 7f8a05af0640 1 -- start start 2024-09-21T13:38:53.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f8a05af0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a0006b520 0x7f8a0019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:53.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f8a05af0640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8a00107f80 0x7f8a0019ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:53.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f8a05af0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0010a930 0x7f8a0019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:53.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f8a05af0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0010ff40 con 0x7f8a0006b520 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f8a05af0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0010fdc0 con 0x7f8a0010a930 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f8a05af0640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f8a001100c0 con 0x7f8a00107f80 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0010a930 0x7f8a0019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0010a930 0x7f8a0019b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:48518/0 (socket says 172.21.15.162:48518) 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fffff640 1 -- 172.21.15.162:0/1140614306 learned_addr learned my addr 172.21.15.162:0/1140614306 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89ff7fe640 1 --2- 172.21.15.162:0/1140614306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a0006b520 0x7f8a0019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89feffd640 1 --2- 172.21.15.162:0/1140614306 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8a00107f80 0x7f8a0019ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fffff640 1 -- 172.21.15.162:0/1140614306 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8a00107f80 msgr2=0x7f8a0019ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fffff640 1 --2- 172.21.15.162:0/1140614306 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8a00107f80 0x7f8a0019ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fffff640 1 -- 172.21.15.162:0/1140614306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a0006b520 msgr2=0x7f8a0019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fffff640 1 --2- 172.21.15.162:0/1140614306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a0006b520 0x7f8a0019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fffff640 1 -- 172.21.15.162:0/1140614306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0019c240 con 0x7f8a0010a930 2024-09-21T13:38:53.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89ff7fe640 1 --2- 172.21.15.162:0/1140614306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a0006b520 0x7f8a0019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:38:53.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89feffd640 1 --2- 172.21.15.162:0/1140614306 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8a00107f80 0x7f8a0019ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:38:53.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fffff640 1 --2- 172.21.15.162:0/1140614306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0010a930 0x7f8a0019b9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89f800cad0 tx=0x7f89f800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:53.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fcff9640 1 -- 172.21.15.162:0/1140614306 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f800ae20 con 0x7f8a0010a930 2024-09-21T13:38:53.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fcff9640 1 -- 172.21.15.162:0/1140614306 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f89f8005020 con 0x7f8a0010a930 2024-09-21T13:38:53.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f8a05af0640 1 -- 172.21.15.162:0/1140614306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0019c530 con 0x7f8a0010a930 2024-09-21T13:38:53.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.068+0000 7f89fcff9640 1 -- 172.21.15.162:0/1140614306 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f800f6b0 con 0x7f8a0010a930 2024-09-21T13:38:53.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.069+0000 7f8a05af0640 1 -- 172.21.15.162:0/1140614306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a001a2c10 con 0x7f8a0010a930 2024-09-21T13:38:53.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.070+0000 7f8a05af0640 1 -- 172.21.15.162:0/1140614306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a00107a40 con 0x7f8a0010a930 2024-09-21T13:38:53.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.070+0000 7f89fcff9640 1 -- 172.21.15.162:0/1140614306 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7f89f800f850 con 0x7f8a0010a930 2024-09-21T13:38:53.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.070+0000 7f89fcff9640 1 --2- 172.21.15.162:0/1140614306 >> v2:172.21.15.2:6800/3897423974 conn(0x7f89e807b020 0x7f89e807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:53.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.071+0000 7f89fcff9640 1 -- 172.21.15.162:0/1140614306 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4081+0+0 (secure 0 0 0) 0x7f89f809da60 con 0x7f8a0010a930 2024-09-21T13:38:53.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.071+0000 7f89ff7fe640 1 --2- 172.21.15.162:0/1140614306 >> v2:172.21.15.2:6800/3897423974 conn(0x7f89e807b020 0x7f89e807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:53.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.071+0000 7f89ff7fe640 1 --2- 172.21.15.162:0/1140614306 >> v2:172.21.15.2:6800/3897423974 conn(0x7f89e807b020 0x7f89e807d4e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89f00096c0 tx=0x7f89f00316e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:53.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.075+0000 7f89fcff9640 1 -- 172.21.15.162:0/1140614306 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89f8014030 con 0x7f8a0010a930 2024-09-21T13:38:53.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.267+0000 7f8a05af0640 1 -- 172.21.15.162:0/1140614306 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi002=foo.a", "target": ["mon-mgr", ""]}) -- 0x7f8a00109a80 con 0x7f89e807b020 2024-09-21T13:38:53.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.274+0000 7f89fcff9640 1 -- 172.21.15.162:0/1140614306 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f8a00109a80 con 0x7f89e807b020 2024-09-21T13:38:53.275 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled rgw.foo.a update... 2024-09-21T13:38:53.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 -- 172.21.15.162:0/1140614306 >> v2:172.21.15.2:6800/3897423974 conn(0x7f89e807b020 msgr2=0x7f89e807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:53.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 --2- 172.21.15.162:0/1140614306 >> v2:172.21.15.2:6800/3897423974 conn(0x7f89e807b020 0x7f89e807d4e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89f00096c0 tx=0x7f89f00316e0 comp rx=0 tx=0).stop 2024-09-21T13:38:53.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 -- 172.21.15.162:0/1140614306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0010a930 msgr2=0x7f8a0019b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:53.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 --2- 172.21.15.162:0/1140614306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0010a930 0x7f8a0019b9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89f800cad0 tx=0x7f89f800cf90 comp rx=0 tx=0).stop 2024-09-21T13:38:53.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 -- 172.21.15.162:0/1140614306 shutdown_connections 2024-09-21T13:38:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 --2- 172.21.15.162:0/1140614306 >> v2:172.21.15.2:6800/3897423974 conn(0x7f89e807b020 0x7f89e807d4e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 --2- 172.21.15.162:0/1140614306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0010a930 0x7f8a0019b9a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 --2- 172.21.15.162:0/1140614306 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f8a00107f80 0x7f8a0019ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 --2- 172.21.15.162:0/1140614306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a0006b520 0x7f8a0019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 -- 172.21.15.162:0/1140614306 >> 172.21.15.162:0/1140614306 conn(0x7f8a000fd1b0 msgr2=0x7f8a00108360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 -- 172.21.15.162:0/1140614306 shutdown_connections 2024-09-21T13:38:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:53.276+0000 7f8a05af0640 1 -- 172.21.15.162:0/1140614306 wait complete. 2024-09-21T13:38:53.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:53 smithi162 ceph-mon[33046]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:53.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:53 smithi002 ceph-mon[30076]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:53.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:53 smithi002 ceph-mon[40622]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:53.904 DEBUG:teuthology.orchestra.run.smithi002:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@rgw.foo.a.service 2024-09-21T13:38:53.906 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi162 2024-09-21T13:38:53.906 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd pool create datapool 3 3 replicated 2024-09-21T13:38:54.149 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:38:54.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi002=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:38:54.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: Saving service rgw.foo.a spec with placement smithi002=foo.a;count:1 2024-09-21T13:38:54.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:54.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:54.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:54.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:54.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:54.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T13:38:54.523 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T13:38:54.523 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:54.523 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:54.523 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:54 smithi162 ceph-mon[33046]: Deploying daemon rgw.foo.a on smithi002 2024-09-21T13:38:54.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi002=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:38:54.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: Saving service rgw.foo.a spec with placement smithi002=foo.a;count:1 2024-09-21T13:38:54.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:54.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:54.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:54.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:54.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:54.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T13:38:54.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T13:38:54.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:54.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:54.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[40622]: Deploying daemon rgw.foo.a on smithi002 2024-09-21T13:38:54.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi002=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:38:54.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: Saving service rgw.foo.a spec with placement smithi002=foo.a;count:1 2024-09-21T13:38:54.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:54.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:54.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:54.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:54.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:54.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T13:38:54.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T13:38:54.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:54.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:54.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:54 smithi002 ceph-mon[30076]: Deploying daemon rgw.foo.a on smithi002 2024-09-21T13:38:54.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.606+0000 7fae4303d640 1 -- 172.21.15.162:0/4042211661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae3c103430 msgr2=0x7fae3c109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:54.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.606+0000 7fae4303d640 1 --2- 172.21.15.162:0/4042211661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae3c103430 0x7fae3c109db0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae34009cd0 tx=0x7fae3402a8e0 comp rx=0 tx=0).stop 2024-09-21T13:38:54.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.606+0000 7fae4303d640 1 -- 172.21.15.162:0/4042211661 shutdown_connections 2024-09-21T13:38:54.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.606+0000 7fae4303d640 1 --2- 172.21.15.162:0/4042211661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae3c103430 0x7fae3c109db0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:54.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.606+0000 7fae4303d640 1 --2- 172.21.15.162:0/4042211661 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fae3c102a70 0x7fae3c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:54.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.606+0000 7fae4303d640 1 --2- 172.21.15.162:0/4042211661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae3c101910 0x7fae3c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:54.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.606+0000 7fae4303d640 1 -- 172.21.15.162:0/4042211661 >> 172.21.15.162:0/4042211661 conn(0x7fae3c0fd200 msgr2=0x7fae3c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:54.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.606+0000 7fae4303d640 1 -- 172.21.15.162:0/4042211661 shutdown_connections 2024-09-21T13:38:54.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.606+0000 7fae4303d640 1 -- 172.21.15.162:0/4042211661 wait complete. 2024-09-21T13:38:54.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae4303d640 1 Processor -- start 2024-09-21T13:38:54.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae4303d640 1 -- start start 2024-09-21T13:38:54.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae4303d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae3c101910 0x7fae3c06bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:54.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae4303d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae3c102a70 0x7fae3c19d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:54.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae4303d640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fae3c103430 0x7fae3c19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:54.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae4303d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c10cc60 con 0x7fae3c101910 2024-09-21T13:38:54.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae4303d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c10cae0 con 0x7fae3c102a70 2024-09-21T13:38:54.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae4303d640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fae3c10cde0 con 0x7fae3c103430 2024-09-21T13:38:54.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae3bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae3c102a70 0x7fae3c19d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:54.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae40dd9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae3c101910 0x7fae3c06bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae3bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae3c102a70 0x7fae3c19d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:48538/0 (socket says 172.21.15.162:48538) 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae415da640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fae3c103430 0x7fae3c19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae3bfff640 1 -- 172.21.15.162:0/3104365537 learned_addr learned my addr 172.21.15.162:0/3104365537 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae3bfff640 1 -- 172.21.15.162:0/3104365537 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fae3c103430 msgr2=0x7fae3c19f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae3bfff640 1 --2- 172.21.15.162:0/3104365537 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fae3c103430 0x7fae3c19f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae3bfff640 1 -- 172.21.15.162:0/3104365537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae3c101910 msgr2=0x7fae3c06bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae3bfff640 1 --2- 172.21.15.162:0/3104365537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae3c101910 0x7fae3c06bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae3bfff640 1 -- 172.21.15.162:0/3104365537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3c1a00f0 con 0x7fae3c102a70 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.607+0000 7fae3bfff640 1 --2- 172.21.15.162:0/3104365537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae3c102a70 0x7fae3c19d240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae2800e9f0 tx=0x7fae2800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.608+0000 7fae39ffb640 1 -- 172.21.15.162:0/3104365537 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2800cd80 con 0x7fae3c102a70 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.608+0000 7fae39ffb640 1 -- 172.21.15.162:0/3104365537 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fae280054a0 con 0x7fae3c102a70 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.608+0000 7fae4303d640 1 -- 172.21.15.162:0/3104365537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3c1a03e0 con 0x7fae3c102a70 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.608+0000 7fae39ffb640 1 -- 172.21.15.162:0/3104365537 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28010430 con 0x7fae3c102a70 2024-09-21T13:38:54.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.608+0000 7fae4303d640 1 -- 172.21.15.162:0/3104365537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae3c1a08d0 con 0x7fae3c102a70 2024-09-21T13:38:54.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.609+0000 7fae4303d640 1 -- 172.21.15.162:0/3104365537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae3c101d10 con 0x7fae3c102a70 2024-09-21T13:38:54.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.609+0000 7fae39ffb640 1 -- 172.21.15.162:0/3104365537 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7fae28005020 con 0x7fae3c102a70 2024-09-21T13:38:54.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.610+0000 7fae39ffb640 1 --2- 172.21.15.162:0/3104365537 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae2c07b020 0x7fae2c07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:38:54.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.610+0000 7fae39ffb640 1 -- 172.21.15.162:0/3104365537 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4081+0+0 (secure 0 0 0) 0x7fae2809dd80 con 0x7fae3c102a70 2024-09-21T13:38:54.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.610+0000 7fae40dd9640 1 --2- 172.21.15.162:0/3104365537 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae2c07b020 0x7fae2c07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:38:54.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.610+0000 7fae40dd9640 1 --2- 172.21.15.162:0/3104365537 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae2c07b020 0x7fae2c07d4e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae30009bd0 tx=0x7fae30005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:38:54.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.614+0000 7fae39ffb640 1 -- 172.21.15.162:0/3104365537 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae28069c50 con 0x7fae3c102a70 2024-09-21T13:38:54.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:54.796+0000 7fae4303d640 1 -- 172.21.15.162:0/3104365537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) -- 0x7fae3c02e880 con 0x7fae3c102a70 2024-09-21T13:38:55.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.631+0000 7fae39ffb640 1 -- 172.21.15.162:0/3104365537 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v52) ==== 160+0+0 (secure 0 0 0) 0x7fae2806eb00 con 0x7fae3c102a70 2024-09-21T13:38:55.632 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'datapool' created 2024-09-21T13:38:55.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 -- 172.21.15.162:0/3104365537 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae2c07b020 msgr2=0x7fae2c07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:55.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 --2- 172.21.15.162:0/3104365537 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae2c07b020 0x7fae2c07d4e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae30009bd0 tx=0x7fae30005f90 comp rx=0 tx=0).stop 2024-09-21T13:38:55.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 -- 172.21.15.162:0/3104365537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae3c102a70 msgr2=0x7fae3c19d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:38:55.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 --2- 172.21.15.162:0/3104365537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae3c102a70 0x7fae3c19d240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae2800e9f0 tx=0x7fae2800edf0 comp rx=0 tx=0).stop 2024-09-21T13:38:55.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 -- 172.21.15.162:0/3104365537 shutdown_connections 2024-09-21T13:38:55.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 --2- 172.21.15.162:0/3104365537 >> v2:172.21.15.2:6800/3897423974 conn(0x7fae2c07b020 0x7fae2c07d4e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:55.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 --2- 172.21.15.162:0/3104365537 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fae3c103430 0x7fae3c19f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:55.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 --2- 172.21.15.162:0/3104365537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae3c102a70 0x7fae3c19d240 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:55.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 --2- 172.21.15.162:0/3104365537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae3c101910 0x7fae3c06bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:38:55.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 -- 172.21.15.162:0/3104365537 >> 172.21.15.162:0/3104365537 conn(0x7fae3c0fd200 msgr2=0x7fae3c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:38:55.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 -- 172.21.15.162:0/3104365537 shutdown_connections 2024-09-21T13:38:55.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:38:55.634+0000 7fae4303d640 1 -- 172.21.15.162:0/3104365537 wait complete. 2024-09-21T13:38:55.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:55 smithi002 ceph-mon[30076]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:55.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/3104365537' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T13:38:55.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T13:38:55.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:55 smithi002 ceph-mon[40622]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:55.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/3104365537' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T13:38:55.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T13:38:55.851 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:38:55 smithi002 systemd[1]: Starting Ceph rgw.foo.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:38:55.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:55 smithi162 ceph-mon[33046]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:55.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/3104365537' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T13:38:55.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-21T13:38:56.111 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:38:55 smithi002 podman[66851]: 2024-09-21 13:38:55.761807679 +0000 UTC m=+0.016250278 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:38:56.111 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:38:55 smithi002 podman[66851]: 2024-09-21 13:38:55.866655451 +0000 UTC m=+0.121098040 container create 89bb81dd660f72d8d0e2a410979b9c000ed9f4431a9819dd77a17a5c692c63bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-rgw-foo-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T13:38:56.111 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:38:56 smithi002 podman[66851]: 2024-09-21 13:38:56.110625188 +0000 UTC m=+0.365067778 container init 89bb81dd660f72d8d0e2a410979b9c000ed9f4431a9819dd77a17a5c692c63bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-rgw-foo-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T13:38:56.252 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- rbd pool init datapool 2024-09-21T13:38:56.521 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:38:56.600 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:38:56 smithi002 podman[66851]: 2024-09-21 13:38:56.115554427 +0000 UTC m=+0.369997017 container start 89bb81dd660f72d8d0e2a410979b9c000ed9f4431a9819dd77a17a5c692c63bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-rgw-foo-a, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T13:38:56.600 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:38:56 smithi002 bash[66851]: 89bb81dd660f72d8d0e2a410979b9c000ed9f4431a9819dd77a17a5c692c63bb 2024-09-21T13:38:56.600 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:38:56 smithi002 systemd[1]: Started Ceph rgw.foo.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:38:56.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-21T13:38:56.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[30076]: osdmap e52: 8 total, 8 up, 8 in 2024-09-21T13:38:56.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:56.898 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-21T13:38:56.898 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[40622]: osdmap e52: 8 total, 8 up, 8 in 2024-09-21T13:38:56.898 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.898 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.898 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.898 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.898 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.898 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:56 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:56.959 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-21T13:38:56.959 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:56 smithi162 ceph-mon[33046]: osdmap e52: 8 total, 8 up, 8 in 2024-09-21T13:38:56.959 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:56 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.959 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:56 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.959 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:56 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.960 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:56 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.960 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:56 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:56.960 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:56 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:38:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:57 smithi162 ceph-mon[33046]: pgmap v191: 4 pgs: 3 unknown, 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:57 smithi162 ceph-mon[33046]: Saving service rgw.foo.a spec with placement smithi002=foo.a;count:1 2024-09-21T13:38:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:57 smithi162 ceph-mon[33046]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:38:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:57 smithi162 ceph-mon[33046]: osdmap e53: 8 total, 8 up, 8 in 2024-09-21T13:38:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/983244416' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-21T13:38:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-21T13:38:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/1677885843' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T13:38:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T13:38:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[40622]: pgmap v191: 4 pgs: 3 unknown, 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[40622]: Saving service rgw.foo.a spec with placement smithi002=foo.a;count:1 2024-09-21T13:38:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[40622]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:38:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[40622]: osdmap e53: 8 total, 8 up, 8 in 2024-09-21T13:38:58.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/983244416' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-21T13:38:58.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-21T13:38:58.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/1677885843' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T13:38:58.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T13:38:58.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[30076]: pgmap v191: 4 pgs: 3 unknown, 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:58.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[30076]: Saving service rgw.foo.a spec with placement smithi002=foo.a;count:1 2024-09-21T13:38:58.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[30076]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:38:58.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[30076]: osdmap e53: 8 total, 8 up, 8 in 2024-09-21T13:38:58.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/983244416' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-21T13:38:58.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-21T13:38:58.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/1677885843' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T13:38:58.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-21T13:38:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-21T13:38:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-21T13:38:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:58 smithi162 ceph-mon[33046]: osdmap e54: 8 total, 8 up, 8 in 2024-09-21T13:38:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:58 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:58 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:58 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:58 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:58 smithi162 ceph-mon[33046]: Checking dashboard <-> RGW credentials 2024-09-21T13:38:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:58 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-21T13:38:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-21T13:38:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[30076]: osdmap e54: 8 total, 8 up, 8 in 2024-09-21T13:38:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[30076]: Checking dashboard <-> RGW credentials 2024-09-21T13:38:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-21T13:38:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-21T13:38:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[40622]: osdmap e54: 8 total, 8 up, 8 in 2024-09-21T13:38:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:38:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:38:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[40622]: Checking dashboard <-> RGW credentials 2024-09-21T13:38:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:58 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:38:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:59 smithi162 ceph-mon[33046]: pgmap v194: 36 pgs: 5 creating+peering, 8 active+clean, 23 unknown; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:38:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:59 smithi162 ceph-mon[33046]: osdmap e55: 8 total, 8 up, 8 in 2024-09-21T13:38:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:38:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:38:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:38:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:59 smithi162 ceph-mon[33046]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:38:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:59 smithi162 ceph-mon[33046]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T13:38:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:59 smithi162 ceph-mon[33046]: Cluster is now healthy 2024-09-21T13:38:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T13:38:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:59 smithi162 ceph-mon[33046]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T13:38:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:38:59 smithi162 ceph-mon[33046]: osdmap e56: 8 total, 8 up, 8 in 2024-09-21T13:39:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[30076]: pgmap v194: 36 pgs: 5 creating+peering, 8 active+clean, 23 unknown; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:39:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[30076]: osdmap e55: 8 total, 8 up, 8 in 2024-09-21T13:39:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:39:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:39:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:39:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[30076]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:39:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[30076]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T13:39:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[30076]: Cluster is now healthy 2024-09-21T13:39:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[30076]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[30076]: osdmap e56: 8 total, 8 up, 8 in 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[40622]: pgmap v194: 36 pgs: 5 creating+peering, 8 active+clean, 23 unknown; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[40622]: osdmap e55: 8 total, 8 up, 8 in 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[40622]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[40622]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[40622]: Cluster is now healthy 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T13:39:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[40622]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-21T13:39:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:38:59 smithi002 ceph-mon[40622]: osdmap e56: 8 total, 8 up, 8 in 2024-09-21T13:39:00.276 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.162 --placement '1;smithi162=iscsi.a' 2024-09-21T13:39:00.528 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:39:00.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.981+0000 7f35e225e640 1 -- 172.21.15.162:0/2807513112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35dc102a00 msgr2=0x7f35dc102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:00.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.981+0000 7f35e225e640 1 --2- 172.21.15.162:0/2807513112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35dc102a00 0x7f35dc102e00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009930 tx=0x7f35cc02a420 comp rx=0 tx=0).stop 2024-09-21T13:39:00.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.981+0000 7f35e225e640 1 -- 172.21.15.162:0/2807513112 shutdown_connections 2024-09-21T13:39:00.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.981+0000 7f35e225e640 1 --2- 172.21.15.162:0/2807513112 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f35dc104520 0x7f35dc10aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:00.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.981+0000 7f35e225e640 1 --2- 172.21.15.162:0/2807513112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc103b60 0x7f35dc103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:00.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.981+0000 7f35e225e640 1 --2- 172.21.15.162:0/2807513112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35dc102a00 0x7f35dc102e00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:00.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.982+0000 7f35e225e640 1 -- 172.21.15.162:0/2807513112 >> 172.21.15.162:0/2807513112 conn(0x7f35dc0fe2f0 msgr2=0x7f35dc100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:00.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.982+0000 7f35e225e640 1 -- 172.21.15.162:0/2807513112 shutdown_connections 2024-09-21T13:39:00.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.982+0000 7f35e225e640 1 -- 172.21.15.162:0/2807513112 wait complete. 2024-09-21T13:39:00.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.982+0000 7f35e225e640 1 Processor -- start 2024-09-21T13:39:00.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.982+0000 7f35e225e640 1 -- start start 2024-09-21T13:39:00.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.982+0000 7f35e225e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc102a00 0x7f35dc198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:00.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.982+0000 7f35e225e640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f35dc103b60 0x7f35dc198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:00.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.982+0000 7f35e225e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35dc104520 0x7f35dc1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:00.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.982+0000 7f35e225e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc10de60 con 0x7f35dc102a00 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.982+0000 7f35e225e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc10dce0 con 0x7f35dc104520 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35e225e640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f35dc10dfe0 con 0x7f35dc103b60 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35dbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35dc104520 0x7f35dc1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35dbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35dc104520 0x7f35dc1998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51610/0 (socket says 172.21.15.162:51610) 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35dbfff640 1 -- 172.21.15.162:0/484172908 learned_addr learned my addr 172.21.15.162:0/484172908 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35daffd640 1 --2- 172.21.15.162:0/484172908 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f35dc103b60 0x7f35dc198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35db7fe640 1 --2- 172.21.15.162:0/484172908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc102a00 0x7f35dc198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35dbfff640 1 -- 172.21.15.162:0/484172908 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f35dc103b60 msgr2=0x7f35dc198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35dbfff640 1 --2- 172.21.15.162:0/484172908 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f35dc103b60 0x7f35dc198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35dbfff640 1 -- 172.21.15.162:0/484172908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc102a00 msgr2=0x7f35dc198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35dbfff640 1 --2- 172.21.15.162:0/484172908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc102a00 0x7f35dc198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35dbfff640 1 -- 172.21.15.162:0/484172908 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc19a170 con 0x7f35dc104520 2024-09-21T13:39:00.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35dbfff640 1 --2- 172.21.15.162:0/484172908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35dc104520 0x7f35dc1998d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f35d400b970 tx=0x7f35d400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:00.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35d8ff9640 1 -- 172.21.15.162:0/484172908 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4019070 con 0x7f35dc104520 2024-09-21T13:39:00.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35d8ff9640 1 -- 172.21.15.162:0/484172908 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f35d4014440 con 0x7f35dc104520 2024-09-21T13:39:00.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35e225e640 1 -- 172.21.15.162:0/484172908 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc19a460 con 0x7f35dc104520 2024-09-21T13:39:00.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35d8ff9640 1 -- 172.21.15.162:0/484172908 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d40075d0 con 0x7f35dc104520 2024-09-21T13:39:00.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.983+0000 7f35e225e640 1 -- 172.21.15.162:0/484172908 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc1a0b40 con 0x7f35dc104520 2024-09-21T13:39:00.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.984+0000 7f35e225e640 1 -- 172.21.15.162:0/484172908 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35dc102e80 con 0x7f35dc104520 2024-09-21T13:39:00.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.985+0000 7f35d8ff9640 1 -- 172.21.15.162:0/484172908 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7f35d401c070 con 0x7f35dc104520 2024-09-21T13:39:00.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.985+0000 7f35d8ff9640 1 --2- 172.21.15.162:0/484172908 >> v2:172.21.15.2:6800/3897423974 conn(0x7f35c407b020 0x7f35c407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:00.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.985+0000 7f35d8ff9640 1 -- 172.21.15.162:0/484172908 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5549+0+0 (secure 0 0 0) 0x7f35d409d460 con 0x7f35dc104520 2024-09-21T13:39:00.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.986+0000 7f35db7fe640 1 --2- 172.21.15.162:0/484172908 >> v2:172.21.15.2:6800/3897423974 conn(0x7f35c407b020 0x7f35c407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:00.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.986+0000 7f35db7fe640 1 --2- 172.21.15.162:0/484172908 >> v2:172.21.15.2:6800/3897423974 conn(0x7f35c407b020 0x7f35c407d4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35cc006010 tx=0x7f35cc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:00.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:00.990+0000 7f35d8ff9640 1 -- 172.21.15.162:0/484172908 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35d4068d40 con 0x7f35dc104520 2024-09-21T13:39:01.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.178+0000 7f35e225e640 1 -- 172.21.15.162:0/484172908 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.162", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}) -- 0x7f35dc02e8d0 con 0x7f35c407b020 2024-09-21T13:39:01.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.188+0000 7f35d8ff9640 1 -- 172.21.15.162:0/484172908 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+35 (secure 0 0 0) 0x7f35dc02e8d0 con 0x7f35c407b020 2024-09-21T13:39:01.189 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled iscsi.datapool update... 2024-09-21T13:39:01.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 -- 172.21.15.162:0/484172908 >> v2:172.21.15.2:6800/3897423974 conn(0x7f35c407b020 msgr2=0x7f35c407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:01.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 --2- 172.21.15.162:0/484172908 >> v2:172.21.15.2:6800/3897423974 conn(0x7f35c407b020 0x7f35c407d4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35cc006010 tx=0x7f35cc000bc0 comp rx=0 tx=0).stop 2024-09-21T13:39:01.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 -- 172.21.15.162:0/484172908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35dc104520 msgr2=0x7f35dc1998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:01.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 --2- 172.21.15.162:0/484172908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35dc104520 0x7f35dc1998d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f35d400b970 tx=0x7f35d400be30 comp rx=0 tx=0).stop 2024-09-21T13:39:01.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 -- 172.21.15.162:0/484172908 shutdown_connections 2024-09-21T13:39:01.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 --2- 172.21.15.162:0/484172908 >> v2:172.21.15.2:6800/3897423974 conn(0x7f35c407b020 0x7f35c407d4e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:01.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 --2- 172.21.15.162:0/484172908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35dc104520 0x7f35dc1998d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:01.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 --2- 172.21.15.162:0/484172908 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f35dc103b60 0x7f35dc198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:01.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 --2- 172.21.15.162:0/484172908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc102a00 0x7f35dc198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:01.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 -- 172.21.15.162:0/484172908 >> 172.21.15.162:0/484172908 conn(0x7f35dc0fe2f0 msgr2=0x7f35dc0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:01.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 -- 172.21.15.162:0/484172908 shutdown_connections 2024-09-21T13:39:01.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:01.190+0000 7f35e225e640 1 -- 172.21.15.162:0/484172908 wait complete. 2024-09-21T13:39:01.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:01 smithi162 ceph-mon[33046]: pgmap v197: 68 pgs: 5 creating+peering, 27 active+clean, 36 unknown; 578 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:39:01.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:01 smithi162 ceph-mon[33046]: osdmap e57: 8 total, 8 up, 8 in 2024-09-21T13:39:01.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:01.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:01.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:01.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:01 smithi162 ceph-mon[33046]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:01.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:01 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:01.873 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-09-21T13:39:01.874 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:39:01.874 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-21T13:39:01.905 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:39:01.905 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-21T13:39:01.931 DEBUG:teuthology.orchestra.run.smithi162:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@iscsi.iscsi.a.service 2024-09-21T13:39:01.974 INFO:tasks.cephadm:Adding prometheus.a on smithi162 2024-09-21T13:39:01.974 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch apply prometheus '1;smithi162=a' 2024-09-21T13:39:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[30076]: pgmap v197: 68 pgs: 5 creating+peering, 27 active+clean, 36 unknown; 578 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:39:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[30076]: osdmap e57: 8 total, 8 up, 8 in 2024-09-21T13:39:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[30076]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[40622]: pgmap v197: 68 pgs: 5 creating+peering, 27 active+clean, 36 unknown; 578 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:39:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[40622]: osdmap e57: 8 total, 8 up, 8 in 2024-09-21T13:39:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[40622]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-21T13:39:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:01 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:02.257 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:39:02.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.745+0000 7f77c6660640 1 -- 172.21.15.162:0/1544913038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0103b60 msgr2=0x7f77c0103fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.745+0000 7f77c6660640 1 --2- 172.21.15.162:0/1544913038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0103b60 0x7f77c0103fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009930 tx=0x7f77b402a420 comp rx=0 tx=0).stop 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.745+0000 7f77c6660640 1 -- 172.21.15.162:0/1544913038 shutdown_connections 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.745+0000 7f77c6660640 1 --2- 172.21.15.162:0/1544913038 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f77c0104520 0x7f77c010aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.745+0000 7f77c6660640 1 --2- 172.21.15.162:0/1544913038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0103b60 0x7f77c0103fe0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.745+0000 7f77c6660640 1 --2- 172.21.15.162:0/1544913038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c0102a00 0x7f77c0102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.745+0000 7f77c6660640 1 -- 172.21.15.162:0/1544913038 >> 172.21.15.162:0/1544913038 conn(0x7f77c00fe2f0 msgr2=0x7f77c0100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.745+0000 7f77c6660640 1 -- 172.21.15.162:0/1544913038 shutdown_connections 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.745+0000 7f77c6660640 1 -- 172.21.15.162:0/1544913038 wait complete. 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.745+0000 7f77c6660640 1 Processor -- start 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.745+0000 7f77c6660640 1 -- start start 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77c6660640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f77c0102a00 0x7f77c01984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:02.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77c6660640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0103b60 0x7f77c0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77c6660640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c0104520 0x7f77c0199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77c6660640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77c010dd30 con 0x7f77c0104520 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77c6660640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77c010dbb0 con 0x7f77c0103b60 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77c6660640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f77c010deb0 con 0x7f77c0102a00 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0103b60 0x7f77c0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0103b60 0x7f77c0198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51620/0 (socket says 172.21.15.162:51620) 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bf7fe640 1 -- 172.21.15.162:0/2808190670 learned_addr learned my addr 172.21.15.162:0/2808190670 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bffff640 1 --2- 172.21.15.162:0/2808190670 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f77c0102a00 0x7f77c01984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77c4bfd640 1 --2- 172.21.15.162:0/2808190670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c0104520 0x7f77c0199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bf7fe640 1 -- 172.21.15.162:0/2808190670 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f77c0102a00 msgr2=0x7f77c01984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bf7fe640 1 --2- 172.21.15.162:0/2808190670 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f77c0102a00 0x7f77c01984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bf7fe640 1 -- 172.21.15.162:0/2808190670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c0104520 msgr2=0x7f77c0199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bf7fe640 1 --2- 172.21.15.162:0/2808190670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c0104520 0x7f77c0199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bf7fe640 1 -- 172.21.15.162:0/2808190670 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c019a010 con 0x7f77c0103b60 2024-09-21T13:39:02.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bffff640 1 --2- 172.21.15.162:0/2808190670 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f77c0102a00 0x7f77c01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bf7fe640 1 --2- 172.21.15.162:0/2808190670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0103b60 0x7f77c0198b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f77b4005940 tx=0x7f77b4032c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bd7fa640 1 -- 172.21.15.162:0/2808190670 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b403f030 con 0x7f77c0103b60 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bd7fa640 1 -- 172.21.15.162:0/2808190670 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f77b4032e30 con 0x7f77c0103b60 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77c6660640 1 -- 172.21.15.162:0/2808190670 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c019a2a0 con 0x7f77c0103b60 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77bd7fa640 1 -- 172.21.15.162:0/2808190670 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4035070 con 0x7f77c0103b60 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.746+0000 7f77c6660640 1 -- 172.21.15.162:0/2808190670 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c01a0810 con 0x7f77c0103b60 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.747+0000 7f77c6660640 1 -- 172.21.15.162:0/2808190670 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c0102e00 con 0x7f77c0103b60 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.748+0000 7f77bd7fa640 1 -- 172.21.15.162:0/2808190670 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7f77b4042030 con 0x7f77c0103b60 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.748+0000 7f77bd7fa640 1 --2- 172.21.15.162:0/2808190670 >> v2:172.21.15.2:6800/3897423974 conn(0x7f77a807b020 0x7f77a807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.748+0000 7f77bd7fa640 1 -- 172.21.15.162:0/2808190670 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5915+0+0 (secure 0 0 0) 0x7f77b40be6d0 con 0x7f77c0103b60 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.749+0000 7f77bffff640 1 --2- 172.21.15.162:0/2808190670 >> v2:172.21.15.2:6800/3897423974 conn(0x7f77a807b020 0x7f77a807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.749+0000 7f77bffff640 1 --2- 172.21.15.162:0/2808190670 >> v2:172.21.15.2:6800/3897423974 conn(0x7f77a807b020 0x7f77a807d4e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77b00058c0 tx=0x7f77b0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:02.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.753+0000 7f77bd7fa640 1 -- 172.21.15.162:0/2808190670 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77b4089dc0 con 0x7f77c0103b60 2024-09-21T13:39:02.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.945+0000 7f77c6660640 1 -- 172.21.15.162:0/2808190670 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}) -- 0x7f77c0063590 con 0x7f77a807b020 2024-09-21T13:39:02.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:02 smithi162 ceph-mon[33046]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.162", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:02.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:02 smithi162 ceph-mon[33046]: Saving service iscsi.datapool spec with placement smithi162=iscsi.a;count:1 2024-09-21T13:39:02.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T13:39:02.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:02 smithi162 ceph-mon[33046]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T13:39:02.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:02 smithi162 ceph-mon[33046]: osdmap e58: 8 total, 8 up, 8 in 2024-09-21T13:39:02.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.954+0000 7f77bd7fa640 1 -- 172.21.15.162:0/2808190670 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+31 (secure 0 0 0) 0x7f77c0063590 con 0x7f77a807b020 2024-09-21T13:39:02.955 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled prometheus update... 2024-09-21T13:39:02.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 -- 172.21.15.162:0/2808190670 >> v2:172.21.15.2:6800/3897423974 conn(0x7f77a807b020 msgr2=0x7f77a807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:02.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 --2- 172.21.15.162:0/2808190670 >> v2:172.21.15.2:6800/3897423974 conn(0x7f77a807b020 0x7f77a807d4e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77b00058c0 tx=0x7f77b0005850 comp rx=0 tx=0).stop 2024-09-21T13:39:02.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 -- 172.21.15.162:0/2808190670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0103b60 msgr2=0x7f77c0198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:02.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 --2- 172.21.15.162:0/2808190670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0103b60 0x7f77c0198b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f77b4005940 tx=0x7f77b4032c40 comp rx=0 tx=0).stop 2024-09-21T13:39:02.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 -- 172.21.15.162:0/2808190670 shutdown_connections 2024-09-21T13:39:02.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 --2- 172.21.15.162:0/2808190670 >> v2:172.21.15.2:6800/3897423974 conn(0x7f77a807b020 0x7f77a807d4e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:02.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 --2- 172.21.15.162:0/2808190670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c0104520 0x7f77c0199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:02.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 --2- 172.21.15.162:0/2808190670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0103b60 0x7f77c0198b30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:02.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 --2- 172.21.15.162:0/2808190670 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f77c0102a00 0x7f77c01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:02.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 -- 172.21.15.162:0/2808190670 >> 172.21.15.162:0/2808190670 conn(0x7f77c00fe2f0 msgr2=0x7f77c00ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:02.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 -- 172.21.15.162:0/2808190670 shutdown_connections 2024-09-21T13:39:02.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:02.956+0000 7f77c6660640 1 -- 172.21.15.162:0/2808190670 wait complete. 2024-09-21T13:39:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:02 smithi002 ceph-mon[30076]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.162", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:02 smithi002 ceph-mon[30076]: Saving service iscsi.datapool spec with placement smithi162=iscsi.a;count:1 2024-09-21T13:39:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T13:39:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:02 smithi002 ceph-mon[30076]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T13:39:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:02 smithi002 ceph-mon[30076]: osdmap e58: 8 total, 8 up, 8 in 2024-09-21T13:39:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:02 smithi002 ceph-mon[40622]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.162", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:02 smithi002 ceph-mon[40622]: Saving service iscsi.datapool spec with placement smithi162=iscsi.a;count:1 2024-09-21T13:39:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T13:39:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:02 smithi002 ceph-mon[40622]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-21T13:39:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:02 smithi002 ceph-mon[40622]: osdmap e58: 8 total, 8 up, 8 in 2024-09-21T13:39:03.574 DEBUG:teuthology.orchestra.run.smithi162:prometheus.a> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@prometheus.a.service 2024-09-21T13:39:03.576 INFO:tasks.cephadm:Adding node-exporter.a on smithi002 2024-09-21T13:39:03.576 INFO:tasks.cephadm:Adding node-exporter.b on smithi162 2024-09-21T13:39:03.576 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch apply node-exporter '2;smithi002=a;smithi162=b' 2024-09-21T13:39:03.868 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:39:03.980 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:03 smithi162 ceph-mon[33046]: pgmap v200: 100 pgs: 10 creating+peering, 59 active+clean, 31 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-21T13:39:03.980 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:03 smithi162 ceph-mon[33046]: osdmap e59: 8 total, 8 up, 8 in 2024-09-21T13:39:03.980 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:03.980 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:03.980 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:03.980 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:03 smithi162 ceph-mon[33046]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:03.980 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:03 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[30076]: pgmap v200: 100 pgs: 10 creating+peering, 59 active+clean, 31 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-21T13:39:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[30076]: osdmap e59: 8 total, 8 up, 8 in 2024-09-21T13:39:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[30076]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:04.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[40622]: pgmap v200: 100 pgs: 10 creating+peering, 59 active+clean, 31 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-21T13:39:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[40622]: osdmap e59: 8 total, 8 up, 8 in 2024-09-21T13:39:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[40622]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-21T13:39:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:03 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:04.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.263+0000 7f6a1f058640 1 -- 172.21.15.162:0/3892850575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a18104a50 msgr2=0x7f6a18106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:04.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.263+0000 7f6a1f058640 1 --2- 172.21.15.162:0/3892850575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a18104a50 0x7f6a18106ec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009900 tx=0x7f6a0402a410 comp rx=0 tx=0).stop 2024-09-21T13:39:04.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.263+0000 7f6a1f058640 1 -- 172.21.15.162:0/3892850575 shutdown_connections 2024-09-21T13:39:04.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.263+0000 7f6a1f058640 1 --2- 172.21.15.162:0/3892850575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a18107600 0x7f6a18109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:04.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.263+0000 7f6a1f058640 1 --2- 172.21.15.162:0/3892850575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a18104a50 0x7f6a18106ec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:04.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.263+0000 7f6a1f058640 1 --2- 172.21.15.162:0/3892850575 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6a18102090 0x7f6a18104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:04.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.263+0000 7f6a1f058640 1 -- 172.21.15.162:0/3892850575 >> 172.21.15.162:0/3892850575 conn(0x7f6a180fc500 msgr2=0x7f6a180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:04.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.263+0000 7f6a1f058640 1 -- 172.21.15.162:0/3892850575 shutdown_connections 2024-09-21T13:39:04.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.263+0000 7f6a1f058640 1 -- 172.21.15.162:0/3892850575 wait complete. 2024-09-21T13:39:04.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1f058640 1 Processor -- start 2024-09-21T13:39:04.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1f058640 1 -- start start 2024-09-21T13:39:04.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1f058640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6a18102090 0x7f6a18103dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1f058640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a18104a50 0x7f6a18102630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1f058640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a18107600 0x7f6a18102b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1f058640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1810cc00 con 0x7f6a18104a50 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1f058640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1810ca80 con 0x7f6a18107600 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1f058640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1810cd80 con 0x7f6a18102090 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1d5f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a18107600 0x7f6a18102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1cdf4640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6a18102090 0x7f6a18103dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1d5f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a18107600 0x7f6a18102b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51650/0 (socket says 172.21.15.162:51650) 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1d5f5640 1 -- 172.21.15.162:0/513219749 learned_addr learned my addr 172.21.15.162:0/513219749 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a17fff640 1 --2- 172.21.15.162:0/513219749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a18104a50 0x7f6a18102630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1d5f5640 1 -- 172.21.15.162:0/513219749 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6a18102090 msgr2=0x7f6a18103dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1d5f5640 1 --2- 172.21.15.162:0/513219749 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6a18102090 0x7f6a18103dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1d5f5640 1 -- 172.21.15.162:0/513219749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a18104a50 msgr2=0x7f6a18102630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1d5f5640 1 --2- 172.21.15.162:0/513219749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a18104a50 0x7f6a18102630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.264+0000 7f6a1d5f5640 1 -- 172.21.15.162:0/513219749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a18103430 con 0x7f6a18107600 2024-09-21T13:39:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.265+0000 7f6a1d5f5640 1 --2- 172.21.15.162:0/513219749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a18107600 0x7f6a18102b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000eaa0 tx=0x7f6a1000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.265+0000 7f6a15ffb640 1 -- 172.21.15.162:0/513219749 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000cdb0 con 0x7f6a18107600 2024-09-21T13:39:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.265+0000 7f6a1f058640 1 -- 172.21.15.162:0/513219749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a181a25b0 con 0x7f6a18107600 2024-09-21T13:39:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.265+0000 7f6a15ffb640 1 -- 172.21.15.162:0/513219749 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f6a10005020 con 0x7f6a18107600 2024-09-21T13:39:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.265+0000 7f6a15ffb640 1 -- 172.21.15.162:0/513219749 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a100116d0 con 0x7f6a18107600 2024-09-21T13:39:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.265+0000 7f6a1f058640 1 -- 172.21.15.162:0/513219749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a181a2ac0 con 0x7f6a18107600 2024-09-21T13:39:04.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.266+0000 7f6a1f058640 1 -- 172.21.15.162:0/513219749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a18104eb0 con 0x7f6a18107600 2024-09-21T13:39:04.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.266+0000 7f6a15ffb640 1 -- 172.21.15.162:0/513219749 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7f6a10004a40 con 0x7f6a18107600 2024-09-21T13:39:04.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.267+0000 7f6a15ffb640 1 --2- 172.21.15.162:0/513219749 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6a0807b020 0x7f6a0807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:04.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.267+0000 7f6a15ffb640 1 -- 172.21.15.162:0/513219749 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5926+0+0 (secure 0 0 0) 0x7f6a1009e240 con 0x7f6a18107600 2024-09-21T13:39:04.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.267+0000 7f6a1cdf4640 1 --2- 172.21.15.162:0/513219749 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6a0807b020 0x7f6a0807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:04.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.268+0000 7f6a1cdf4640 1 --2- 172.21.15.162:0/513219749 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6a0807b020 0x7f6a0807d4e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c005fd0 tx=0x7f6a0c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.271+0000 7f6a15ffb640 1 -- 172.21.15.162:0/513219749 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6a10016030 con 0x7f6a18107600 2024-09-21T13:39:04.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.460+0000 7f6a1f058640 1 -- 172.21.15.162:0/513219749 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi002=a;smithi162=b", "target": ["mon-mgr", ""]}) -- 0x7f6a18101690 con 0x7f6a0807b020 2024-09-21T13:39:04.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.468+0000 7f6a15ffb640 1 -- 172.21.15.162:0/513219749 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (secure 0 0 0) 0x7f6a18101690 con 0x7f6a0807b020 2024-09-21T13:39:04.469 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled node-exporter update... 2024-09-21T13:39:04.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 -- 172.21.15.162:0/513219749 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6a0807b020 msgr2=0x7f6a0807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:04.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 --2- 172.21.15.162:0/513219749 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6a0807b020 0x7f6a0807d4e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c005fd0 tx=0x7f6a0c00b390 comp rx=0 tx=0).stop 2024-09-21T13:39:04.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 -- 172.21.15.162:0/513219749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a18107600 msgr2=0x7f6a18102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:04.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 --2- 172.21.15.162:0/513219749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a18107600 0x7f6a18102b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000eaa0 tx=0x7f6a1000ef60 comp rx=0 tx=0).stop 2024-09-21T13:39:04.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 -- 172.21.15.162:0/513219749 shutdown_connections 2024-09-21T13:39:04.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 --2- 172.21.15.162:0/513219749 >> v2:172.21.15.2:6800/3897423974 conn(0x7f6a0807b020 0x7f6a0807d4e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:04.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 --2- 172.21.15.162:0/513219749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a18107600 0x7f6a18102b70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:04.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 --2- 172.21.15.162:0/513219749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a18104a50 0x7f6a18102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:04.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 --2- 172.21.15.162:0/513219749 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6a18102090 0x7f6a18103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:04.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 -- 172.21.15.162:0/513219749 >> 172.21.15.162:0/513219749 conn(0x7f6a180fc500 msgr2=0x7f6a18100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:04.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 -- 172.21.15.162:0/513219749 shutdown_connections 2024-09-21T13:39:04.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:04.470+0000 7f6a1f058640 1 -- 172.21.15.162:0/513219749 wait complete. 2024-09-21T13:39:04.969 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:04 smithi162 ceph-mon[33046]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:04.969 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:04 smithi162 ceph-mon[33046]: Saving service prometheus spec with placement smithi162=a;count:1 2024-09-21T13:39:04.969 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T13:39:04.969 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:04 smithi162 ceph-mon[33046]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T13:39:04.969 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:04 smithi162 ceph-mon[33046]: osdmap e60: 8 total, 8 up, 8 in 2024-09-21T13:39:04.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:04.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:04.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:04.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:04 smithi162 ceph-mon[33046]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:04.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:04 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[30076]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[30076]: Saving service prometheus spec with placement smithi162=a;count:1 2024-09-21T13:39:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T13:39:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[30076]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T13:39:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[30076]: osdmap e60: 8 total, 8 up, 8 in 2024-09-21T13:39:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[30076]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[40622]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[40622]: Saving service prometheus spec with placement smithi162=a;count:1 2024-09-21T13:39:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T13:39:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[40622]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-21T13:39:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[40622]: osdmap e60: 8 total, 8 up, 8 in 2024-09-21T13:39:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3197873571' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1845870786' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[40622]: from='client.? ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-21T13:39:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:04 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:05.285 DEBUG:teuthology.orchestra.run.smithi002:node-exporter.a> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@node-exporter.a.service 2024-09-21T13:39:05.288 DEBUG:teuthology.orchestra.run.smithi162:node-exporter.b> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@node-exporter.b.service 2024-09-21T13:39:05.290 INFO:tasks.cephadm:Adding alertmanager.a on smithi002 2024-09-21T13:39:05.290 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch apply alertmanager '1;smithi002=a' 2024-09-21T13:39:05.964 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:39:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: pgmap v203: 132 pgs: 18 creating+peering, 89 active+clean, 25 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-21T13:39:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi002=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: Saving service node-exporter spec with placement smithi002=a;smithi162=b;count:2 2024-09-21T13:39:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T13:39:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T13:39:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: osdmap e61: 8 total, 8 up, 8 in 2024-09-21T13:39:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:05.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-21T13:39:05.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-21T13:39:05.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:05 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:39:06.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: pgmap v203: 132 pgs: 18 creating+peering, 89 active+clean, 25 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-21T13:39:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi002=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: Saving service node-exporter spec with placement smithi002=a;smithi162=b;count:2 2024-09-21T13:39:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T13:39:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T13:39:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: osdmap e61: 8 total, 8 up, 8 in 2024-09-21T13:39:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-21T13:39:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-21T13:39:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: pgmap v203: 132 pgs: 18 creating+peering, 89 active+clean, 25 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi002=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: Saving service node-exporter spec with placement smithi002=a;smithi162=b;count:2 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: osdmap e61: 8 total, 8 up, 8 in 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-21T13:39:06.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:05 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:39:06.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:06 smithi162 ceph-mon[33046]: Deploying daemon iscsi.iscsi.a on smithi162 2024-09-21T13:39:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.869+0000 7f2d432d7640 1 -- 172.21.15.162:0/2465407404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3c1018e0 msgr2=0x7f2d3c101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.869+0000 7f2d432d7640 1 --2- 172.21.15.162:0/2465407404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3c1018e0 0x7f2d3c101ce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009930 tx=0x7f2d3002a420 comp rx=0 tx=0).stop 2024-09-21T13:39:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.870+0000 7f2d432d7640 1 -- 172.21.15.162:0/2465407404 shutdown_connections 2024-09-21T13:39:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.870+0000 7f2d432d7640 1 --2- 172.21.15.162:0/2465407404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d3c103400 0x7f2d3c109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.870+0000 7f2d432d7640 1 --2- 172.21.15.162:0/2465407404 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2d3c102a40 0x7f2d3c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.870+0000 7f2d432d7640 1 --2- 172.21.15.162:0/2465407404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3c1018e0 0x7f2d3c101ce0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.870+0000 7f2d432d7640 1 -- 172.21.15.162:0/2465407404 >> 172.21.15.162:0/2465407404 conn(0x7f2d3c0fd1b0 msgr2=0x7f2d3c0ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.870+0000 7f2d432d7640 1 -- 172.21.15.162:0/2465407404 shutdown_connections 2024-09-21T13:39:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.870+0000 7f2d432d7640 1 -- 172.21.15.162:0/2465407404 wait complete. 2024-09-21T13:39:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.870+0000 7f2d432d7640 1 Processor -- start 2024-09-21T13:39:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.870+0000 7f2d432d7640 1 -- start start 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d432d7640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2d3c1018e0 0x7f2d3c1a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d432d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3c102a40 0x7f2d3c1a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d432d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d3c103400 0x7f2d3c1a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d432d7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c10ccf0 con 0x7f2d3c103400 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d432d7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c10cb70 con 0x7f2d3c102a40 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d432d7640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3c10ce70 con 0x7f2d3c1018e0 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d40872640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3c102a40 0x7f2d3c1a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d40872640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3c102a40 0x7f2d3c1a3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51660/0 (socket says 172.21.15.162:51660) 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d40872640 1 -- 172.21.15.162:0/1089548632 learned_addr learned my addr 172.21.15.162:0/1089548632 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d40872640 1 -- 172.21.15.162:0/1089548632 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2d3c1018e0 msgr2=0x7f2d3c1a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d41073640 1 --2- 172.21.15.162:0/1089548632 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2d3c1018e0 0x7f2d3c1a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d41874640 1 --2- 172.21.15.162:0/1089548632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d3c103400 0x7f2d3c1a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d40872640 1 --2- 172.21.15.162:0/1089548632 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2d3c1018e0 0x7f2d3c1a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d40872640 1 -- 172.21.15.162:0/1089548632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d3c103400 msgr2=0x7f2d3c1a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d40872640 1 --2- 172.21.15.162:0/1089548632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d3c103400 0x7f2d3c1a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d40872640 1 -- 172.21.15.162:0/1089548632 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c1a67f0 con 0x7f2d3c102a40 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d41874640 1 --2- 172.21.15.162:0/1089548632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d3c103400 0x7f2d3c1a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d41073640 1 --2- 172.21.15.162:0/1089548632 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2d3c1018e0 0x7f2d3c1a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d40872640 1 --2- 172.21.15.162:0/1089548632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3c102a40 0x7f2d3c1a3b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800b4a0 tx=0x7f2d3800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d2e7fc640 1 -- 172.21.15.162:0/1089548632 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d38014070 con 0x7f2d3c102a40 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d2e7fc640 1 -- 172.21.15.162:0/1089548632 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2d38010a90 con 0x7f2d3c102a40 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d432d7640 1 -- 172.21.15.162:0/1089548632 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3c1a6ae0 con 0x7f2d3c102a40 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.871+0000 7f2d2e7fc640 1 -- 172.21.15.162:0/1089548632 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d38017b80 con 0x7f2d3c102a40 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.872+0000 7f2d432d7640 1 -- 172.21.15.162:0/1089548632 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3c1a7020 con 0x7f2d3c102a40 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.873+0000 7f2d432d7640 1 -- 172.21.15.162:0/1089548632 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3c101d60 con 0x7f2d3c102a40 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.873+0000 7f2d2e7fc640 1 -- 172.21.15.162:0/1089548632 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7f2d38017070 con 0x7f2d3c102a40 2024-09-21T13:39:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.874+0000 7f2d2e7fc640 1 --2- 172.21.15.162:0/1089548632 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2d2807b020 0x7f2d2807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:06.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.874+0000 7f2d2e7fc640 1 -- 172.21.15.162:0/1089548632 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5942+0+0 (secure 0 0 0) 0x7f2d3809d770 con 0x7f2d3c102a40 2024-09-21T13:39:06.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.874+0000 7f2d41073640 1 --2- 172.21.15.162:0/1089548632 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2d2807b020 0x7f2d2807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:06.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.875+0000 7f2d41073640 1 --2- 172.21.15.162:0/1089548632 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2d2807b020 0x7f2d2807d4e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2d300096c0 tx=0x7f2d30005710 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:06.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:06.878+0000 7f2d2e7fc640 1 -- 172.21.15.162:0/1089548632 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d38064ae0 con 0x7f2d3c102a40 2024-09-21T13:39:07.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.090+0000 7f2d432d7640 1 -- 172.21.15.162:0/1089548632 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi002=a", "target": ["mon-mgr", ""]}) -- 0x7f2d3c063590 con 0x7f2d2807b020 2024-09-21T13:39:07.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.098+0000 7f2d2e7fc640 1 -- 172.21.15.162:0/1089548632 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+33 (secure 0 0 0) 0x7f2d3c063590 con 0x7f2d2807b020 2024-09-21T13:39:07.099 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled alertmanager update... 2024-09-21T13:39:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:06 smithi002 ceph-mon[30076]: Deploying daemon iscsi.iscsi.a on smithi162 2024-09-21T13:39:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:06 smithi002 ceph-mon[40622]: Deploying daemon iscsi.iscsi.a on smithi162 2024-09-21T13:39:07.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.100+0000 7f2d432d7640 1 -- 172.21.15.162:0/1089548632 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2d2807b020 msgr2=0x7f2d2807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:07.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.101+0000 7f2d432d7640 1 --2- 172.21.15.162:0/1089548632 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2d2807b020 0x7f2d2807d4e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2d300096c0 tx=0x7f2d30005710 comp rx=0 tx=0).stop 2024-09-21T13:39:07.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.101+0000 7f2d432d7640 1 -- 172.21.15.162:0/1089548632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3c102a40 msgr2=0x7f2d3c1a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:07.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.101+0000 7f2d432d7640 1 --2- 172.21.15.162:0/1089548632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3c102a40 0x7f2d3c1a3b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800b4a0 tx=0x7f2d3800b960 comp rx=0 tx=0).stop 2024-09-21T13:39:07.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.101+0000 7f2d432d7640 1 -- 172.21.15.162:0/1089548632 shutdown_connections 2024-09-21T13:39:07.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.101+0000 7f2d432d7640 1 --2- 172.21.15.162:0/1089548632 >> v2:172.21.15.2:6800/3897423974 conn(0x7f2d2807b020 0x7f2d2807d4e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:07.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.101+0000 7f2d432d7640 1 --2- 172.21.15.162:0/1089548632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d3c103400 0x7f2d3c1a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:07.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.101+0000 7f2d432d7640 1 --2- 172.21.15.162:0/1089548632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3c102a40 0x7f2d3c1a3b20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:07.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.101+0000 7f2d432d7640 1 --2- 172.21.15.162:0/1089548632 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2d3c1018e0 0x7f2d3c1a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:07.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.101+0000 7f2d432d7640 1 -- 172.21.15.162:0/1089548632 >> 172.21.15.162:0/1089548632 conn(0x7f2d3c0fd1b0 msgr2=0x7f2d3c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:07.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.101+0000 7f2d432d7640 1 -- 172.21.15.162:0/1089548632 shutdown_connections 2024-09-21T13:39:07.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:07.101+0000 7f2d432d7640 1 -- 172.21.15.162:0/1089548632 wait complete. 2024-09-21T13:39:07.426 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:07 smithi162 systemd[1]: Starting Ceph iscsi.iscsi.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:39:07.721 DEBUG:teuthology.orchestra.run.smithi002:alertmanager.a> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@alertmanager.a.service 2024-09-21T13:39:07.723 INFO:tasks.cephadm:Adding grafana.a on smithi162 2024-09-21T13:39:07.724 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph orch apply grafana '1;smithi162=a' 2024-09-21T13:39:07.943 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:07 smithi162 ceph-mon[33046]: pgmap v205: 132 pgs: 15 creating+peering, 106 active+clean, 11 unknown; 580 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 4.0 KiB/s wr, 57 op/s 2024-09-21T13:39:07.943 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:07 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:07.943 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:07 smithi162 podman[60844]: 2024-09-21 13:39:07.826518668 +0000 UTC m=+0.016358444 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:39:07.943 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:07 smithi162 podman[60844]: 2024-09-21 13:39:07.94259886 +0000 UTC m=+0.132438669 container create 83f1cb6134cb6130a83766722d2282ea194183e3f5470ecc4eba9aa125d310f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:39:08.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:07 smithi002 ceph-mon[30076]: pgmap v205: 132 pgs: 15 creating+peering, 106 active+clean, 11 unknown; 580 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 4.0 KiB/s wr, 57 op/s 2024-09-21T13:39:08.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:07 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:08.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:07 smithi002 ceph-mon[40622]: pgmap v205: 132 pgs: 15 creating+peering, 106 active+clean, 11 unknown; 580 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 4.0 KiB/s wr, 57 op/s 2024-09-21T13:39:08.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:07 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:08.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 podman[60844]: 2024-09-21 13:39:08.161353902 +0000 UTC m=+0.351193669 container init 83f1cb6134cb6130a83766722d2282ea194183e3f5470ecc4eba9aa125d310f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T13:39:08.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 podman[60844]: 2024-09-21 13:39:08.166137353 +0000 UTC m=+0.355977116 container start 83f1cb6134cb6130a83766722d2282ea194183e3f5470ecc4eba9aa125d310f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T13:39:08.281 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:39:08.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 bash[60844]: 83f1cb6134cb6130a83766722d2282ea194183e3f5470ecc4eba9aa125d310f6 2024-09-21T13:39:08.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 systemd[1]: Started Ceph iscsi.iscsi.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:39:08.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug Started the configuration object watcher 2024-09-21T13:39:08.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug Checking for config object changes every 1s 2024-09-21T13:39:08.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug Processing osd blocklist entries for this node 2024-09-21T13:39:08.809 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-mon[33046]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi002=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:08.809 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-mon[33046]: Saving service alertmanager spec with placement smithi002=a;count:1 2024-09-21T13:39:08.809 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-mon[33046]: osdmap e62: 8 total, 8 up, 8 in 2024-09-21T13:39:08.810 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:08.810 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:08.810 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:08.810 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:08.810 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:08.810 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug Reading the configuration object to update local LIO configuration 2024-09-21T13:39:08.810 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug Configuration does not have an entry for this host(smithi162.front.sepia.ceph.com) - nothing to define to LIO 2024-09-21T13:39:08.810 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: * Serving Flask app 'rbd-target-api' (lazy loading) 2024-09-21T13:39:08.810 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: * Environment: production 2024-09-21T13:39:08.810 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-21T13:39:08.810 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: Use a production WSGI server instead. 2024-09-21T13:39:08.811 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: * Debug mode: off 2024-09-21T13:39:08.811 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug * Running on all addresses. 2024-09-21T13:39:08.811 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-21T13:39:08.811 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: * Running on all addresses. 2024-09-21T13:39:08.811 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-21T13:39:08.811 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug * Running on http://[fe80::ec4:7aff:fe88:7f41]:5000/ (Press CTRL+C to quit) 2024-09-21T13:39:08.811 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: * Running on http://[fe80::ec4:7aff:fe88:7f41]:5000/ (Press CTRL+C to quit) 2024-09-21T13:39:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[30076]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi002=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[30076]: Saving service alertmanager spec with placement smithi002=a;count:1 2024-09-21T13:39:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[30076]: osdmap e62: 8 total, 8 up, 8 in 2024-09-21T13:39:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:09.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:09.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[40622]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi002=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[40622]: Saving service alertmanager spec with placement smithi002=a;count:1 2024-09-21T13:39:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[40622]: osdmap e62: 8 total, 8 up, 8 in 2024-09-21T13:39:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:08 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:09.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.516+0000 7f4213cbf640 1 -- 172.21.15.162:0/2747982782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f420c103400 msgr2=0x7f420c109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:09.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.516+0000 7f4213cbf640 1 --2- 172.21.15.162:0/2747982782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f420c103400 0x7f420c109d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4204009cd0 tx=0x7f420402a8e0 comp rx=0 tx=0).stop 2024-09-21T13:39:09.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.516+0000 7f4213cbf640 1 -- 172.21.15.162:0/2747982782 shutdown_connections 2024-09-21T13:39:09.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.516+0000 7f4213cbf640 1 --2- 172.21.15.162:0/2747982782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f420c103400 0x7f420c109d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:09.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.516+0000 7f4213cbf640 1 --2- 172.21.15.162:0/2747982782 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f420c102a40 0x7f420c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:09.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.516+0000 7f4213cbf640 1 --2- 172.21.15.162:0/2747982782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f420c1018e0 0x7f420c101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:09.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.516+0000 7f4213cbf640 1 -- 172.21.15.162:0/2747982782 >> 172.21.15.162:0/2747982782 conn(0x7f420c0fd1b0 msgr2=0x7f420c0ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:09.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.516+0000 7f4213cbf640 1 -- 172.21.15.162:0/2747982782 shutdown_connections 2024-09-21T13:39:09.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.516+0000 7f4213cbf640 1 -- 172.21.15.162:0/2747982782 wait complete. 2024-09-21T13:39:09.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f4213cbf640 1 Processor -- start 2024-09-21T13:39:09.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f4213cbf640 1 -- start start 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f4213cbf640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f420c1018e0 0x7f420c06b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f4213cbf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f420c102a40 0x7f420c19d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f4213cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f420c103400 0x7f420c19f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f4213cbf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f420c10cc10 con 0x7f420c103400 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f4213cbf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f420c10ca90 con 0x7f420c102a40 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f4213cbf640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f420c10cd90 con 0x7f420c1018e0 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f421125a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f420c102a40 0x7f420c19d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f421125a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f420c102a40 0x7f420c19d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51762/0 (socket says 172.21.15.162:51762) 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f421125a640 1 -- 172.21.15.162:0/2643205979 learned_addr learned my addr 172.21.15.162:0/2643205979 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f421225c640 1 --2- 172.21.15.162:0/2643205979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f420c103400 0x7f420c19f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.517+0000 7f4211a5b640 1 --2- 172.21.15.162:0/2643205979 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f420c1018e0 0x7f420c06b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:09.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.518+0000 7f421125a640 1 -- 172.21.15.162:0/2643205979 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f420c1018e0 msgr2=0x7f420c06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.518+0000 7f421125a640 1 --2- 172.21.15.162:0/2643205979 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f420c1018e0 0x7f420c06b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.518+0000 7f421125a640 1 -- 172.21.15.162:0/2643205979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f420c103400 msgr2=0x7f420c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.518+0000 7f421125a640 1 --2- 172.21.15.162:0/2643205979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f420c103400 0x7f420c19f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.518+0000 7f421125a640 1 -- 172.21.15.162:0/2643205979 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420c1a0060 con 0x7f420c102a40 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.518+0000 7f421125a640 1 --2- 172.21.15.162:0/2643205979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f420c102a40 0x7f420c19d1b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00c970 tx=0x7f41fc00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.518+0000 7f4202ffd640 1 -- 172.21.15.162:0/2643205979 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc007bb0 con 0x7f420c102a40 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.518+0000 7f4202ffd640 1 -- 172.21.15.162:0/2643205979 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f41fc007d50 con 0x7f420c102a40 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.518+0000 7f4213cbf640 1 -- 172.21.15.162:0/2643205979 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420c1a0350 con 0x7f420c102a40 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.518+0000 7f4202ffd640 1 -- 172.21.15.162:0/2643205979 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc004da0 con 0x7f420c102a40 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.518+0000 7f4213cbf640 1 -- 172.21.15.162:0/2643205979 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f420c1a0890 con 0x7f420c102a40 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.519+0000 7f4213cbf640 1 -- 172.21.15.162:0/2643205979 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f420c101ce0 con 0x7f420c102a40 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.520+0000 7f4202ffd640 1 -- 172.21.15.162:0/2643205979 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 103197+0+0 (secure 0 0 0) 0x7f41fc004fa0 con 0x7f420c102a40 2024-09-21T13:39:09.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.520+0000 7f4202ffd640 1 --2- 172.21.15.162:0/2643205979 >> v2:172.21.15.2:6800/3897423974 conn(0x7f41f807b020 0x7f41f807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:09.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.521+0000 7f4202ffd640 1 -- 172.21.15.162:0/2643205979 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7f41fc09de40 con 0x7f420c102a40 2024-09-21T13:39:09.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.521+0000 7f4211a5b640 1 --2- 172.21.15.162:0/2643205979 >> v2:172.21.15.2:6800/3897423974 conn(0x7f41f807b020 0x7f41f807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:09.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.521+0000 7f4211a5b640 1 --2- 172.21.15.162:0/2643205979 >> v2:172.21.15.2:6800/3897423974 conn(0x7f41f807b020 0x7f41f807d4e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42080058c0 tx=0x7f420800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:09.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.525+0000 7f4202ffd640 1 -- 172.21.15.162:0/2643205979 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41fc014030 con 0x7f420c102a40 2024-09-21T13:39:09.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.728+0000 7f4213cbf640 1 -- 172.21.15.162:0/2643205979 --> v2:172.21.15.2:6800/3897423974 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}) -- 0x7f420c063590 con 0x7f41f807b020 2024-09-21T13:39:09.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.735+0000 7f4202ffd640 1 -- 172.21.15.162:0/2643205979 <== mgr.14152 v2:172.21.15.2:6800/3897423974 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f420c063590 con 0x7f41f807b020 2024-09-21T13:39:09.736 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled grafana update... 2024-09-21T13:39:09.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 -- 172.21.15.162:0/2643205979 >> v2:172.21.15.2:6800/3897423974 conn(0x7f41f807b020 msgr2=0x7f41f807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:09.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 --2- 172.21.15.162:0/2643205979 >> v2:172.21.15.2:6800/3897423974 conn(0x7f41f807b020 0x7f41f807d4e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42080058c0 tx=0x7f420800a2d0 comp rx=0 tx=0).stop 2024-09-21T13:39:09.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 -- 172.21.15.162:0/2643205979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f420c102a40 msgr2=0x7f420c19d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:09.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 --2- 172.21.15.162:0/2643205979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f420c102a40 0x7f420c19d1b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00c970 tx=0x7f41fc00ce30 comp rx=0 tx=0).stop 2024-09-21T13:39:09.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 -- 172.21.15.162:0/2643205979 shutdown_connections 2024-09-21T13:39:09.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 --2- 172.21.15.162:0/2643205979 >> v2:172.21.15.2:6800/3897423974 conn(0x7f41f807b020 0x7f41f807d4e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:09.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 --2- 172.21.15.162:0/2643205979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f420c103400 0x7f420c19f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:09.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 --2- 172.21.15.162:0/2643205979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f420c102a40 0x7f420c19d1b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:09.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 --2- 172.21.15.162:0/2643205979 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f420c1018e0 0x7f420c06b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:09.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 -- 172.21.15.162:0/2643205979 >> 172.21.15.162:0/2643205979 conn(0x7f420c0fd1b0 msgr2=0x7f420c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:09.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 -- 172.21.15.162:0/2643205979 shutdown_connections 2024-09-21T13:39:09.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:09.737+0000 7f4213cbf640 1 -- 172.21.15.162:0/2643205979 wait complete. 2024-09-21T13:39:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:09 smithi162 ceph-mon[33046]: pgmap v206: 132 pgs: 4 creating+peering, 128 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 6.0 KiB/s wr, 140 op/s 2024-09-21T13:39:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:09 smithi162 ceph-mon[33046]: Checking pool "datapool" exists for service iscsi.datapool 2024-09-21T13:39:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:09 smithi162 ceph-mon[33046]: Deploying daemon prometheus.a on smithi162 2024-09-21T13:39:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/2867273153' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T13:39:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:09 smithi002 ceph-mon[30076]: pgmap v206: 132 pgs: 4 creating+peering, 128 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 6.0 KiB/s wr, 140 op/s 2024-09-21T13:39:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:09 smithi002 ceph-mon[30076]: Checking pool "datapool" exists for service iscsi.datapool 2024-09-21T13:39:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:09 smithi002 ceph-mon[30076]: Deploying daemon prometheus.a on smithi162 2024-09-21T13:39:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/2867273153' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T13:39:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:09 smithi002 ceph-mon[40622]: pgmap v206: 132 pgs: 4 creating+peering, 128 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 6.0 KiB/s wr, 140 op/s 2024-09-21T13:39:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:09 smithi002 ceph-mon[40622]: Checking pool "datapool" exists for service iscsi.datapool 2024-09-21T13:39:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:09 smithi002 ceph-mon[40622]: Deploying daemon prometheus.a on smithi162 2024-09-21T13:39:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/2867273153' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T13:39:10.725 DEBUG:teuthology.orchestra.run.smithi162:grafana.a> sudo journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@grafana.a.service 2024-09-21T13:39:10.728 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T13:39:10.728 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T13:39:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:10 smithi162 ceph-mon[33046]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:10 smithi162 ceph-mon[33046]: Saving service grafana spec with placement smithi162=a;count:1 2024-09-21T13:39:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:10 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:10.993 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:10 smithi002 ceph-mon[30076]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:10 smithi002 ceph-mon[30076]: Saving service grafana spec with placement smithi162=a;count:1 2024-09-21T13:39:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:10 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:10 smithi002 ceph-mon[40622]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:39:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:10 smithi002 ceph-mon[40622]: Saving service grafana spec with placement smithi162=a;count:1 2024-09-21T13:39:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:10 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.411+0000 7fdf5360a640 1 -- 172.21.15.2:0/2386498076 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdf4c104530 msgr2=0x7fdf4c10aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.411+0000 7fdf5360a640 1 --2- 172.21.15.2:0/2386498076 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdf4c104530 0x7fdf4c10aeb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009c40 tx=0x7fdf4402a710 comp rx=0 tx=0).stop 2024-09-21T13:39:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.411+0000 7fdf5360a640 1 -- 172.21.15.2:0/2386498076 shutdown_connections 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.411+0000 7fdf5360a640 1 --2- 172.21.15.2:0/2386498076 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdf4c104530 0x7fdf4c10aeb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.411+0000 7fdf5360a640 1 --2- 172.21.15.2:0/2386498076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c103b70 0x7fdf4c103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.411+0000 7fdf5360a640 1 --2- 172.21.15.2:0/2386498076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c102a10 0x7fdf4c102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.411+0000 7fdf5360a640 1 -- 172.21.15.2:0/2386498076 >> 172.21.15.2:0/2386498076 conn(0x7fdf4c0fe2c0 msgr2=0x7fdf4c100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.411+0000 7fdf5360a640 1 -- 172.21.15.2:0/2386498076 shutdown_connections 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.411+0000 7fdf5360a640 1 -- 172.21.15.2:0/2386498076 wait complete. 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf5360a640 1 Processor -- start 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf5360a640 1 -- start start 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf5360a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c102a10 0x7fdf4c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf5360a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c103b70 0x7fdf4c198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf5360a640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdf4c104530 0x7fdf4c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf5360a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c10dda0 con 0x7fdf4c103b70 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf5360a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c10dc20 con 0x7fdf4c102a10 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf5360a640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fdf4c10df20 con 0x7fdf4c104530 2024-09-21T13:39:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf50ba5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c103b70 0x7fdf4c198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf51ba7640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdf4c104530 0x7fdf4c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf50ba5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c103b70 0x7fdf4c198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38692/0 (socket says 172.21.15.2:38692) 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf50ba5640 1 -- 172.21.15.2:0/3395677904 learned_addr learned my addr 172.21.15.2:0/3395677904 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf513a6640 1 --2- 172.21.15.2:0/3395677904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c102a10 0x7fdf4c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf50ba5640 1 -- 172.21.15.2:0/3395677904 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdf4c104530 msgr2=0x7fdf4c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf50ba5640 1 --2- 172.21.15.2:0/3395677904 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdf4c104530 0x7fdf4c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf50ba5640 1 -- 172.21.15.2:0/3395677904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c102a10 msgr2=0x7fdf4c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf50ba5640 1 --2- 172.21.15.2:0/3395677904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c102a10 0x7fdf4c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.412+0000 7fdf50ba5640 1 -- 172.21.15.2:0/3395677904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4c19a040 con 0x7fdf4c103b70 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.413+0000 7fdf50ba5640 1 --2- 172.21.15.2:0/3395677904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c103b70 0x7fdf4c198b60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00e9c0 tx=0x7fdf3c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.413+0000 7fdf427fc640 1 -- 172.21.15.2:0/3395677904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c00cd80 con 0x7fdf4c103b70 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.413+0000 7fdf427fc640 1 -- 172.21.15.2:0/3395677904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fdf3c0035f0 con 0x7fdf4c103b70 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.413+0000 7fdf427fc640 1 -- 172.21.15.2:0/3395677904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c0044a0 con 0x7fdf4c103b70 2024-09-21T13:39:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.413+0000 7fdf5360a640 1 -- 172.21.15.2:0/3395677904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4c19a330 con 0x7fdf4c103b70 2024-09-21T13:39:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.413+0000 7fdf5360a640 1 -- 172.21.15.2:0/3395677904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf4c1a0a10 con 0x7fdf4c103b70 2024-09-21T13:39:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.414+0000 7fdf5360a640 1 -- 172.21.15.2:0/3395677904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf4c102e10 con 0x7fdf4c103b70 2024-09-21T13:39:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.415+0000 7fdf427fc640 1 -- 172.21.15.2:0/3395677904 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 103248+0+0 (secure 0 0 0) 0x7fdf3c004000 con 0x7fdf4c103b70 2024-09-21T13:39:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.415+0000 7fdf427fc640 1 --2- 172.21.15.2:0/3395677904 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf3807b0b0 0x7fdf3807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.415+0000 7fdf513a6640 1 --2- 172.21.15.2:0/3395677904 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf3807b0b0 0x7fdf3807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.415+0000 7fdf427fc640 1 -- 172.21.15.2:0/3395677904 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7fdf3c09e490 con 0x7fdf4c103b70 2024-09-21T13:39:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.416+0000 7fdf513a6640 1 --2- 172.21.15.2:0/3395677904 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf3807b0b0 0x7fdf3807d570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009990 tx=0x7fdf48009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.420+0000 7fdf427fc640 1 -- 172.21.15.2:0/3395677904 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf3c065680 con 0x7fdf4c103b70 2024-09-21T13:39:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.681+0000 7fdf5360a640 1 -- 172.21.15.2:0/3395677904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fdf4c02e8f0 con 0x7fdf4c103b70 2024-09-21T13:39:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.683+0000 7fdf427fc640 1 -- 172.21.15.2:0/3395677904 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7fdf3c069a60 con 0x7fdf4c103b70 2024-09-21T13:39:11.685 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-21T13:39:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQB/zO5m7KO+KBAA4S46qCTD0T9VqRZmWgmE5Q== 2024-09-21T13:39:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.686+0000 7fdf5360a640 1 -- 172.21.15.2:0/3395677904 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf3807b0b0 msgr2=0x7fdf3807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.686+0000 7fdf5360a640 1 --2- 172.21.15.2:0/3395677904 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf3807b0b0 0x7fdf3807d570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009990 tx=0x7fdf48009110 comp rx=0 tx=0).stop 2024-09-21T13:39:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.686+0000 7fdf5360a640 1 -- 172.21.15.2:0/3395677904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c103b70 msgr2=0x7fdf4c198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.686+0000 7fdf5360a640 1 --2- 172.21.15.2:0/3395677904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c103b70 0x7fdf4c198b60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00e9c0 tx=0x7fdf3c00edc0 comp rx=0 tx=0).stop 2024-09-21T13:39:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.686+0000 7fdf5360a640 1 -- 172.21.15.2:0/3395677904 shutdown_connections 2024-09-21T13:39:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.686+0000 7fdf5360a640 1 --2- 172.21.15.2:0/3395677904 >> v2:172.21.15.2:6800/3897423974 conn(0x7fdf3807b0b0 0x7fdf3807d570 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.686+0000 7fdf5360a640 1 --2- 172.21.15.2:0/3395677904 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdf4c104530 0x7fdf4c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.686+0000 7fdf5360a640 1 --2- 172.21.15.2:0/3395677904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c103b70 0x7fdf4c198b60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.686+0000 7fdf5360a640 1 --2- 172.21.15.2:0/3395677904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c102a10 0x7fdf4c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.686+0000 7fdf5360a640 1 -- 172.21.15.2:0/3395677904 >> 172.21.15.2:0/3395677904 conn(0x7fdf4c0fe2c0 msgr2=0x7fdf4c0ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.687+0000 7fdf5360a640 1 -- 172.21.15.2:0/3395677904 shutdown_connections 2024-09-21T13:39:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:11.687+0000 7fdf5360a640 1 -- 172.21.15.2:0/3395677904 wait complete. 2024-09-21T13:39:12.005 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:11 smithi002 ceph-mon[30076]: pgmap v208: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 5.2 KiB/s wr, 171 op/s 2024-09-21T13:39:12.005 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:11 smithi002 ceph-mon[30076]: mgrmap e16: y(active, since 5m), standbys: x 2024-09-21T13:39:12.005 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3395677904' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T13:39:12.005 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3395677904' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T13:39:12.005 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:11 smithi002 ceph-mon[40622]: pgmap v208: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 5.2 KiB/s wr, 171 op/s 2024-09-21T13:39:12.006 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:11 smithi002 ceph-mon[40622]: mgrmap e16: y(active, since 5m), standbys: x 2024-09-21T13:39:12.006 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3395677904' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T13:39:12.006 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3395677904' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T13:39:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:11 smithi162 ceph-mon[33046]: pgmap v208: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 5.2 KiB/s wr, 171 op/s 2024-09-21T13:39:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:11 smithi162 ceph-mon[33046]: mgrmap e16: y(active, since 5m), standbys: x 2024-09-21T13:39:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3395677904' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T13:39:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3395677904' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T13:39:12.401 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:39:12.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T13:39:12.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T13:39:12.439 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T13:39:12.698 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T13:39:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.307+0000 7f357088c640 1 -- 172.21.15.162:0/2470809874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c103400 msgr2=0x7f356c109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.307+0000 7f357088c640 1 --2- 172.21.15.162:0/2470809874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c103400 0x7f356c109d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3564009cd0 tx=0x7f356402a8e0 comp rx=0 tx=0).stop 2024-09-21T13:39:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.307+0000 7f357088c640 1 -- 172.21.15.162:0/2470809874 shutdown_connections 2024-09-21T13:39:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.307+0000 7f357088c640 1 --2- 172.21.15.162:0/2470809874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c103400 0x7f356c109d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.307+0000 7f357088c640 1 --2- 172.21.15.162:0/2470809874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356c102a40 0x7f356c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.307+0000 7f357088c640 1 --2- 172.21.15.162:0/2470809874 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f356c1018e0 0x7f356c101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.307+0000 7f357088c640 1 -- 172.21.15.162:0/2470809874 >> 172.21.15.162:0/2470809874 conn(0x7f356c0fd1b0 msgr2=0x7f356c0ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.307+0000 7f357088c640 1 -- 172.21.15.162:0/2470809874 shutdown_connections 2024-09-21T13:39:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.307+0000 7f357088c640 1 -- 172.21.15.162:0/2470809874 wait complete. 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f357088c640 1 Processor -- start 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f357088c640 1 -- start start 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f357088c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c1018e0 0x7f356c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f357088c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f356c102a40 0x7f356c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f357088c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356c103400 0x7f356c199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f357088c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f356c10cbf0 con 0x7f356c103400 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f357088c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f356c10ca70 con 0x7f356c1018e0 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f357088c640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f356c10cd70 con 0x7f356c102a40 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f356a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c1018e0 0x7f356c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f356a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c1018e0 0x7f356c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41820/0 (socket says 172.21.15.162:41820) 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f356a59c640 1 -- 172.21.15.162:0/891697076 learned_addr learned my addr 172.21.15.162:0/891697076 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f356ad9d640 1 --2- 172.21.15.162:0/891697076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356c103400 0x7f356c199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.308+0000 7f3569d9b640 1 --2- 172.21.15.162:0/891697076 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f356c102a40 0x7f356c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.309+0000 7f356a59c640 1 -- 172.21.15.162:0/891697076 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f356c102a40 msgr2=0x7f356c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.309+0000 7f356a59c640 1 --2- 172.21.15.162:0/891697076 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f356c102a40 0x7f356c198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.309+0000 7f356a59c640 1 -- 172.21.15.162:0/891697076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356c103400 msgr2=0x7f356c199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.309+0000 7f356a59c640 1 --2- 172.21.15.162:0/891697076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356c103400 0x7f356c199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.309+0000 7f356a59c640 1 -- 172.21.15.162:0/891697076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c199fa0 con 0x7f356c1018e0 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.309+0000 7f356a59c640 1 --2- 172.21.15.162:0/891697076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c1018e0 0x7f356c198470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f355c00d950 tx=0x7f355c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.309+0000 7f355b7fe640 1 -- 172.21.15.162:0/891697076 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c017070 con 0x7f356c1018e0 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.309+0000 7f355b7fe640 1 -- 172.21.15.162:0/891697076 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f355c009c30 con 0x7f356c1018e0 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.309+0000 7f357088c640 1 -- 172.21.15.162:0/891697076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356c19a290 con 0x7f356c1018e0 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.309+0000 7f355b7fe640 1 -- 172.21.15.162:0/891697076 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c00f620 con 0x7f356c1018e0 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.309+0000 7f357088c640 1 -- 172.21.15.162:0/891697076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f356c1a0970 con 0x7f356c1018e0 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.310+0000 7f357088c640 1 -- 172.21.15.162:0/891697076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f356c101ce0 con 0x7f356c1018e0 2024-09-21T13:39:13.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.311+0000 7f355b7fe640 1 -- 172.21.15.162:0/891697076 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 103248+0+0 (secure 0 0 0) 0x7f355c00f7c0 con 0x7f356c1018e0 2024-09-21T13:39:13.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.312+0000 7f355b7fe640 1 --2- 172.21.15.162:0/891697076 >> v2:172.21.15.2:6800/3897423974 conn(0x7f355407b0b0 0x7f355407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:13.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.312+0000 7f355b7fe640 1 -- 172.21.15.162:0/891697076 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7f355c09ddb0 con 0x7f356c1018e0 2024-09-21T13:39:13.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.312+0000 7f3569d9b640 1 --2- 172.21.15.162:0/891697076 >> v2:172.21.15.2:6800/3897423974 conn(0x7f355407b0b0 0x7f355407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:13.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.313+0000 7f3569d9b640 1 --2- 172.21.15.162:0/891697076 >> v2:172.21.15.2:6800/3897423974 conn(0x7f355407b0b0 0x7f355407d570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f356000bbe0 tx=0x7f356000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:13.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.317+0000 7f355b7fe640 1 -- 172.21.15.162:0/891697076 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f355c069400 con 0x7f356c1018e0 2024-09-21T13:39:13.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.605+0000 7f357088c640 1 -- 172.21.15.162:0/891697076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f356c109680 con 0x7f356c1018e0 2024-09-21T13:39:13.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.610+0000 7f355b7fe640 1 -- 172.21.15.162:0/891697076 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f355c06e2b0 con 0x7f356c1018e0 2024-09-21T13:39:13.611 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2024-09-21T13:39:13.611 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCBzO5mo6w3JBAAWlTfpM90y8Ux6c7GgACsaQ== 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.612+0000 7f357088c640 1 -- 172.21.15.162:0/891697076 >> v2:172.21.15.2:6800/3897423974 conn(0x7f355407b0b0 msgr2=0x7f355407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.612+0000 7f357088c640 1 --2- 172.21.15.162:0/891697076 >> v2:172.21.15.2:6800/3897423974 conn(0x7f355407b0b0 0x7f355407d570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f356000bbe0 tx=0x7f356000b390 comp rx=0 tx=0).stop 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.612+0000 7f357088c640 1 -- 172.21.15.162:0/891697076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c1018e0 msgr2=0x7f356c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.612+0000 7f357088c640 1 --2- 172.21.15.162:0/891697076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c1018e0 0x7f356c198470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f355c00d950 tx=0x7f355c00de10 comp rx=0 tx=0).stop 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.613+0000 7f357088c640 1 -- 172.21.15.162:0/891697076 shutdown_connections 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.613+0000 7f357088c640 1 --2- 172.21.15.162:0/891697076 >> v2:172.21.15.2:6800/3897423974 conn(0x7f355407b0b0 0x7f355407d570 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.613+0000 7f357088c640 1 --2- 172.21.15.162:0/891697076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356c103400 0x7f356c199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.613+0000 7f357088c640 1 --2- 172.21.15.162:0/891697076 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f356c102a40 0x7f356c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.613+0000 7f357088c640 1 --2- 172.21.15.162:0/891697076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c1018e0 0x7f356c198470 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.613+0000 7f357088c640 1 -- 172.21.15.162:0/891697076 >> 172.21.15.162:0/891697076 conn(0x7f356c0fd1b0 msgr2=0x7f356c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.613+0000 7f357088c640 1 -- 172.21.15.162:0/891697076 shutdown_connections 2024-09-21T13:39:13.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T13:39:13.613+0000 7f357088c640 1 -- 172.21.15.162:0/891697076 wait complete. 2024-09-21T13:39:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:13 smithi162 ceph-mon[33046]: pgmap v209: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 4.4 KiB/s wr, 140 op/s 2024-09-21T13:39:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.162:0/891697076' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T13:39:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T13:39:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T13:39:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:13 smithi002 ceph-mon[40622]: pgmap v209: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 4.4 KiB/s wr, 140 op/s 2024-09-21T13:39:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.162:0/891697076' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T13:39:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T13:39:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T13:39:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:13 smithi002 ceph-mon[30076]: pgmap v209: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 4.4 KiB/s wr, 140 op/s 2024-09-21T13:39:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.162:0/891697076' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T13:39:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T13:39:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T13:39:15.185 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T13:39:15.185 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-21T13:39:15.185 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T13:39:15.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T13:39:15.492 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:15.925 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:15 smithi002 ceph-mon[30076]: pgmap v210: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 3.7 KiB/s wr, 118 op/s 2024-09-21T13:39:15.925 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:15 smithi002 ceph-mon[40622]: pgmap v210: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 3.7 KiB/s wr, 118 op/s 2024-09-21T13:39:16.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.010+0000 7fefaac11640 1 -- 172.21.15.2:0/1817367336 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fefa4107670 msgr2=0x7fefa4107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:16.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.010+0000 7fefaac11640 1 --2- 172.21.15.2:0/1817367336 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fefa4107670 0x7fefa4107ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009900 tx=0x7fef8c02a410 comp rx=0 tx=0).stop 2024-09-21T13:39:16.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.010+0000 7fefaac11640 1 -- 172.21.15.2:0/1817367336 shutdown_connections 2024-09-21T13:39:16.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.010+0000 7fefaac11640 1 --2- 172.21.15.2:0/1817367336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefa4107ff0 0x7fefa410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:16.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.010+0000 7fefaac11640 1 --2- 172.21.15.2:0/1817367336 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fefa4107670 0x7fefa4107ab0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:16.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.010+0000 7fefaac11640 1 --2- 172.21.15.2:0/1817367336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa4101c60 0x7fefa4102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:16.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.010+0000 7fefaac11640 1 -- 172.21.15.2:0/1817367336 >> 172.21.15.2:0/1817367336 conn(0x7fefa40fd6d0 msgr2=0x7fefa40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:16.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.010+0000 7fefaac11640 1 -- 172.21.15.2:0/1817367336 shutdown_connections 2024-09-21T13:39:16.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.010+0000 7fefaac11640 1 -- 172.21.15.2:0/1817367336 wait complete. 2024-09-21T13:39:16.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.010+0000 7fefaac11640 1 Processor -- start 2024-09-21T13:39:16.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.010+0000 7fefaac11640 1 -- start start 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefaac11640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fefa4101c60 0x7fefa419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefaac11640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefa4107670 0x7fefa419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefaac11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa4107ff0 0x7fefa41a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefaac11640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fefa41113c0 con 0x7fefa4107670 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefaac11640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefa4111240 con 0x7fefa4107ff0 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefaac11640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fefa4111540 con 0x7fefa4101c60 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa89ad640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fefa4101c60 0x7fefa419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefa4107670 0x7fefa419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa89ad640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fefa4101c60 0x7fefa419ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:54746/0 (socket says 172.21.15.2:54746) 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa89ad640 1 -- 172.21.15.2:0/698731645 learned_addr learned my addr 172.21.15.2:0/698731645 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa91ae640 1 --2- 172.21.15.2:0/698731645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa4107ff0 0x7fefa41a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa89ad640 1 -- 172.21.15.2:0/698731645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa4107ff0 msgr2=0x7fefa41a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa89ad640 1 --2- 172.21.15.2:0/698731645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa4107ff0 0x7fefa41a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa89ad640 1 -- 172.21.15.2:0/698731645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefa4107670 msgr2=0x7fefa419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:16.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa89ad640 1 --2- 172.21.15.2:0/698731645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefa4107670 0x7fefa419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa89ad640 1 -- 172.21.15.2:0/698731645 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa41a0cf0 con 0x7fefa4101c60 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa3fff640 1 --2- 172.21.15.2:0/698731645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefa4107670 0x7fefa419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.011+0000 7fefa89ad640 1 --2- 172.21.15.2:0/698731645 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fefa4101c60 0x7fefa419ac40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef9400d950 tx=0x7fef9400dd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.012+0000 7fefa1ffb640 1 -- 172.21.15.2:0/698731645 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94017030 con 0x7fefa4101c60 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.012+0000 7fefa1ffb640 1 -- 172.21.15.2:0/698731645 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fef94004020 con 0x7fefa4101c60 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.012+0000 7fefaac11640 1 -- 172.21.15.2:0/698731645 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa41a0fe0 con 0x7fefa4101c60 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.012+0000 7fefa1ffb640 1 -- 172.21.15.2:0/698731645 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94005470 con 0x7fefa4101c60 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.012+0000 7fefaac11640 1 -- 172.21.15.2:0/698731645 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa41a76a0 con 0x7fefa4101c60 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.013+0000 7fefaac11640 1 -- 172.21.15.2:0/698731645 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa4102040 con 0x7fefa4101c60 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.013+0000 7fefa1ffb640 1 -- 172.21.15.2:0/698731645 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 16) ==== 103248+0+0 (secure 0 0 0) 0x7fef94009a30 con 0x7fefa4101c60 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.014+0000 7fefa1ffb640 1 --2- 172.21.15.2:0/698731645 >> v2:172.21.15.2:6800/3897423974 conn(0x7fef9007b0b0 0x7fef9007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.014+0000 7fefa1ffb640 1 -- 172.21.15.2:0/698731645 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7fef9409dab0 con 0x7fefa4101c60 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.014+0000 7fefa3fff640 1 --2- 172.21.15.2:0/698731645 >> v2:172.21.15.2:6800/3897423974 conn(0x7fef9007b0b0 0x7fef9007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:16.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.014+0000 7fefa3fff640 1 --2- 172.21.15.2:0/698731645 >> v2:172.21.15.2:6800/3897423974 conn(0x7fef9007b0b0 0x7fef9007d570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef8c031440 tx=0x7fef8c031850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:16.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.019+0000 7fefa1ffb640 1 -- 172.21.15.2:0/698731645 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef94064ca0 con 0x7fefa4101c60 2024-09-21T13:39:16.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.210+0000 7fefaac11640 1 -- 172.21.15.2:0/698731645 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fefa41a7930 con 0x7fefa4101c60 2024-09-21T13:39:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.211+0000 7fefa1ffb640 1 -- 172.21.15.2:0/698731645 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v24) ==== 86+0+187 (secure 0 0 0) 0x7fef94069080 con 0x7fefa4101c60 2024-09-21T13:39:16.213 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:39:16.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 -- 172.21.15.2:0/698731645 >> v2:172.21.15.2:6800/3897423974 conn(0x7fef9007b0b0 msgr2=0x7fef9007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 --2- 172.21.15.2:0/698731645 >> v2:172.21.15.2:6800/3897423974 conn(0x7fef9007b0b0 0x7fef9007d570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef8c031440 tx=0x7fef8c031850 comp rx=0 tx=0).stop 2024-09-21T13:39:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 -- 172.21.15.2:0/698731645 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fefa4101c60 msgr2=0x7fefa419ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 --2- 172.21.15.2:0/698731645 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fefa4101c60 0x7fefa419ac40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef9400d950 tx=0x7fef9400dd50 comp rx=0 tx=0).stop 2024-09-21T13:39:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 -- 172.21.15.2:0/698731645 shutdown_connections 2024-09-21T13:39:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 --2- 172.21.15.2:0/698731645 >> v2:172.21.15.2:6800/3897423974 conn(0x7fef9007b0b0 0x7fef9007d570 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 --2- 172.21.15.2:0/698731645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa4107ff0 0x7fefa41a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 --2- 172.21.15.2:0/698731645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefa4107670 0x7fefa419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 --2- 172.21.15.2:0/698731645 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fefa4101c60 0x7fefa419ac40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 -- 172.21.15.2:0/698731645 >> 172.21.15.2:0/698731645 conn(0x7fefa40fd6d0 msgr2=0x7fefa406b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 -- 172.21.15.2:0/698731645 shutdown_connections 2024-09-21T13:39:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:16.214+0000 7fefaac11640 1 -- 172.21.15.2:0/698731645 wait complete. 2024-09-21T13:39:16.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:15 smithi162 ceph-mon[33046]: pgmap v210: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 3.7 KiB/s wr, 118 op/s 2024-09-21T13:39:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/698731645' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T13:39:16.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/698731645' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T13:39:16.899 INFO:teuthology.orchestra.run.smithi002.stdout:[{"version":24,"timestamp":"2024-09-21T13:39:04.918316+0000","name":"","changes":[{"name":"mgr/mgr/dashboard/RGW_API_SECRET_KEY","new_value":"9TEjZbrtYBIMLb4oCD9IuroLPN0IYUtkJFqyThLg"}]}] 2024-09-21T13:39:16.899 INFO:tasks.ceph_manager:config epoch is 24 2024-09-21T13:39:16.899 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T13:39:16.899 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T13:39:16.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T13:39:17.067 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/698731645' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T13:39:17.160 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.624+0000 7f0fb98a2640 1 -- 172.21.15.2:0/1061126923 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0fb4102da0 msgr2=0x7f0fb4103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.624+0000 7f0fb98a2640 1 --2- 172.21.15.2:0/1061126923 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0fb4102da0 0x7f0fb4103180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009900 tx=0x7f0fa402a410 comp rx=0 tx=0).stop 2024-09-21T13:39:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.625+0000 7f0fb98a2640 1 -- 172.21.15.2:0/1061126923 shutdown_connections 2024-09-21T13:39:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.625+0000 7f0fb98a2640 1 --2- 172.21.15.2:0/1061126923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb4109130 0x7f0fb410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.625+0000 7f0fb98a2640 1 --2- 172.21.15.2:0/1061126923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb41087b0 0x7f0fb4108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.625+0000 7f0fb98a2640 1 --2- 172.21.15.2:0/1061126923 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0fb4102da0 0x7f0fb4103180 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.625+0000 7f0fb98a2640 1 -- 172.21.15.2:0/1061126923 >> 172.21.15.2:0/1061126923 conn(0x7f0fb40fe810 msgr2=0x7f0fb4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.625+0000 7f0fb98a2640 1 -- 172.21.15.2:0/1061126923 shutdown_connections 2024-09-21T13:39:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.625+0000 7f0fb98a2640 1 -- 172.21.15.2:0/1061126923 wait complete. 2024-09-21T13:39:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.625+0000 7f0fb98a2640 1 Processor -- start 2024-09-21T13:39:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb98a2640 1 -- start start 2024-09-21T13:39:17.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb98a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb4102da0 0x7f0fb40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:17.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb98a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb41087b0 0x7f0fb40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:17.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb98a2640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0fb4109130 0x7f0fb4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:17.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb98a2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb4112500 con 0x7f0fb41087b0 2024-09-21T13:39:17.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb98a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb4112380 con 0x7f0fb4102da0 2024-09-21T13:39:17.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb98a2640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb4112680 con 0x7f0fb4109130 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb41087b0 0x7f0fb40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb41087b0 0x7f0fb40759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50956/0 (socket says 172.21.15.2:50956) 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb27fc640 1 -- 172.21.15.2:0/20631481 learned_addr learned my addr 172.21.15.2:0/20631481 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb2ffd640 1 --2- 172.21.15.2:0/20631481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb4102da0 0x7f0fb40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb37fe640 1 --2- 172.21.15.2:0/20631481 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0fb4109130 0x7f0fb4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb27fc640 1 -- 172.21.15.2:0/20631481 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0fb4109130 msgr2=0x7f0fb4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb27fc640 1 --2- 172.21.15.2:0/20631481 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0fb4109130 0x7f0fb4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb27fc640 1 -- 172.21.15.2:0/20631481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb4102da0 msgr2=0x7f0fb40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb27fc640 1 --2- 172.21.15.2:0/20631481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb4102da0 0x7f0fb40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb27fc640 1 -- 172.21.15.2:0/20631481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb41a6db0 con 0x7f0fb41087b0 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.626+0000 7f0fb27fc640 1 --2- 172.21.15.2:0/20631481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb41087b0 0x7f0fb40759e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800ea60 tx=0x7f0fa800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.627+0000 7f0fb88a0640 1 -- 172.21.15.2:0/20631481 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800cde0 con 0x7f0fb41087b0 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.627+0000 7f0fb88a0640 1 -- 172.21.15.2:0/20631481 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f0fa80035f0 con 0x7f0fb41087b0 2024-09-21T13:39:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.627+0000 7f0fb98a2640 1 -- 172.21.15.2:0/20631481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb41a70a0 con 0x7f0fb41087b0 2024-09-21T13:39:17.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.627+0000 7f0fb88a0640 1 -- 172.21.15.2:0/20631481 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa80044a0 con 0x7f0fb41087b0 2024-09-21T13:39:17.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.627+0000 7f0fb98a2640 1 -- 172.21.15.2:0/20631481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb41a7630 con 0x7f0fb41087b0 2024-09-21T13:39:17.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.628+0000 7f0fb98a2640 1 -- 172.21.15.2:0/20631481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb4103180 con 0x7f0fb41087b0 2024-09-21T13:39:17.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.629+0000 7f0fb88a0640 1 -- 172.21.15.2:0/20631481 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 103248+0+0 (secure 0 0 0) 0x7f0fa8004000 con 0x7f0fb41087b0 2024-09-21T13:39:17.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.630+0000 7f0fb88a0640 1 --2- 172.21.15.2:0/20631481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0f9c07b0b0 0x7f0f9c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:17.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.630+0000 7f0fb2ffd640 1 --2- 172.21.15.2:0/20631481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0f9c07b0b0 0x7f0f9c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:17.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.630+0000 7f0fb88a0640 1 -- 172.21.15.2:0/20631481 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7f0fa809e650 con 0x7f0fb41087b0 2024-09-21T13:39:17.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.630+0000 7f0fb2ffd640 1 --2- 172.21.15.2:0/20631481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0f9c07b0b0 0x7f0f9c07d570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4031440 tx=0x7f0fa4005b50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:17.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.633+0000 7f0fb88a0640 1 -- 172.21.15.2:0/20631481 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0fa8069d20 con 0x7f0fb41087b0 2024-09-21T13:39:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:17 smithi002 ceph-mon[30076]: pgmap v211: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 2.2 KiB/s wr, 88 op/s 2024-09-21T13:39:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:17 smithi002 ceph-mon[40622]: pgmap v211: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 2.2 KiB/s wr, 88 op/s 2024-09-21T13:39:17.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.872+0000 7f0fb98a2640 1 -- 172.21.15.2:0/20631481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0fb40767a0 con 0x7f0fb41087b0 2024-09-21T13:39:17.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.875+0000 7f0fb88a0640 1 -- 172.21.15.2:0/20631481 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v16) ==== 74+0+198093 (secure 0 0 0) 0x7f0fb40767a0 con 0x7f0fb41087b0 2024-09-21T13:39:17.879 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:39:17.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 -- 172.21.15.2:0/20631481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0f9c07b0b0 msgr2=0x7f0f9c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:17.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 --2- 172.21.15.2:0/20631481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0f9c07b0b0 0x7f0f9c07d570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4031440 tx=0x7f0fa4005b50 comp rx=0 tx=0).stop 2024-09-21T13:39:17.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 -- 172.21.15.2:0/20631481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb41087b0 msgr2=0x7f0fb40759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:17.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 --2- 172.21.15.2:0/20631481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb41087b0 0x7f0fb40759e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800ea60 tx=0x7f0fa800ef20 comp rx=0 tx=0).stop 2024-09-21T13:39:17.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 -- 172.21.15.2:0/20631481 shutdown_connections 2024-09-21T13:39:17.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 --2- 172.21.15.2:0/20631481 >> v2:172.21.15.2:6800/3897423974 conn(0x7f0f9c07b0b0 0x7f0f9c07d570 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:17.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 --2- 172.21.15.2:0/20631481 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0fb4109130 0x7f0fb4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:17.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 --2- 172.21.15.2:0/20631481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb41087b0 0x7f0fb40759e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:17.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 --2- 172.21.15.2:0/20631481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fb4102da0 0x7f0fb40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:17.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 -- 172.21.15.2:0/20631481 >> 172.21.15.2:0/20631481 conn(0x7f0fb40fe810 msgr2=0x7f0fb4100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:17.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 -- 172.21.15.2:0/20631481 shutdown_connections 2024-09-21T13:39:17.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:17.878+0000 7f0fb98a2640 1 -- 172.21.15.2:0/20631481 wait complete. 2024-09-21T13:39:18.073 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:17 smithi162 ceph-mon[33046]: pgmap v211: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 2.2 KiB/s wr, 88 op/s 2024-09-21T13:39:18.616 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:39:18.699 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"flags":0,"active_gid":14152,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3897423974}]},"active_addr":"172.21.15.2:6800/3897423974","active_change":"2024-09-21T13:33:58.101848+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24109,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"cephadm","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3858813436}]},{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":1955926306}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3414323026}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3096145127}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":695105202}]}]} 2024-09-21T13:39:18.702 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T13:39:18.702 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T13:39:18.702 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T13:39:18.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/20631481' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T13:39:18.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:18 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:19.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/20631481' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T13:39:19.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:18 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:19.089 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/20631481' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T13:39:19.089 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:18 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:19.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.422+0000 7f7f53cf1640 1 -- 172.21.15.2:0/192163644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f4c10a900 msgr2=0x7f7f4c10ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:19.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.422+0000 7f7f53cf1640 1 --2- 172.21.15.2:0/192163644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f4c10a900 0x7f7f4c10ccf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009900 tx=0x7f7f4802a410 comp rx=0 tx=0).stop 2024-09-21T13:39:19.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.422+0000 7f7f53cf1640 1 -- 172.21.15.2:0/192163644 shutdown_connections 2024-09-21T13:39:19.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.422+0000 7f7f53cf1640 1 --2- 172.21.15.2:0/192163644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f4c10d230 0x7f7f4c10f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:19.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.422+0000 7f7f53cf1640 1 --2- 172.21.15.2:0/192163644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f4c10a900 0x7f7f4c10ccf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:19.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.422+0000 7f7f53cf1640 1 --2- 172.21.15.2:0/192163644 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7f4c1017f0 0x7f7f4c101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.422+0000 7f7f53cf1640 1 -- 172.21.15.2:0/192163644 >> 172.21.15.2:0/192163644 conn(0x7f7f4c076f50 msgr2=0x7f7f4c077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.422+0000 7f7f53cf1640 1 -- 172.21.15.2:0/192163644 shutdown_connections 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.422+0000 7f7f53cf1640 1 -- 172.21.15.2:0/192163644 wait complete. 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f53cf1640 1 Processor -- start 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f53cf1640 1 -- start start 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f53cf1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f4c1017f0 0x7f7f4c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f53cf1640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7f4c10a900 0x7f7f4c198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f53cf1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f4c10d230 0x7f7f4c19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f53cf1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c112440 con 0x7f7f4c10d230 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f53cf1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c1122c0 con 0x7f7f4c1017f0 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f53cf1640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4c1125c0 con 0x7f7f4c10a900 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f5128c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7f4c10a900 0x7f7f4c198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:19.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f5228e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f4c10d230 0x7f7f4c19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f5128c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7f4c10a900 0x7f7f4c198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:52828/0 (socket says 172.21.15.2:52828) 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f5228e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f4c10d230 0x7f7f4c19e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50976/0 (socket says 172.21.15.2:50976) 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.423+0000 7f7f5128c640 1 -- 172.21.15.2:0/2922220708 learned_addr learned my addr 172.21.15.2:0/2922220708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f51a8d640 1 --2- 172.21.15.2:0/2922220708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f4c1017f0 0x7f7f4c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f5228e640 1 -- 172.21.15.2:0/2922220708 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7f4c10a900 msgr2=0x7f7f4c198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f5228e640 1 --2- 172.21.15.2:0/2922220708 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7f4c10a900 0x7f7f4c198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f5228e640 1 -- 172.21.15.2:0/2922220708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f4c1017f0 msgr2=0x7f7f4c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f5228e640 1 --2- 172.21.15.2:0/2922220708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f4c1017f0 0x7f7f4c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f5228e640 1 -- 172.21.15.2:0/2922220708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c19ea30 con 0x7f7f4c10d230 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f5128c640 1 --2- 172.21.15.2:0/2922220708 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7f4c10a900 0x7f7f4c198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f5228e640 1 --2- 172.21.15.2:0/2922220708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f4c10d230 0x7f7f4c19e260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400e940 tx=0x7f7f4400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f42ffd640 1 -- 172.21.15.2:0/2922220708 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f44004d20 con 0x7f7f4c10d230 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f42ffd640 1 -- 172.21.15.2:0/2922220708 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7f44005020 con 0x7f7f4c10d230 2024-09-21T13:39:19.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f53cf1640 1 -- 172.21.15.2:0/2922220708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4c19ed20 con 0x7f7f4c10d230 2024-09-21T13:39:19.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f42ffd640 1 -- 172.21.15.2:0/2922220708 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f440116d0 con 0x7f7f4c10d230 2024-09-21T13:39:19.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.424+0000 7f7f53cf1640 1 -- 172.21.15.2:0/2922220708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4c1a53e0 con 0x7f7f4c10d230 2024-09-21T13:39:19.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.425+0000 7f7f53cf1640 1 -- 172.21.15.2:0/2922220708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f4c101bd0 con 0x7f7f4c10d230 2024-09-21T13:39:19.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.426+0000 7f7f42ffd640 1 -- 172.21.15.2:0/2922220708 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 103248+0+0 (secure 0 0 0) 0x7f7f4400cb20 con 0x7f7f4c10d230 2024-09-21T13:39:19.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.426+0000 7f7f42ffd640 1 --2- 172.21.15.2:0/2922220708 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7f3807b0b0 0x7f7f3807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:19.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.426+0000 7f7f51a8d640 1 --2- 172.21.15.2:0/2922220708 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7f3807b0b0 0x7f7f3807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:19.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.426+0000 7f7f42ffd640 1 -- 172.21.15.2:0/2922220708 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7f7f4409e3a0 con 0x7f7f4c10d230 2024-09-21T13:39:19.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.427+0000 7f7f51a8d640 1 --2- 172.21.15.2:0/2922220708 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7f3807b0b0 0x7f7f3807d570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0095f0 tx=0x7f7f3c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:19.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.431+0000 7f7f42ffd640 1 -- 172.21.15.2:0/2922220708 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7f44016030 con 0x7f7f4c10d230 2024-09-21T13:39:19.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.618+0000 7f7f53cf1640 1 -- 172.21.15.2:0/2922220708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f4c1a5670 con 0x7f7f4c10d230 2024-09-21T13:39:19.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.619+0000 7f7f42ffd640 1 -- 172.21.15.2:0/2922220708 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+20686 (secure 0 0 0) 0x7f7f440698f0 con 0x7f7f4c10d230 2024-09-21T13:39:19.621 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:39:19.621 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":62,"fsid":"e6144070-781d-11ef-baf6-efdc52797490","created":"2024-09-21T13:33:08.087818+0000","modified":"2024-09-21T13:39:08.268488+0000","last_up_change":"2024-09-21T13:38:46.225842+0000","last_in_change":"2024-09-21T13:38:22.929302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T13:36:22.563835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2024-09-21T13:38:54.802236+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":56,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2024-09-21T13:38:56.157058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-09-21T13:38:57.724555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-09-21T13:38:59.670061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-21T13:39:01.741843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0640c953-1dfe-4a1a-b6cb-18d1dc62aedd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6801","nonce":1847462361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1847462361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1847462361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6803","nonce":1847462361}]},"public_addr":"172.21.15.2:6801/1847462361","cluster_addr":"172.21.15.2:6802/1847462361","heartbeat_back_addr":"172.21.15.2:6804/1847462361","heartbeat_front_addr":"172.21.15.2:6803/1847462361","state":["exists","up"]},{"osd":1,"uuid":"0b42fdd3-2070-4813-aa0b-478d0c046e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6805","nonce":2166392982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2166392982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":2166392982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":2166392982}]},"public_addr":"172.21.15.2:6805/2166392982","cluster_addr":"172.21.15.2:6806/2166392982","heartbeat_back_addr":"172.21.15.2:6808/2166392982","heartbeat_front_addr":"172.21.15.2:6807/2166392982","state":["exists","up"]},{"osd":2,"uuid":"0a2b34c3-05ed-4d0d-9552-6656b9fe2419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6809","nonce":3095985277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3095985277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3095985277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6811","nonce":3095985277}]},"public_addr":"172.21.15.2:6809/3095985277","cluster_addr":"172.21.15.2:6810/3095985277","heartbeat_back_addr":"172.21.15.2:6812/3095985277","heartbeat_front_addr":"172.21.15.2:6811/3095985277","state":["exists","up"]},{"osd":3,"uuid":"4149f0d3-5d3e-4b2b-8112-533db72dba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6813","nonce":2270199396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2270199396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2270199396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":2270199396}]},"public_addr":"172.21.15.2:6813/2270199396","cluster_addr":"172.21.15.2:6814/2270199396","heartbeat_back_addr":"172.21.15.2:6816/2270199396","heartbeat_front_addr":"172.21.15.2:6815/2270199396","state":["exists","up"]},{"osd":4,"uuid":"21be965a-204b-4793-9f70-7929714c63d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2284803610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6801","nonce":2284803610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2284803610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2284803610}]},"public_addr":"172.21.15.162:6800/2284803610","cluster_addr":"172.21.15.162:6801/2284803610","heartbeat_back_addr":"172.21.15.162:6803/2284803610","heartbeat_front_addr":"172.21.15.162:6802/2284803610","state":["exists","up"]},{"osd":5,"uuid":"399a3f0f-876c-4ea2-abbc-799384e1ebb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":309339656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6805","nonce":309339656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":309339656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":309339656}]},"public_addr":"172.21.15.162:6804/309339656","cluster_addr":"172.21.15.162:6805/309339656","heartbeat_back_addr":"172.21.15.162:6807/309339656","heartbeat_front_addr":"172.21.15.162:6806/309339656","state":["exists","up"]},{"osd":6,"uuid":"b698a992-5f48-4c67-829c-814bf21c67c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1212984287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":1212984287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6811","nonce":1212984287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1212984287}]},"public_addr":"172.21.15.162:6808/1212984287","cluster_addr":"172.21.15.162:6809/1212984287","heartbeat_back_addr":"172.21.15.162:6811/1212984287","heartbeat_front_addr":"172.21.15.162:6810/1212984287","state":["exists","up"]},{"osd":7,"uuid":"4609ec1b-c176-4d2e-a3b3-d8feca508e5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4048001305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4048001305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6815","nonce":4048001305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4048001305}]},"public_addr":"172.21.15.162:6812/4048001305","cluster_addr":"172.21.15.162:6813/4048001305","heartbeat_back_addr":"172.21.15.162:6815/4048001305","heartbeat_front_addr":"172.21.15.162:6814/4048001305","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:35:18.527645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:35:49.353335+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:36:19.657138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:36:50.314490+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:37:18.009418+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:37:45.529771+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:38:14.768579+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:38:44.326049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/2286006400":"2024-09-22T13:33:58.101702+0000","172.21.15.2:6800/2044640733":"2024-09-22T13:33:58.101702+0000","172.21.15.2:0/2236300066":"2024-09-22T13:33:58.101702+0000","172.21.15.2:0/1818679566":"2024-09-22T13:33:58.101702+0000","172.21.15.2:0/1740908995":"2024-09-22T13:33:31.065333+0000","172.21.15.2:6800/3091351943":"2024-09-22T13:33:31.065333+0000","172.21.15.2:0/2919667121":"2024-09-22T13:33:31.065333+0000","172.21.15.2:0/1659939686":"2024-09-22T13:33:31.065333+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T13:39:19.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 -- 172.21.15.2:0/2922220708 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7f3807b0b0 msgr2=0x7f7f3807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:19.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 --2- 172.21.15.2:0/2922220708 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7f3807b0b0 0x7f7f3807d570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0095f0 tx=0x7f7f3c005f90 comp rx=0 tx=0).stop 2024-09-21T13:39:19.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 -- 172.21.15.2:0/2922220708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f4c10d230 msgr2=0x7f7f4c19e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:19.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 --2- 172.21.15.2:0/2922220708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f4c10d230 0x7f7f4c19e260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400e940 tx=0x7f7f4400ee00 comp rx=0 tx=0).stop 2024-09-21T13:39:19.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 -- 172.21.15.2:0/2922220708 shutdown_connections 2024-09-21T13:39:19.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 --2- 172.21.15.2:0/2922220708 >> v2:172.21.15.2:6800/3897423974 conn(0x7f7f3807b0b0 0x7f7f3807d570 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:19.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 --2- 172.21.15.2:0/2922220708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f4c10d230 0x7f7f4c19e260 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:19.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 --2- 172.21.15.2:0/2922220708 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7f4c10a900 0x7f7f4c198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:19.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 --2- 172.21.15.2:0/2922220708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f4c1017f0 0x7f7f4c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:19.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 -- 172.21.15.2:0/2922220708 >> 172.21.15.2:0/2922220708 conn(0x7f7f4c076f50 msgr2=0x7f7f4c100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:19.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 -- 172.21.15.2:0/2922220708 shutdown_connections 2024-09-21T13:39:19.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:19.622+0000 7f7f53cf1640 1 -- 172.21.15.2:0/2922220708 wait complete. 2024-09-21T13:39:19.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:19 smithi162 ceph-mon[33046]: pgmap v212: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 307 B/s wr, 29 op/s 2024-09-21T13:39:19.923 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:19 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:19.923 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2922220708' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T13:39:19.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:19 smithi002 ceph-mon[30076]: pgmap v212: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 307 B/s wr, 29 op/s 2024-09-21T13:39:19.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:19 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:19.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2922220708' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T13:39:19.985 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:19 smithi002 ceph-mon[40622]: pgmap v212: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 307 B/s wr, 29 op/s 2024-09-21T13:39:19.985 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:19 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:19.985 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2922220708' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T13:39:20.233 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 systemd[1]: Starting Ceph prometheus.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:39:20.368 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T13:39:20.369 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T13:39:20.571 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 podman[61885]: 2024-09-21 13:39:20.221725217 +0000 UTC m=+0.016596277 image pull 1d3b7f56885b6dd623f1785be963aa9c195f86bc256ea454e8d02a7980b79c53 quay.io/prometheus/prometheus:v2.51.0 2024-09-21T13:39:20.571 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 podman[61885]: 2024-09-21 13:39:20.34306707 +0000 UTC m=+0.137938171 container create a1560bd0df2137d348c92eb18b046de653ebde2f0a7251f5612cfb0702cfac8c (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T13:39:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:20.983 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 podman[61885]: 2024-09-21 13:39:20.5705874 +0000 UTC m=+0.365458467 container init a1560bd0df2137d348c92eb18b046de653ebde2f0a7251f5612cfb0702cfac8c (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T13:39:20.983 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 podman[61885]: 2024-09-21 13:39:20.575854821 +0000 UTC m=+0.370725893 container start a1560bd0df2137d348c92eb18b046de653ebde2f0a7251f5612cfb0702cfac8c (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T13:39:20.983 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.595Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.0, branch=HEAD, revision=c05c15512acb675e3f6cd662a6727854e93fc024)" 2024-09-21T13:39:20.983 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.595Z caller=main.go:622 level=info build_context="(go=go1.22.1, platform=linux/amd64, user=root@b5723e458358, date=20240319-10:54:45, tags=netgo,builtinassets,stringlabels)" 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.596Z caller=main.go:623 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi162 (none))" 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.596Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.596Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.597Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=:9095 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.597Z caller=main.go:1129 level=info msg="Starting TSDB ..." 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.599Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.599Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.601Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.601Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.852µs 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.601Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.601Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.601Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=32.499µs wal_replay_duration=394.879µs wbl_replay_duration=89ns total_replay_duration=447.68µs 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.603Z caller=main.go:1150 level=info fs_type=XFS_SUPER_MAGIC 2024-09-21T13:39:20.984 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.603Z caller=main.go:1153 level=info msg="TSDB started" 2024-09-21T13:39:20.985 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.603Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-21T13:39:20.985 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.618Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=15.175305ms db_storage=684ns remote_storage=985ns web_handler=252ns query_engine=510ns scrape=385.867µs scrape_sd=92.733µs notify=672ns notify_sd=651ns rules=14.406081ms tracing=6.601µs 2024-09-21T13:39:20.985 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.618Z caller=main.go:1114 level=info msg="Server is ready to receive web requests." 2024-09-21T13:39:20.985 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:39:20.618Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..." 2024-09-21T13:39:20.985 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 bash[61885]: a1560bd0df2137d348c92eb18b046de653ebde2f0a7251f5612cfb0702cfac8c 2024-09-21T13:39:20.985 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:39:20 smithi162 systemd[1]: Started Ceph prometheus.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.113+0000 7f1591b2c640 1 -- 172.21.15.2:0/1947301147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f158c1076b0 msgr2=0x7f158c107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.113+0000 7f1591b2c640 1 --2- 172.21.15.2:0/1947301147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f158c1076b0 0x7f158c107af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1580009900 tx=0x7f158002a410 comp rx=0 tx=0).stop 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.113+0000 7f1591b2c640 1 -- 172.21.15.2:0/1947301147 shutdown_connections 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.113+0000 7f1591b2c640 1 --2- 172.21.15.2:0/1947301147 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f158c108030 0x7f158c10e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.113+0000 7f1591b2c640 1 --2- 172.21.15.2:0/1947301147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f158c1076b0 0x7f158c107af0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.113+0000 7f1591b2c640 1 --2- 172.21.15.2:0/1947301147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f158c101ca0 0x7f158c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.113+0000 7f1591b2c640 1 -- 172.21.15.2:0/1947301147 >> 172.21.15.2:0/1947301147 conn(0x7f158c0fd710 msgr2=0x7f158c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.114+0000 7f1591b2c640 1 -- 172.21.15.2:0/1947301147 shutdown_connections 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.114+0000 7f1591b2c640 1 -- 172.21.15.2:0/1947301147 wait complete. 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.114+0000 7f1591b2c640 1 Processor -- start 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.114+0000 7f1591b2c640 1 -- start start 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.114+0000 7f1591b2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f158c101ca0 0x7f158c199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.114+0000 7f1591b2c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f158c1076b0 0x7f158c199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f1591b2c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f158c108030 0x7f158c19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f1591b2c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1113e0 con 0x7f158c101ca0 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f1591b2c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f158c111260 con 0x7f158c1076b0 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f1591b2c640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f158c111560 con 0x7f158c108030 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f158c101ca0 0x7f158c199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158bfff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f158c108030 0x7f158c19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158bfff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f158c108030 0x7f158c19a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:52838/0 (socket says 172.21.15.2:52838) 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158bfff640 1 -- 172.21.15.2:0/548924596 learned_addr learned my addr 172.21.15.2:0/548924596 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f158c101ca0 0x7f158c199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50992/0 (socket says 172.21.15.2:50992) 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158affd640 1 --2- 172.21.15.2:0/548924596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f158c1076b0 0x7f158c199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158bfff640 1 -- 172.21.15.2:0/548924596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f158c1076b0 msgr2=0x7f158c199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158bfff640 1 --2- 172.21.15.2:0/548924596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f158c1076b0 0x7f158c199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158bfff640 1 -- 172.21.15.2:0/548924596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f158c101ca0 msgr2=0x7f158c199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158bfff640 1 --2- 172.21.15.2:0/548924596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f158c101ca0 0x7f158c199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158bfff640 1 -- 172.21.15.2:0/548924596 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c1a4af0 con 0x7f158c108030 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f158bfff640 1 --2- 172.21.15.2:0/548924596 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f158c108030 0x7f158c19a1b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f158400efd0 tx=0x7f158400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f1588ff9640 1 -- 172.21.15.2:0/548924596 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584003b70 con 0x7f158c108030 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f1588ff9640 1 -- 172.21.15.2:0/548924596 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f1584003d10 con 0x7f158c108030 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f1591b2c640 1 -- 172.21.15.2:0/548924596 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c1a4de0 con 0x7f158c108030 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f1588ff9640 1 -- 172.21.15.2:0/548924596 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840106c0 con 0x7f158c108030 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.115+0000 7f1591b2c640 1 -- 172.21.15.2:0/548924596 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c1a5240 con 0x7f158c108030 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.116+0000 7f1591b2c640 1 -- 172.21.15.2:0/548924596 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f158c102080 con 0x7f158c108030 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.117+0000 7f1588ff9640 1 -- 172.21.15.2:0/548924596 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 16) ==== 103248+0+0 (secure 0 0 0) 0x7f1584004020 con 0x7f158c108030 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.118+0000 7f1588ff9640 1 --2- 172.21.15.2:0/548924596 >> v2:172.21.15.2:6800/3897423974 conn(0x7f157407b0b0 0x7f157407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.118+0000 7f1588ff9640 1 -- 172.21.15.2:0/548924596 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7f158409e760 con 0x7f158c108030 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.118+0000 7f158b7fe640 1 --2- 172.21.15.2:0/548924596 >> v2:172.21.15.2:6800/3897423974 conn(0x7f157407b0b0 0x7f157407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.118+0000 7f158b7fe640 1 --2- 172.21.15.2:0/548924596 >> v2:172.21.15.2:6800/3897423974 conn(0x7f157407b0b0 0x7f157407d570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f157c00abe0 tx=0x7f157c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.122+0000 7f1588ff9640 1 -- 172.21.15.2:0/548924596 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1584069d30 con 0x7f158c108030 2024-09-21T13:39:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.311+0000 7f1591b2c640 1 -- 172.21.15.2:0/548924596 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f158c109e40 con 0x7f158c108030 2024-09-21T13:39:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.312+0000 7f1588ff9640 1 -- 172.21.15.2:0/548924596 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+20686 (secure 0 0 0) 0x7f158406ebe0 con 0x7f158c108030 2024-09-21T13:39:21.314 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:39:21.314 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":62,"fsid":"e6144070-781d-11ef-baf6-efdc52797490","created":"2024-09-21T13:33:08.087818+0000","modified":"2024-09-21T13:39:08.268488+0000","last_up_change":"2024-09-21T13:38:46.225842+0000","last_in_change":"2024-09-21T13:38:22.929302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T13:36:22.563835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2024-09-21T13:38:54.802236+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":56,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2024-09-21T13:38:56.157058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-09-21T13:38:57.724555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-09-21T13:38:59.670061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-21T13:39:01.741843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0640c953-1dfe-4a1a-b6cb-18d1dc62aedd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6801","nonce":1847462361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1847462361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1847462361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6803","nonce":1847462361}]},"public_addr":"172.21.15.2:6801/1847462361","cluster_addr":"172.21.15.2:6802/1847462361","heartbeat_back_addr":"172.21.15.2:6804/1847462361","heartbeat_front_addr":"172.21.15.2:6803/1847462361","state":["exists","up"]},{"osd":1,"uuid":"0b42fdd3-2070-4813-aa0b-478d0c046e59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6805","nonce":2166392982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2166392982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":2166392982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":2166392982}]},"public_addr":"172.21.15.2:6805/2166392982","cluster_addr":"172.21.15.2:6806/2166392982","heartbeat_back_addr":"172.21.15.2:6808/2166392982","heartbeat_front_addr":"172.21.15.2:6807/2166392982","state":["exists","up"]},{"osd":2,"uuid":"0a2b34c3-05ed-4d0d-9552-6656b9fe2419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6809","nonce":3095985277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3095985277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3095985277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6811","nonce":3095985277}]},"public_addr":"172.21.15.2:6809/3095985277","cluster_addr":"172.21.15.2:6810/3095985277","heartbeat_back_addr":"172.21.15.2:6812/3095985277","heartbeat_front_addr":"172.21.15.2:6811/3095985277","state":["exists","up"]},{"osd":3,"uuid":"4149f0d3-5d3e-4b2b-8112-533db72dba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6813","nonce":2270199396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2270199396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2270199396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":2270199396}]},"public_addr":"172.21.15.2:6813/2270199396","cluster_addr":"172.21.15.2:6814/2270199396","heartbeat_back_addr":"172.21.15.2:6816/2270199396","heartbeat_front_addr":"172.21.15.2:6815/2270199396","state":["exists","up"]},{"osd":4,"uuid":"21be965a-204b-4793-9f70-7929714c63d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2284803610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6801","nonce":2284803610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2284803610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2284803610}]},"public_addr":"172.21.15.162:6800/2284803610","cluster_addr":"172.21.15.162:6801/2284803610","heartbeat_back_addr":"172.21.15.162:6803/2284803610","heartbeat_front_addr":"172.21.15.162:6802/2284803610","state":["exists","up"]},{"osd":5,"uuid":"399a3f0f-876c-4ea2-abbc-799384e1ebb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":309339656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6805","nonce":309339656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":309339656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":309339656}]},"public_addr":"172.21.15.162:6804/309339656","cluster_addr":"172.21.15.162:6805/309339656","heartbeat_back_addr":"172.21.15.162:6807/309339656","heartbeat_front_addr":"172.21.15.162:6806/309339656","state":["exists","up"]},{"osd":6,"uuid":"b698a992-5f48-4c67-829c-814bf21c67c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1212984287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":1212984287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6811","nonce":1212984287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1212984287}]},"public_addr":"172.21.15.162:6808/1212984287","cluster_addr":"172.21.15.162:6809/1212984287","heartbeat_back_addr":"172.21.15.162:6811/1212984287","heartbeat_front_addr":"172.21.15.162:6810/1212984287","state":["exists","up"]},{"osd":7,"uuid":"4609ec1b-c176-4d2e-a3b3-d8feca508e5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4048001305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4048001305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6815","nonce":4048001305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4048001305}]},"public_addr":"172.21.15.162:6812/4048001305","cluster_addr":"172.21.15.162:6813/4048001305","heartbeat_back_addr":"172.21.15.162:6815/4048001305","heartbeat_front_addr":"172.21.15.162:6814/4048001305","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:35:18.527645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:35:49.353335+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:36:19.657138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:36:50.314490+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:37:18.009418+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:37:45.529771+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:38:14.768579+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:38:44.326049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/2286006400":"2024-09-22T13:33:58.101702+0000","172.21.15.2:6800/2044640733":"2024-09-22T13:33:58.101702+0000","172.21.15.2:0/2236300066":"2024-09-22T13:33:58.101702+0000","172.21.15.2:0/1818679566":"2024-09-22T13:33:58.101702+0000","172.21.15.2:0/1740908995":"2024-09-22T13:33:31.065333+0000","172.21.15.2:6800/3091351943":"2024-09-22T13:33:31.065333+0000","172.21.15.2:0/2919667121":"2024-09-22T13:33:31.065333+0000","172.21.15.2:0/1659939686":"2024-09-22T13:33:31.065333+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T13:39:21.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 -- 172.21.15.2:0/548924596 >> v2:172.21.15.2:6800/3897423974 conn(0x7f157407b0b0 msgr2=0x7f157407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:21.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 --2- 172.21.15.2:0/548924596 >> v2:172.21.15.2:6800/3897423974 conn(0x7f157407b0b0 0x7f157407d570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f157c00abe0 tx=0x7f157c00a2d0 comp rx=0 tx=0).stop 2024-09-21T13:39:21.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 -- 172.21.15.2:0/548924596 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f158c108030 msgr2=0x7f158c19a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 --2- 172.21.15.2:0/548924596 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f158c108030 0x7f158c19a1b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f158400efd0 tx=0x7f158400c6a0 comp rx=0 tx=0).stop 2024-09-21T13:39:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 -- 172.21.15.2:0/548924596 shutdown_connections 2024-09-21T13:39:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 --2- 172.21.15.2:0/548924596 >> v2:172.21.15.2:6800/3897423974 conn(0x7f157407b0b0 0x7f157407d570 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 --2- 172.21.15.2:0/548924596 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f158c108030 0x7f158c19a1b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 --2- 172.21.15.2:0/548924596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f158c1076b0 0x7f158c199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 --2- 172.21.15.2:0/548924596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f158c101ca0 0x7f158c199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 -- 172.21.15.2:0/548924596 >> 172.21.15.2:0/548924596 conn(0x7f158c0fd710 msgr2=0x7f158c0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 -- 172.21.15.2:0/548924596 shutdown_connections 2024-09-21T13:39:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:21.315+0000 7f1591b2c640 1 -- 172.21.15.2:0/548924596 wait complete. 2024-09-21T13:39:21.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[30076]: pgmap v213: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 258 B/s wr, 25 op/s 2024-09-21T13:39:21.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:21.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:21.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:21.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-21T13:39:21.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/548924596' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T13:39:21.903 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[40622]: pgmap v213: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 258 B/s wr, 25 op/s 2024-09-21T13:39:21.903 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:21.903 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:21.903 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:21.903 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-21T13:39:21.903 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/548924596' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T13:39:21.904 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ignoring --setuser ceph since I am not root 2024-09-21T13:39:21.904 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:21 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ignoring --setgroup ceph since I am not root 2024-09-21T13:39:21.933 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T13:39:21.933 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T13:39:21.933 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T13:39:21.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T13:39:21.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T13:39:21.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T13:39:21.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T13:39:21.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T13:39:21.983 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:39:21 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x[34695]: ignoring --setuser ceph since I am not root 2024-09-21T13:39:21.983 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:39:21 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x[34695]: ignoring --setgroup ceph since I am not root 2024-09-21T13:39:21.983 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:39:21 smithi162 ceph-mgr[34718]: -- 172.21.15.162:0/408106757 <== mon.2 v2:172.21.15.2:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a3e07af0e0 con 0x55a3e078d400 2024-09-21T13:39:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:21 smithi162 ceph-mon[33046]: pgmap v213: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 258 B/s wr, 25 op/s 2024-09-21T13:39:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:21 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:21 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:21 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' 2024-09-21T13:39:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:21 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-21T13:39:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/548924596' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T13:39:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:22.540 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:22.891 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:22 smithi002 ceph-mon[30076]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T13:39:22.891 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:22 smithi002 ceph-mon[30076]: mgrmap e17: y(active, since 5m), standbys: x 2024-09-21T13:39:22.891 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:22 smithi002 ceph-mon[40622]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T13:39:22.891 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:22 smithi002 ceph-mon[40622]: mgrmap e17: y(active, since 5m), standbys: x 2024-09-21T13:39:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:22 smithi162 ceph-mon[33046]: from='mgr.14152 172.21.15.2:0/1530208758' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T13:39:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:22 smithi162 ceph-mon[33046]: mgrmap e17: y(active, since 5m), standbys: x 2024-09-21T13:39:23.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.327+0000 7f726e0a8640 1 -- 172.21.15.2:0/2221256131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7268107670 msgr2=0x7f7268107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:23.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.327+0000 7f726e0a8640 1 --2- 172.21.15.2:0/2221256131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7268107670 0x7f7268107ab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7250009900 tx=0x7f725002a410 comp rx=0 tx=0).stop 2024-09-21T13:39:23.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.327+0000 7f726e0a8640 1 -- 172.21.15.2:0/2221256131 shutdown_connections 2024-09-21T13:39:23.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.327+0000 7f726e0a8640 1 --2- 172.21.15.2:0/2221256131 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7268107ff0 0x7f726810e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.327+0000 7f726e0a8640 1 --2- 172.21.15.2:0/2221256131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7268107670 0x7f7268107ab0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.327+0000 7f726e0a8640 1 --2- 172.21.15.2:0/2221256131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7268101c60 0x7f7268102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.327+0000 7f726e0a8640 1 -- 172.21.15.2:0/2221256131 >> 172.21.15.2:0/2221256131 conn(0x7f72680fd6d0 msgr2=0x7f72680ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.327+0000 7f726e0a8640 1 -- 172.21.15.2:0/2221256131 shutdown_connections 2024-09-21T13:39:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.327+0000 7f726e0a8640 1 -- 172.21.15.2:0/2221256131 wait complete. 2024-09-21T13:39:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f726e0a8640 1 Processor -- start 2024-09-21T13:39:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f726e0a8640 1 -- start start 2024-09-21T13:39:23.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f726e0a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7268101c60 0x7f72680fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:23.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f726e0a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7268107670 0x7f72680fe110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:23.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f726e0a8640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7268107ff0 0x7f72680fe650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:23.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f726e0a8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72681113c0 con 0x7f7268101c60 2024-09-21T13:39:23.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f726e0a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7268111240 con 0x7f7268107670 2024-09-21T13:39:23.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f726e0a8640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f7268111540 con 0x7f7268107ff0 2024-09-21T13:39:23.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f72677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7268101c60 0x7f72680fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:23.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f725effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7268107670 0x7f72680fe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:23.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f72677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7268101c60 0x7f72680fdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51022/0 (socket says 172.21.15.2:51022) 2024-09-21T13:39:23.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f7267fff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7268107ff0 0x7f72680fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:23.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.328+0000 7f72677fe640 1 -- 172.21.15.2:0/542692056 learned_addr learned my addr 172.21.15.2:0/542692056 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:23.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.329+0000 7f725effd640 1 -- 172.21.15.2:0/542692056 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7268107ff0 msgr2=0x7f72680fe650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:23.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.329+0000 7f725effd640 1 --2- 172.21.15.2:0/542692056 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7268107ff0 0x7f72680fe650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.329+0000 7f725effd640 1 -- 172.21.15.2:0/542692056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7268101c60 msgr2=0x7f72680fdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:23.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.329+0000 7f725effd640 1 --2- 172.21.15.2:0/542692056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7268101c60 0x7f72680fdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.329+0000 7f725effd640 1 -- 172.21.15.2:0/542692056 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72681a6dc0 con 0x7f7268107670 2024-09-21T13:39:23.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.329+0000 7f725effd640 1 --2- 172.21.15.2:0/542692056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7268107670 0x7f72680fe110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f725002a930 tx=0x7f7250004ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:23.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.329+0000 7f72657fa640 1 -- 172.21.15.2:0/542692056 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725003f030 con 0x7f7268107670 2024-09-21T13:39:23.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.329+0000 7f726e0a8640 1 -- 172.21.15.2:0/542692056 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72681a7050 con 0x7f7268107670 2024-09-21T13:39:23.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.329+0000 7f72657fa640 1 -- 172.21.15.2:0/542692056 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f72500044c0 con 0x7f7268107670 2024-09-21T13:39:23.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.329+0000 7f72657fa640 1 -- 172.21.15.2:0/542692056 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250035070 con 0x7f7268107670 2024-09-21T13:39:23.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.329+0000 7f726e0a8640 1 -- 172.21.15.2:0/542692056 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72681a7530 con 0x7f7268107670 2024-09-21T13:39:23.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.330+0000 7f726e0a8640 1 -- 172.21.15.2:0/542692056 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7268104f00 con 0x7f7268107670 2024-09-21T13:39:23.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.331+0000 7f72657fa640 1 -- 172.21.15.2:0/542692056 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 17) ==== 103262+0+0 (secure 0 0 0) 0x7f7250042030 con 0x7f7268107670 2024-09-21T13:39:23.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.332+0000 7f72657fa640 1 --2- 172.21.15.2:0/542692056 >> v2:172.21.15.2:6800/3897423974 conn(0x7f725407b100 0x7f725407d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:23.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.332+0000 7f72677fe640 1 -- 172.21.15.2:0/542692056 >> v2:172.21.15.2:6800/3897423974 conn(0x7f725407b100 msgr2=0x7f725407d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3897423974 2024-09-21T13:39:23.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.332+0000 7f72657fa640 1 -- 172.21.15.2:0/542692056 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7f72500be740 con 0x7f7268107670 2024-09-21T13:39:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.332+0000 7f72677fe640 1 --2- 172.21.15.2:0/542692056 >> v2:172.21.15.2:6800/3897423974 conn(0x7f725407b100 0x7f725407d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:39:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.332+0000 7f72657fa640 1 --2- 172.21.15.2:0/542692056 >> v2:172.21.15.2:6809/3095985277 conn(0x7f72540846d0 0x7f7254086b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.332+0000 7f72657fa640 1 -- 172.21.15.2:0/542692056 --> v2:172.21.15.2:6809/3095985277 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72540871c0 con 0x7f72540846d0 2024-09-21T13:39:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.332+0000 7f72657fa640 1 -- 172.21.15.2:0/542692056 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f72500beaf0 con 0x7f7268107670 2024-09-21T13:39:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.332+0000 7f7267fff640 1 --2- 172.21.15.2:0/542692056 >> v2:172.21.15.2:6809/3095985277 conn(0x7f72540846d0 0x7f7254086b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.332+0000 7f7267fff640 1 --2- 172.21.15.2:0/542692056 >> v2:172.21.15.2:6809/3095985277 conn(0x7f72540846d0 0x7f7254086b30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:23.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.333+0000 7f72657fa640 1 -- 172.21.15.2:0/542692056 <== osd.2 v2:172.21.15.2:6809/3095985277 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72540871c0 con 0x7f72540846d0 2024-09-21T13:39:23.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.347+0000 7f726e0a8640 1 -- 172.21.15.2:0/542692056 --> v2:172.21.15.2:6809/3095985277 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7268102f10 con 0x7f72540846d0 2024-09-21T13:39:23.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.347+0000 7f72657fa640 1 -- 172.21.15.2:0/542692056 <== osd.2 v2:172.21.15.2:6809/3095985277 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7268102f10 con 0x7f72540846d0 2024-09-21T13:39:23.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.347+0000 7f726e0a8640 1 -- 172.21.15.2:0/542692056 >> v2:172.21.15.2:6809/3095985277 conn(0x7f72540846d0 msgr2=0x7f7254086b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:23.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.347+0000 7f726e0a8640 1 --2- 172.21.15.2:0/542692056 >> v2:172.21.15.2:6809/3095985277 conn(0x7f72540846d0 0x7f7254086b30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.347+0000 7f726e0a8640 1 -- 172.21.15.2:0/542692056 >> v2:172.21.15.2:6800/3897423974 conn(0x7f725407b100 msgr2=0x7f725407d5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:39:23.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.347+0000 7f726e0a8640 1 --2- 172.21.15.2:0/542692056 >> v2:172.21.15.2:6800/3897423974 conn(0x7f725407b100 0x7f725407d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.347+0000 7f726e0a8640 1 -- 172.21.15.2:0/542692056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7268107670 msgr2=0x7f72680fe110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:23.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.347+0000 7f726e0a8640 1 --2- 172.21.15.2:0/542692056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7268107670 0x7f72680fe110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f725002a930 tx=0x7f7250004ed0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.347+0000 7f7267fff640 1 -- 172.21.15.2:0/542692056 reap_dead start 2024-09-21T13:39:23.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.348+0000 7f726e0a8640 1 -- 172.21.15.2:0/542692056 shutdown_connections 2024-09-21T13:39:23.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.348+0000 7f726e0a8640 1 -- 172.21.15.2:0/542692056 >> 172.21.15.2:0/542692056 conn(0x7f72680fd6d0 msgr2=0x7f726806aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:23.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.348+0000 7f726e0a8640 1 -- 172.21.15.2:0/542692056 shutdown_connections 2024-09-21T13:39:23.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.348+0000 7f726e0a8640 1 -- 172.21.15.2:0/542692056 wait complete. 2024-09-21T13:39:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.697+0000 7f96c63f9640 1 -- 172.21.15.2:0/3753768270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c010d0d0 msgr2=0x7f96c010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.697+0000 7f96c63f9640 1 --2- 172.21.15.2:0/3753768270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c010d0d0 0x7f96c010f530 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009ca0 tx=0x7f96b802a8c0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.697+0000 7f96c63f9640 1 -- 172.21.15.2:0/3753768270 shutdown_connections 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.697+0000 7f96c63f9640 1 --2- 172.21.15.2:0/3753768270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c010d0d0 0x7f96c010f530 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.697+0000 7f96c63f9640 1 --2- 172.21.15.2:0/3753768270 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f96c0104590 0x7f96c010ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.697+0000 7f96c63f9640 1 --2- 172.21.15.2:0/3753768270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96c0103c70 0x7f96c0104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.697+0000 7f96c63f9640 1 -- 172.21.15.2:0/3753768270 >> 172.21.15.2:0/3753768270 conn(0x7f96c00fd6d0 msgr2=0x7f96c00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.697+0000 7f96c63f9640 1 -- 172.21.15.2:0/3753768270 shutdown_connections 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.697+0000 7f96c63f9640 1 -- 172.21.15.2:0/3753768270 wait complete. 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.698+0000 7f96c63f9640 1 Processor -- start 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.698+0000 7f96c63f9640 1 -- start start 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.698+0000 7f96c63f9640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f96c0103c70 0x7f96c0198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.698+0000 7f96c63f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96c0104590 0x7f96c0198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96c63f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c010d0d0 0x7f96c019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96c63f9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f96c0112450 con 0x7f96c010d0d0 2024-09-21T13:39:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96c63f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96c01122d0 con 0x7f96c0104590 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96c63f9640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f96c01125d0 con 0x7f96c0103c70 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bffff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f96c0103c70 0x7f96c0198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96c4996640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c010d0d0 0x7f96c019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bffff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f96c0103c70 0x7f96c0198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:52884/0 (socket says 172.21.15.2:52884) 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bffff640 1 -- 172.21.15.2:0/3886097639 learned_addr learned my addr 172.21.15.2:0/3886097639 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bf7fe640 1 --2- 172.21.15.2:0/3886097639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96c0104590 0x7f96c0198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bf7fe640 1 -- 172.21.15.2:0/3886097639 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f96c0103c70 msgr2=0x7f96c0198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bf7fe640 1 --2- 172.21.15.2:0/3886097639 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f96c0103c70 0x7f96c0198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bf7fe640 1 -- 172.21.15.2:0/3886097639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c010d0d0 msgr2=0x7f96c019e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bf7fe640 1 --2- 172.21.15.2:0/3886097639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c010d0d0 0x7f96c019e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bf7fe640 1 -- 172.21.15.2:0/3886097639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c019e9b0 con 0x7f96c0104590 2024-09-21T13:39:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96c4996640 1 --2- 172.21.15.2:0/3886097639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c010d0d0 0x7f96c019e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bffff640 1 --2- 172.21.15.2:0/3886097639 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f96c0103c70 0x7f96c0198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bf7fe640 1 --2- 172.21.15.2:0/3886097639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96c0104590 0x7f96c0198e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f96b400e9c0 tx=0x7f96b400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.699+0000 7f96bd7fa640 1 -- 172.21.15.2:0/3886097639 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b400ccc0 con 0x7f96c0104590 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.700+0000 7f96bd7fa640 1 -- 172.21.15.2:0/3886097639 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f96b40108b0 con 0x7f96c0104590 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.700+0000 7f96c63f9640 1 -- 172.21.15.2:0/3886097639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c019eca0 con 0x7f96c0104590 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.700+0000 7f96bd7fa640 1 -- 172.21.15.2:0/3886097639 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b40186b0 con 0x7f96c0104590 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.700+0000 7f96c63f9640 1 -- 172.21.15.2:0/3886097639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c01a5360 con 0x7f96c0104590 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.700+0000 7f96c63f9640 1 -- 172.21.15.2:0/3886097639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96c0063820 con 0x7f96c0104590 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.701+0000 7f96bd7fa640 1 -- 172.21.15.2:0/3886097639 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 17) ==== 103262+0+0 (secure 0 0 0) 0x7f96b401f020 con 0x7f96c0104590 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.702+0000 7f96bd7fa640 1 --2- 172.21.15.2:0/3886097639 >> v2:172.21.15.2:6800/3897423974 conn(0x7f96a807b100 0x7f96a807d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.702+0000 7f96bffff640 1 -- 172.21.15.2:0/3886097639 >> v2:172.21.15.2:6800/3897423974 conn(0x7f96a807b100 msgr2=0x7f96a807d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3897423974 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.702+0000 7f96bd7fa640 1 -- 172.21.15.2:0/3886097639 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7f96b409e470 con 0x7f96c0104590 2024-09-21T13:39:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.702+0000 7f96bffff640 1 --2- 172.21.15.2:0/3886097639 >> v2:172.21.15.2:6800/3897423974 conn(0x7f96a807b100 0x7f96a807d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:39:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.702+0000 7f96bd7fa640 1 --2- 172.21.15.2:0/3886097639 >> v2:172.21.15.2:6805/2166392982 conn(0x7f96a80846d0 0x7f96a8086b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.702+0000 7f96bd7fa640 1 -- 172.21.15.2:0/3886097639 --> v2:172.21.15.2:6805/2166392982 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96b4015e80 con 0x7f96a80846d0 2024-09-21T13:39:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.702+0000 7f96bd7fa640 1 -- 172.21.15.2:0/3886097639 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f96b409e820 con 0x7f96c0104590 2024-09-21T13:39:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.702+0000 7f96c4996640 1 --2- 172.21.15.2:0/3886097639 >> v2:172.21.15.2:6805/2166392982 conn(0x7f96a80846d0 0x7f96a8086b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.702+0000 7f96c4996640 1 --2- 172.21.15.2:0/3886097639 >> v2:172.21.15.2:6805/2166392982 conn(0x7f96a80846d0 0x7f96a8086b30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.703+0000 7f96bd7fa640 1 -- 172.21.15.2:0/3886097639 <== osd.1 v2:172.21.15.2:6805/2166392982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96b4015e80 con 0x7f96a80846d0 2024-09-21T13:39:23.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.717+0000 7f96c63f9640 1 -- 172.21.15.2:0/3886097639 --> v2:172.21.15.2:6805/2166392982 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f96c0063c20 con 0x7f96a80846d0 2024-09-21T13:39:23.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.717+0000 7f96bd7fa640 1 -- 172.21.15.2:0/3886097639 <== osd.1 v2:172.21.15.2:6805/2166392982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f96c0063c20 con 0x7f96a80846d0 2024-09-21T13:39:23.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.718+0000 7f96c63f9640 1 -- 172.21.15.2:0/3886097639 >> v2:172.21.15.2:6805/2166392982 conn(0x7f96a80846d0 msgr2=0x7f96a8086b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:23.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.718+0000 7f96c63f9640 1 --2- 172.21.15.2:0/3886097639 >> v2:172.21.15.2:6805/2166392982 conn(0x7f96a80846d0 0x7f96a8086b30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.718+0000 7f96c63f9640 1 -- 172.21.15.2:0/3886097639 >> v2:172.21.15.2:6800/3897423974 conn(0x7f96a807b100 msgr2=0x7f96a807d5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:39:23.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.718+0000 7f96c63f9640 1 --2- 172.21.15.2:0/3886097639 >> v2:172.21.15.2:6800/3897423974 conn(0x7f96a807b100 0x7f96a807d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:23.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.718+0000 7f96c63f9640 1 -- 172.21.15.2:0/3886097639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96c0104590 msgr2=0x7f96c0198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:23.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.718+0000 7f96c63f9640 1 --2- 172.21.15.2:0/3886097639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96c0104590 0x7f96c0198e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f96b400e9c0 tx=0x7f96b400ee80 comp rx=0 tx=0).stop 2024-09-21T13:39:23.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.718+0000 7f96c4996640 1 -- 172.21.15.2:0/3886097639 reap_dead start 2024-09-21T13:39:23.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.718+0000 7f96c63f9640 1 -- 172.21.15.2:0/3886097639 shutdown_connections 2024-09-21T13:39:23.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.718+0000 7f96c63f9640 1 -- 172.21.15.2:0/3886097639 >> 172.21.15.2:0/3886097639 conn(0x7f96c00fd6d0 msgr2=0x7f96c00fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:23.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.718+0000 7f96c63f9640 1 -- 172.21.15.2:0/3886097639 shutdown_connections 2024-09-21T13:39:23.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:23.718+0000 7f96c63f9640 1 -- 172.21.15.2:0/3886097639 wait complete. 2024-09-21T13:39:24.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.203+0000 7fb156397640 1 -- 172.21.15.2:0/232305036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150107ff0 msgr2=0x7fb15010e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:24.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.203+0000 7fb156397640 1 --2- 172.21.15.2:0/232305036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150107ff0 0x7fb15010e7f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb148009ca0 tx=0x7fb14802a8c0 comp rx=0 tx=0).stop 2024-09-21T13:39:24.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.203+0000 7fb156397640 1 -- 172.21.15.2:0/232305036 shutdown_connections 2024-09-21T13:39:24.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.203+0000 7fb156397640 1 --2- 172.21.15.2:0/232305036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150107ff0 0x7fb15010e7f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:24.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.203+0000 7fb156397640 1 --2- 172.21.15.2:0/232305036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb150107670 0x7fb150107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:24.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.203+0000 7fb156397640 1 --2- 172.21.15.2:0/232305036 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb150101c60 0x7fb150102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:24.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.203+0000 7fb156397640 1 -- 172.21.15.2:0/232305036 >> 172.21.15.2:0/232305036 conn(0x7fb1500fd6d0 msgr2=0x7fb1500ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:24.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.203+0000 7fb156397640 1 -- 172.21.15.2:0/232305036 shutdown_connections 2024-09-21T13:39:24.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.203+0000 7fb156397640 1 -- 172.21.15.2:0/232305036 wait complete. 2024-09-21T13:39:24.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.203+0000 7fb156397640 1 Processor -- start 2024-09-21T13:39:24.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.203+0000 7fb156397640 1 -- start start 2024-09-21T13:39:24.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb156397640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb150101c60 0x7fb150198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:24.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb156397640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb150107670 0x7fb150198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb156397640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150107ff0 0x7fb15019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb156397640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1501113d0 con 0x7fb150107ff0 2024-09-21T13:39:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb156397640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb150111250 con 0x7fb150107670 2024-09-21T13:39:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb156397640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fb150111550 con 0x7fb150101c60 2024-09-21T13:39:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb14ffff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb150101c60 0x7fb150198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb14ffff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb150101c60 0x7fb150198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:52894/0 (socket says 172.21.15.2:52894) 2024-09-21T13:39:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb14ffff640 1 -- 172.21.15.2:0/87352904 learned_addr learned my addr 172.21.15.2:0/87352904 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb154934640 1 --2- 172.21.15.2:0/87352904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150107ff0 0x7fb15019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:24.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb14f7fe640 1 --2- 172.21.15.2:0/87352904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb150107670 0x7fb150198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:24.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb14ffff640 1 -- 172.21.15.2:0/87352904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb150107670 msgr2=0x7fb150198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:24.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb14ffff640 1 --2- 172.21.15.2:0/87352904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb150107670 0x7fb150198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:24.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb14ffff640 1 -- 172.21.15.2:0/87352904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150107ff0 msgr2=0x7fb15019e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:24.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb14ffff640 1 --2- 172.21.15.2:0/87352904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150107ff0 0x7fb15019e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:24.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb14ffff640 1 -- 172.21.15.2:0/87352904 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15019e9b0 con 0x7fb150101c60 2024-09-21T13:39:24.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.204+0000 7fb154934640 1 --2- 172.21.15.2:0/87352904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150107ff0 0x7fb15019e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:24.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.205+0000 7fb14ffff640 1 --2- 172.21.15.2:0/87352904 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb150101c60 0x7fb150198900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb14000e9f0 tx=0x7fb14000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:24.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.205+0000 7fb14d7fa640 1 -- 172.21.15.2:0/87352904 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14000cd80 con 0x7fb150101c60 2024-09-21T13:39:24.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.205+0000 7fb14d7fa640 1 -- 172.21.15.2:0/87352904 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fb1400108b0 con 0x7fb150101c60 2024-09-21T13:39:24.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.205+0000 7fb14d7fa640 1 -- 172.21.15.2:0/87352904 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140018870 con 0x7fb150101c60 2024-09-21T13:39:24.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.205+0000 7fb156397640 1 -- 172.21.15.2:0/87352904 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15019eca0 con 0x7fb150101c60 2024-09-21T13:39:24.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.205+0000 7fb156397640 1 -- 172.21.15.2:0/87352904 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1501035d0 con 0x7fb150101c60 2024-09-21T13:39:24.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.206+0000 7fb156397640 1 -- 172.21.15.2:0/87352904 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb150063860 con 0x7fb150101c60 2024-09-21T13:39:24.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.207+0000 7fb14d7fa640 1 -- 172.21.15.2:0/87352904 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 17) ==== 103262+0+0 (secure 0 0 0) 0x7fb140010430 con 0x7fb150101c60 2024-09-21T13:39:24.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.207+0000 7fb14d7fa640 1 --2- 172.21.15.2:0/87352904 >> v2:172.21.15.2:6800/3897423974 conn(0x7fb13807b100 0x7fb13807d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:24.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.207+0000 7fb14f7fe640 1 -- 172.21.15.2:0/87352904 >> v2:172.21.15.2:6800/3897423974 conn(0x7fb13807b100 msgr2=0x7fb13807d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3897423974 2024-09-21T13:39:24.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.207+0000 7fb14d7fa640 1 -- 172.21.15.2:0/87352904 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7fb14009e570 con 0x7fb150101c60 2024-09-21T13:39:24.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.207+0000 7fb14f7fe640 1 --2- 172.21.15.2:0/87352904 >> v2:172.21.15.2:6800/3897423974 conn(0x7fb13807b100 0x7fb13807d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:39:24.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.207+0000 7fb14d7fa640 1 --2- 172.21.15.2:0/87352904 >> v2:172.21.15.162:6808/1212984287 conn(0x7fb138084750 0x7fb138086bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:24.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.207+0000 7fb14d7fa640 1 -- 172.21.15.2:0/87352904 --> v2:172.21.15.162:6808/1212984287 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb14001ee50 con 0x7fb138084750 2024-09-21T13:39:24.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.207+0000 7fb14d7fa640 1 -- 172.21.15.2:0/87352904 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fb1400a5050 con 0x7fb150101c60 2024-09-21T13:39:24.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.207+0000 7fb154934640 1 --2- 172.21.15.2:0/87352904 >> v2:172.21.15.162:6808/1212984287 conn(0x7fb138084750 0x7fb138086bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:24.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.208+0000 7fb154934640 1 --2- 172.21.15.2:0/87352904 >> v2:172.21.15.162:6808/1212984287 conn(0x7fb138084750 0x7fb138086bb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:24.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.209+0000 7fb14d7fa640 1 -- 172.21.15.2:0/87352904 <== osd.6 v2:172.21.15.162:6808/1212984287 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb14001ee50 con 0x7fb138084750 2024-09-21T13:39:24.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.222+0000 7fb156397640 1 -- 172.21.15.2:0/87352904 --> v2:172.21.15.162:6808/1212984287 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb150063c60 con 0x7fb138084750 2024-09-21T13:39:24.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb14d7fa640 1 -- 172.21.15.2:0/87352904 <== osd.6 v2:172.21.15.162:6808/1212984287 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb150063c60 con 0x7fb138084750 2024-09-21T13:39:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb156397640 1 -- 172.21.15.2:0/87352904 >> v2:172.21.15.162:6808/1212984287 conn(0x7fb138084750 msgr2=0x7fb138086bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb156397640 1 --2- 172.21.15.2:0/87352904 >> v2:172.21.15.162:6808/1212984287 conn(0x7fb138084750 0x7fb138086bb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb156397640 1 -- 172.21.15.2:0/87352904 >> v2:172.21.15.2:6800/3897423974 conn(0x7fb13807b100 msgr2=0x7fb13807d5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:39:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb156397640 1 --2- 172.21.15.2:0/87352904 >> v2:172.21.15.2:6800/3897423974 conn(0x7fb13807b100 0x7fb13807d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb156397640 1 -- 172.21.15.2:0/87352904 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb150101c60 msgr2=0x7fb150198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb156397640 1 --2- 172.21.15.2:0/87352904 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb150101c60 0x7fb150198900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb14000e9f0 tx=0x7fb14000eeb0 comp rx=0 tx=0).stop 2024-09-21T13:39:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb154934640 1 -- 172.21.15.2:0/87352904 reap_dead start 2024-09-21T13:39:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb156397640 1 -- 172.21.15.2:0/87352904 shutdown_connections 2024-09-21T13:39:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb156397640 1 -- 172.21.15.2:0/87352904 >> 172.21.15.2:0/87352904 conn(0x7fb1500fd6d0 msgr2=0x7fb1500ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb156397640 1 -- 172.21.15.2:0/87352904 shutdown_connections 2024-09-21T13:39:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:24.223+0000 7fb156397640 1 -- 172.21.15.2:0/87352904 wait complete. 2024-09-21T13:39:25.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.652+0000 7f19ad407640 1 -- 172.21.15.2:0/124284515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a8101c80 msgr2=0x7f19a8102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:25.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.652+0000 7f19ad407640 1 --2- 172.21.15.2:0/124284515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a8101c80 0x7f19a8102060 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1998009860 tx=0x7f199802a340 comp rx=0 tx=0).stop 2024-09-21T13:39:25.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.652+0000 7f19ad407640 1 -- 172.21.15.2:0/124284515 shutdown_connections 2024-09-21T13:39:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.652+0000 7f19ad407640 1 --2- 172.21.15.2:0/124284515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19a8108010 0x7f19a810e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.652+0000 7f19ad407640 1 --2- 172.21.15.2:0/124284515 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f19a8107690 0x7f19a8107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.652+0000 7f19ad407640 1 --2- 172.21.15.2:0/124284515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a8101c80 0x7f19a8102060 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.652+0000 7f19ad407640 1 -- 172.21.15.2:0/124284515 >> 172.21.15.2:0/124284515 conn(0x7f19a80fd6f0 msgr2=0x7f19a80ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.652+0000 7f19ad407640 1 -- 172.21.15.2:0/124284515 shutdown_connections 2024-09-21T13:39:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.652+0000 7f19ad407640 1 -- 172.21.15.2:0/124284515 wait complete. 2024-09-21T13:39:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f19ad407640 1 Processor -- start 2024-09-21T13:39:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f19ad407640 1 -- start start 2024-09-21T13:39:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f19ad407640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f19a8101c80 0x7f19a80fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f19ad407640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a8107690 0x7f19a80fe130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f19ad407640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19a8108010 0x7f19a80fe670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f19ad407640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81113a0 con 0x7f19a8107690 2024-09-21T13:39:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f19ad407640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19a8111220 con 0x7f19a8108010 2024-09-21T13:39:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f19ad407640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f19a8111520 con 0x7f19a8101c80 2024-09-21T13:39:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f199e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a8107690 0x7f19a80fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f19a6ffd640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f19a8101c80 0x7f19a80fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f199e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a8107690 0x7f19a80fe130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51094/0 (socket says 172.21.15.2:51094) 2024-09-21T13:39:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f199e7fc640 1 -- 172.21.15.2:0/906139173 learned_addr learned my addr 172.21.15.2:0/906139173 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.653+0000 7f19a77fe640 1 --2- 172.21.15.2:0/906139173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19a8108010 0x7f19a80fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f19a6ffd640 1 -- 172.21.15.2:0/906139173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19a8108010 msgr2=0x7f19a80fe670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f19a6ffd640 1 --2- 172.21.15.2:0/906139173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19a8108010 0x7f19a80fe670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f19a6ffd640 1 -- 172.21.15.2:0/906139173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a8107690 msgr2=0x7f19a80fe130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f19a6ffd640 1 --2- 172.21.15.2:0/906139173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a8107690 0x7f19a80fe130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f19a6ffd640 1 -- 172.21.15.2:0/906139173 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a81a6da0 con 0x7f19a8101c80 2024-09-21T13:39:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f199e7fc640 1 --2- 172.21.15.2:0/906139173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a8107690 0x7f19a80fe130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f19a6ffd640 1 --2- 172.21.15.2:0/906139173 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f19a8101c80 0x7f19a80fdbf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1998035040 tx=0x7f1998033b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f19a4ff9640 1 -- 172.21.15.2:0/906139173 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199803f020 con 0x7f19a8101c80 2024-09-21T13:39:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f19a4ff9640 1 -- 172.21.15.2:0/906139173 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f1998004040 con 0x7f19a8101c80 2024-09-21T13:39:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f19ad407640 1 -- 172.21.15.2:0/906139173 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a81a7030 con 0x7f19a8101c80 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f19a4ff9640 1 -- 172.21.15.2:0/906139173 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998037040 con 0x7f19a8101c80 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.654+0000 7f19ad407640 1 -- 172.21.15.2:0/906139173 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a81a7510 con 0x7f19a8101c80 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.655+0000 7f19ad407640 1 -- 172.21.15.2:0/906139173 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19a8104ee0 con 0x7f19a8101c80 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.656+0000 7f19a4ff9640 1 -- 172.21.15.2:0/906139173 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 17) ==== 103262+0+0 (secure 0 0 0) 0x7f1998042020 con 0x7f19a8101c80 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.656+0000 7f19a4ff9640 1 --2- 172.21.15.2:0/906139173 >> v2:172.21.15.2:6800/3897423974 conn(0x7f199407b100 0x7f199407d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.656+0000 7f199e7fc640 1 -- 172.21.15.2:0/906139173 >> v2:172.21.15.2:6800/3897423974 conn(0x7f199407b100 msgr2=0x7f199407d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3897423974 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.657+0000 7f19a4ff9640 1 -- 172.21.15.2:0/906139173 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7f19980be520 con 0x7f19a8101c80 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.657+0000 7f199e7fc640 1 --2- 172.21.15.2:0/906139173 >> v2:172.21.15.2:6800/3897423974 conn(0x7f199407b100 0x7f199407d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.657+0000 7f19a4ff9640 1 --2- 172.21.15.2:0/906139173 >> v2:172.21.15.162:6812/4048001305 conn(0x7f19940846d0 0x7f1994086b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.657+0000 7f19a4ff9640 1 -- 172.21.15.2:0/906139173 --> v2:172.21.15.162:6812/4048001305 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1998043e70 con 0x7f19940846d0 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.657+0000 7f19a4ff9640 1 -- 172.21.15.2:0/906139173 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f19980bea00 con 0x7f19a8101c80 2024-09-21T13:39:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.657+0000 7f19a77fe640 1 --2- 172.21.15.2:0/906139173 >> v2:172.21.15.162:6812/4048001305 conn(0x7f19940846d0 0x7f1994086b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.657+0000 7f19a77fe640 1 --2- 172.21.15.2:0/906139173 >> v2:172.21.15.162:6812/4048001305 conn(0x7f19940846d0 0x7f1994086b30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.658+0000 7f19a4ff9640 1 -- 172.21.15.2:0/906139173 <== osd.7 v2:172.21.15.162:6812/4048001305 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1998043e70 con 0x7f19940846d0 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.672+0000 7f19ad407640 1 -- 172.21.15.2:0/906139173 --> v2:172.21.15.162:6812/4048001305 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f19a8102f30 con 0x7f19940846d0 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.672+0000 7f19a4ff9640 1 -- 172.21.15.2:0/906139173 <== osd.7 v2:172.21.15.162:6812/4048001305 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f19a8102f30 con 0x7f19940846d0 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.672+0000 7f19ad407640 1 -- 172.21.15.2:0/906139173 >> v2:172.21.15.162:6812/4048001305 conn(0x7f19940846d0 msgr2=0x7f1994086b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.672+0000 7f19ad407640 1 --2- 172.21.15.2:0/906139173 >> v2:172.21.15.162:6812/4048001305 conn(0x7f19940846d0 0x7f1994086b30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.673+0000 7f19ad407640 1 -- 172.21.15.2:0/906139173 >> v2:172.21.15.2:6800/3897423974 conn(0x7f199407b100 msgr2=0x7f199407d5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.673+0000 7f19ad407640 1 --2- 172.21.15.2:0/906139173 >> v2:172.21.15.2:6800/3897423974 conn(0x7f199407b100 0x7f199407d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.673+0000 7f19ad407640 1 -- 172.21.15.2:0/906139173 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f19a8101c80 msgr2=0x7f19a80fdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.673+0000 7f19ad407640 1 --2- 172.21.15.2:0/906139173 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f19a8101c80 0x7f19a80fdbf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1998035040 tx=0x7f1998033b00 comp rx=0 tx=0).stop 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.673+0000 7f19a77fe640 1 -- 172.21.15.2:0/906139173 reap_dead start 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.673+0000 7f19ad407640 1 -- 172.21.15.2:0/906139173 shutdown_connections 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.673+0000 7f19ad407640 1 -- 172.21.15.2:0/906139173 >> 172.21.15.2:0/906139173 conn(0x7f19a80fd6f0 msgr2=0x7f19a806b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.673+0000 7f19ad407640 1 -- 172.21.15.2:0/906139173 shutdown_connections 2024-09-21T13:39:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:25.673+0000 7f19ad407640 1 -- 172.21.15.2:0/906139173 wait complete. 2024-09-21T13:39:26.563 INFO:teuthology.orchestra.run.smithi002.stdout:77309411366 2024-09-21T13:39:26.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T13:39:26.970 INFO:teuthology.orchestra.run.smithi002.stdout:210453397514 2024-09-21T13:39:26.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-mon[33046]: Standby manager daemon x restarted 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-mon[33046]: Standby manager daemon x started 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-mon[33046]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-mon[33046]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-mon[33046]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-mon[33046]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x[34695]: [21/Sep/2024:13:39:26] ENGINE Bus STARTING 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x[34695]: CherryPy Checker: 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x[34695]: The Application mounted at '' has an empty config. 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x[34695]: 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x[34695]: [21/Sep/2024:13:39:26] ENGINE Serving on http://:::9283 2024-09-21T13:39:26.983 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:39:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x[34695]: [21/Sep/2024:13:39:26] ENGINE Bus STARTED 2024-09-21T13:39:27.077 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[40622]: Standby manager daemon x restarted 2024-09-21T13:39:27.077 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[40622]: Standby manager daemon x started 2024-09-21T13:39:27.077 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[40622]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T13:39:27.077 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[40622]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T13:39:27.077 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[40622]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T13:39:27.077 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[40622]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T13:39:27.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[30076]: Standby manager daemon x restarted 2024-09-21T13:39:27.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[30076]: Standby manager daemon x started 2024-09-21T13:39:27.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[30076]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-21T13:39:27.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[30076]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T13:39:27.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[30076]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-21T13:39:27.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:26 smithi002 ceph-mon[30076]: from='mgr.? 172.21.15.162:0/2221530223' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T13:39:27.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.169+0000 7f50dbb47640 1 -- 172.21.15.2:0/2838545512 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50d4101600 msgr2=0x7f50d41019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:27.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.169+0000 7f50dbb47640 1 --2- 172.21.15.2:0/2838545512 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50d4101600 0x7f50d41019e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009900 tx=0x7f50d002a410 comp rx=0 tx=0).stop 2024-09-21T13:39:27.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.169+0000 7f50dbb47640 1 -- 172.21.15.2:0/2838545512 shutdown_connections 2024-09-21T13:39:27.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.169+0000 7f50dbb47640 1 --2- 172.21.15.2:0/2838545512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d410f2b0 0x7f50d4111720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.169+0000 7f50dbb47640 1 --2- 172.21.15.2:0/2838545512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50d4102000 0x7f50d410ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.169+0000 7f50dbb47640 1 --2- 172.21.15.2:0/2838545512 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50d4101600 0x7f50d41019e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.169+0000 7f50dbb47640 1 -- 172.21.15.2:0/2838545512 >> 172.21.15.2:0/2838545512 conn(0x7f50d4076ea0 msgr2=0x7f50d40772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:27.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.169+0000 7f50dbb47640 1 -- 172.21.15.2:0/2838545512 shutdown_connections 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.169+0000 7f50dbb47640 1 -- 172.21.15.2:0/2838545512 wait complete. 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.170+0000 7f50dbb47640 1 Processor -- start 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.170+0000 7f50dbb47640 1 -- start start 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.170+0000 7f50dbb47640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50d4101600 0x7f50d419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.170+0000 7f50dbb47640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50d4102000 0x7f50d419b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.170+0000 7f50dbb47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d410f2b0 0x7f50d41a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.170+0000 7f50dbb47640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4114690 con 0x7f50d410f2b0 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.170+0000 7f50dbb47640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4114510 con 0x7f50d4102000 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.170+0000 7f50dbb47640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f50d4114810 con 0x7f50d4101600 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50d98e3640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50d4101600 0x7f50d419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50d98e3640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50d4101600 0x7f50d419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:37680/0 (socket says 172.21.15.2:37680) 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50d98e3640 1 -- 172.21.15.2:0/2442986563 learned_addr learned my addr 172.21.15.2:0/2442986563 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:27.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50da0e4640 1 --2- 172.21.15.2:0/2442986563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d410f2b0 0x7f50d41a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50d90e2640 1 --2- 172.21.15.2:0/2442986563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50d4102000 0x7f50d419b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50d98e3640 1 -- 172.21.15.2:0/2442986563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50d4102000 msgr2=0x7f50d419b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50d98e3640 1 --2- 172.21.15.2:0/2442986563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50d4102000 0x7f50d419b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50d98e3640 1 -- 172.21.15.2:0/2442986563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d410f2b0 msgr2=0x7f50d41a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50d98e3640 1 --2- 172.21.15.2:0/2442986563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d410f2b0 0x7f50d41a0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50d98e3640 1 -- 172.21.15.2:0/2442986563 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d41a0c60 con 0x7f50d4101600 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50da0e4640 1 --2- 172.21.15.2:0/2442986563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d410f2b0 0x7f50d41a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.171+0000 7f50d98e3640 1 --2- 172.21.15.2:0/2442986563 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50d4101600 0x7f50d419abb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f50d0005ab0 tx=0x7f50d0005080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.172+0000 7f50caffd640 1 -- 172.21.15.2:0/2442986563 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d003f070 con 0x7f50d4101600 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.172+0000 7f50caffd640 1 -- 172.21.15.2:0/2442986563 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f50d0003a70 con 0x7f50d4101600 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.172+0000 7f50caffd640 1 -- 172.21.15.2:0/2442986563 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0035030 con 0x7f50d4101600 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.172+0000 7f50dbb47640 1 -- 172.21.15.2:0/2442986563 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d41a0ef0 con 0x7f50d4101600 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.172+0000 7f50dbb47640 1 -- 172.21.15.2:0/2442986563 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d41a7610 con 0x7f50d4101600 2024-09-21T13:39:27.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.173+0000 7f50dbb47640 1 -- 172.21.15.2:0/2442986563 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50d4063860 con 0x7f50d4101600 2024-09-21T13:39:27.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.174+0000 7f50caffd640 1 -- 172.21.15.2:0/2442986563 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 18) ==== 103262+0+0 (secure 0 0 0) 0x7f50d0042070 con 0x7f50d4101600 2024-09-21T13:39:27.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.174+0000 7f50caffd640 1 --2- 172.21.15.2:0/2442986563 >> v2:172.21.15.2:6800/3897423974 conn(0x7f50c007b100 0x7f50c007d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:27.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.174+0000 7f50d90e2640 1 -- 172.21.15.2:0/2442986563 >> v2:172.21.15.2:6800/3897423974 conn(0x7f50c007b100 msgr2=0x7f50c007d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3897423974 2024-09-21T13:39:27.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.175+0000 7f50caffd640 1 -- 172.21.15.2:0/2442986563 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5942+0+0 (secure 0 0 0) 0x7f50d00bed30 con 0x7f50d4101600 2024-09-21T13:39:27.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.175+0000 7f50d90e2640 1 --2- 172.21.15.2:0/2442986563 >> v2:172.21.15.2:6800/3897423974 conn(0x7f50c007b100 0x7f50c007d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T13:39:27.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.175+0000 7f50caffd640 1 --2- 172.21.15.2:0/2442986563 >> v2:172.21.15.2:6813/2270199396 conn(0x7f50c0084750 0x7f50c0086bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:27.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.175+0000 7f50caffd640 1 -- 172.21.15.2:0/2442986563 --> v2:172.21.15.2:6813/2270199396 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50d00047a0 con 0x7f50c0084750 2024-09-21T13:39:27.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.175+0000 7f50caffd640 1 -- 172.21.15.2:0/2442986563 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f50d00bf210 con 0x7f50d4101600 2024-09-21T13:39:27.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.175+0000 7f50da0e4640 1 --2- 172.21.15.2:0/2442986563 >> v2:172.21.15.2:6813/2270199396 conn(0x7f50c0084750 0x7f50c0086bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:27.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.175+0000 7f50da0e4640 1 --2- 172.21.15.2:0/2442986563 >> v2:172.21.15.2:6813/2270199396 conn(0x7f50c0084750 0x7f50c0086bb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:27.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.176+0000 7f50caffd640 1 -- 172.21.15.2:0/2442986563 <== osd.3 v2:172.21.15.2:6813/2270199396 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f50d00047a0 con 0x7f50c0084750 2024-09-21T13:39:27.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.195+0000 7f50dbb47640 1 -- 172.21.15.2:0/2442986563 --> v2:172.21.15.2:6813/2270199396 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f50d4063cb0 con 0x7f50c0084750 2024-09-21T13:39:27.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.195+0000 7f50caffd640 1 -- 172.21.15.2:0/2442986563 <== osd.3 v2:172.21.15.2:6813/2270199396 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f50d4063cb0 con 0x7f50c0084750 2024-09-21T13:39:27.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.195+0000 7f50dbb47640 1 -- 172.21.15.2:0/2442986563 >> v2:172.21.15.2:6813/2270199396 conn(0x7f50c0084750 msgr2=0x7f50c0086bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:27.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.195+0000 7f50dbb47640 1 --2- 172.21.15.2:0/2442986563 >> v2:172.21.15.2:6813/2270199396 conn(0x7f50c0084750 0x7f50c0086bb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.196+0000 7f50dbb47640 1 -- 172.21.15.2:0/2442986563 >> v2:172.21.15.2:6800/3897423974 conn(0x7f50c007b100 msgr2=0x7f50c007d5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:39:27.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.196+0000 7f50dbb47640 1 --2- 172.21.15.2:0/2442986563 >> v2:172.21.15.2:6800/3897423974 conn(0x7f50c007b100 0x7f50c007d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.196+0000 7f50dbb47640 1 -- 172.21.15.2:0/2442986563 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50d4101600 msgr2=0x7f50d419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.196+0000 7f50dbb47640 1 --2- 172.21.15.2:0/2442986563 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f50d4101600 0x7f50d419abb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f50d0005ab0 tx=0x7f50d0005080 comp rx=0 tx=0).stop 2024-09-21T13:39:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.196+0000 7f50da0e4640 1 -- 172.21.15.2:0/2442986563 reap_dead start 2024-09-21T13:39:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.196+0000 7f50dbb47640 1 -- 172.21.15.2:0/2442986563 shutdown_connections 2024-09-21T13:39:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.196+0000 7f50dbb47640 1 -- 172.21.15.2:0/2442986563 >> 172.21.15.2:0/2442986563 conn(0x7f50d4076ea0 msgr2=0x7f50d410f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.196+0000 7f50dbb47640 1 -- 172.21.15.2:0/2442986563 shutdown_connections 2024-09-21T13:39:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.196+0000 7f50dbb47640 1 -- 172.21.15.2:0/2442986563 wait complete. 2024-09-21T13:39:27.589 INFO:teuthology.orchestra.run.smithi002.stdout:55834574891 2024-09-21T13:39:27.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T13:39:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.783+0000 7febb7b46640 1 -- 172.21.15.2:0/3658900189 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7febb0107ff0 msgr2=0x7febb010e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.783+0000 7febb7b46640 1 --2- 172.21.15.2:0/3658900189 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7febb0107ff0 0x7febb010e7f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feba8009ca0 tx=0x7feba802a8c0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.783+0000 7febb7b46640 1 -- 172.21.15.2:0/3658900189 shutdown_connections 2024-09-21T13:39:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.783+0000 7febb7b46640 1 --2- 172.21.15.2:0/3658900189 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7febb0107ff0 0x7febb010e7f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.783+0000 7febb7b46640 1 --2- 172.21.15.2:0/3658900189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb0107670 0x7febb0107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.783+0000 7febb7b46640 1 --2- 172.21.15.2:0/3658900189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb0101c60 0x7febb0102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.783+0000 7febb7b46640 1 -- 172.21.15.2:0/3658900189 >> 172.21.15.2:0/3658900189 conn(0x7febb00fd710 msgr2=0x7febb00ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.783+0000 7febb7b46640 1 -- 172.21.15.2:0/3658900189 shutdown_connections 2024-09-21T13:39:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.783+0000 7febb7b46640 1 -- 172.21.15.2:0/3658900189 wait complete. 2024-09-21T13:39:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.784+0000 7febb7b46640 1 Processor -- start 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.784+0000 7febb7b46640 1 -- start start 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb7b46640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb0101c60 0x7febb019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb7b46640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb0107670 0x7febb019b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb7b46640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7febb0107ff0 0x7febb01a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb7b46640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febb01102d0 con 0x7febb0107670 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb7b46640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febb0110150 con 0x7febb0101c60 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb7b46640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7febb0110450 con 0x7febb0107ff0 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb50e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb0107670 0x7febb019b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb50e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb0107670 0x7febb019b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47162/0 (socket says 172.21.15.2:47162) 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb50e1640 1 -- 172.21.15.2:0/309174073 learned_addr learned my addr 172.21.15.2:0/309174073 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb60e3640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7febb0107ff0 0x7febb01a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb58e2640 1 --2- 172.21.15.2:0/309174073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb0101c60 0x7febb019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb60e3640 1 -- 172.21.15.2:0/309174073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb0101c60 msgr2=0x7febb019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb60e3640 1 --2- 172.21.15.2:0/309174073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb0101c60 0x7febb019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb60e3640 1 -- 172.21.15.2:0/309174073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb0107670 msgr2=0x7febb019b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb60e3640 1 --2- 172.21.15.2:0/309174073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb0107670 0x7febb019b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.785+0000 7febb60e3640 1 -- 172.21.15.2:0/309174073 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb01a0b80 con 0x7febb0107ff0 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.786+0000 7febb60e3640 1 --2- 172.21.15.2:0/309174073 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7febb0107ff0 0x7febb01a03b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feba8033040 tx=0x7feba80093d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.786+0000 7feba6ffd640 1 -- 172.21.15.2:0/309174073 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8003db0 con 0x7febb0107ff0 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.786+0000 7febb7b46640 1 -- 172.21.15.2:0/309174073 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb01a0e10 con 0x7febb0107ff0 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.786+0000 7feba6ffd640 1 -- 172.21.15.2:0/309174073 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7feba80044c0 con 0x7febb0107ff0 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.786+0000 7feba6ffd640 1 -- 172.21.15.2:0/309174073 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8030b80 con 0x7febb0107ff0 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.786+0000 7febb7b46640 1 -- 172.21.15.2:0/309174073 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7febb01963d0 con 0x7febb0107ff0 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.787+0000 7febb7b46640 1 -- 172.21.15.2:0/309174073 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7febb00ff940 con 0x7febb0107ff0 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.788+0000 7feba6ffd640 1 -- 172.21.15.2:0/309174073 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 19) ==== 102915+0+0 (secure 0 0 0) 0x7feba8030d20 con 0x7febb0107ff0 2024-09-21T13:39:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.788+0000 7feba6ffd640 1 -- 172.21.15.2:0/309174073 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7feba80bee50 con 0x7febb0107ff0 2024-09-21T13:39:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.789+0000 7feba6ffd640 1 --2- 172.21.15.2:0/309174073 >> v2:172.21.15.2:6801/1847462361 conn(0x7feb9c081a70 0x7feb9c083eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.789+0000 7feba6ffd640 1 -- 172.21.15.2:0/309174073 --> v2:172.21.15.2:6801/1847462361 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feba8032e00 con 0x7feb9c081a70 2024-09-21T13:39:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.789+0000 7feba6ffd640 1 -- 172.21.15.2:0/309174073 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7feba80c4570 con 0x7febb0107ff0 2024-09-21T13:39:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.789+0000 7febb58e2640 1 --2- 172.21.15.2:0/309174073 >> v2:172.21.15.2:6801/1847462361 conn(0x7feb9c081a70 0x7feb9c083eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.790+0000 7febb58e2640 1 --2- 172.21.15.2:0/309174073 >> v2:172.21.15.2:6801/1847462361 conn(0x7feb9c081a70 0x7feb9c083eb0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.791+0000 7feba6ffd640 1 -- 172.21.15.2:0/309174073 <== osd.0 v2:172.21.15.2:6801/1847462361 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feba8032e00 con 0x7feb9c081a70 2024-09-21T13:39:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.805+0000 7febb7b46640 1 -- 172.21.15.2:0/309174073 --> v2:172.21.15.2:6801/1847462361 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7febb0102f10 con 0x7feb9c081a70 2024-09-21T13:39:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.805+0000 7feba6ffd640 1 -- 172.21.15.2:0/309174073 <== osd.0 v2:172.21.15.2:6801/1847462361 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7febb0102f10 con 0x7feb9c081a70 2024-09-21T13:39:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 -- 172.21.15.2:0/309174073 >> v2:172.21.15.2:6801/1847462361 conn(0x7feb9c081a70 msgr2=0x7feb9c083eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 --2- 172.21.15.2:0/309174073 >> v2:172.21.15.2:6801/1847462361 conn(0x7feb9c081a70 0x7feb9c083eb0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 -- 172.21.15.2:0/309174073 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7febb0107ff0 msgr2=0x7febb01a03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 --2- 172.21.15.2:0/309174073 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7febb0107ff0 0x7febb01a03b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feba8033040 tx=0x7feba80093d0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 -- 172.21.15.2:0/309174073 shutdown_connections 2024-09-21T13:39:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 --2- 172.21.15.2:0/309174073 >> v2:172.21.15.2:6801/1847462361 conn(0x7feb9c081a70 0x7feb9c083eb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 --2- 172.21.15.2:0/309174073 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7febb0107ff0 0x7febb01a03b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 --2- 172.21.15.2:0/309174073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb0107670 0x7febb019b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 --2- 172.21.15.2:0/309174073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb0101c60 0x7febb019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 -- 172.21.15.2:0/309174073 >> 172.21.15.2:0/309174073 conn(0x7febb00fd710 msgr2=0x7febb00fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 -- 172.21.15.2:0/309174073 shutdown_connections 2024-09-21T13:39:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:27.806+0000 7febb7b46640 1 -- 172.21.15.2:0/309174073 wait complete. 2024-09-21T13:39:27.818 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: mgrmap e18: y(active, since 5m), standbys: x 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: Active manager daemon y restarted 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: Activating manager daemon y 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: osdmap e63: 8 total, 8 up, 8 in 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: mgrmap e19: y(active, starting, since 0.00858425s), standbys: x 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:39:27.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[30076]: Manager daemon y is now available 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: mgrmap e18: y(active, since 5m), standbys: x 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: Active manager daemon y restarted 2024-09-21T13:39:27.820 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: Activating manager daemon y 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: osdmap e63: 8 total, 8 up, 8 in 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: mgrmap e19: y(active, starting, since 0.00858425s), standbys: x 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:39:27.821 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:39:27.822 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:39:27.822 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T13:39:27.822 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T13:39:27.822 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T13:39:27.822 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:27 smithi002 ceph-mon[40622]: Manager daemon y is now available 2024-09-21T13:39:28.089 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: mgrmap e18: y(active, since 5m), standbys: x 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: Active manager daemon y restarted 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: Activating manager daemon y 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: osdmap e63: 8 total, 8 up, 8 in 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: mgrmap e19: y(active, starting, since 0.00858425s), standbys: x 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T13:39:28.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T13:39:28.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T13:39:28.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T13:39:28.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T13:39:28.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T13:39:28.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T13:39:28.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T13:39:28.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T13:39:28.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T13:39:28.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:27 smithi162 ceph-mon[33046]: Manager daemon y is now available 2024-09-21T13:39:28.512 INFO:teuthology.orchestra.run.smithi002.stdout:34359738419 2024-09-21T13:39:28.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T13:39:28.747 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:39:28] ENGINE Bus STARTING 2024-09-21T13:39:28.747 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: CherryPy Checker: 2024-09-21T13:39:28.747 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: The Application mounted at '' has an empty config. 2024-09-21T13:39:28.747 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: 2024-09-21T13:39:28.747 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:39:28] ENGINE Serving on http://:::9283 2024-09-21T13:39:28.747 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:39:28] ENGINE Bus STARTED 2024-09-21T13:39:28.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:39:29.023 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:39:29.023 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:29.023 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:39:29.023 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:39:29.023 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T13:39:29.023 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T13:39:29.023 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[40622]: mgrmap e20: y(active, since 1.01252s), standbys: x 2024-09-21T13:39:29.023 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:39:29.023 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[40622]: pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:39:29.023 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:29.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:39:29.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:29.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:39:29.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:39:29.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T13:39:29.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T13:39:29.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[30076]: mgrmap e20: y(active, since 1.01252s), standbys: x 2024-09-21T13:39:29.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:39:29.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[30076]: pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:39:29.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:28 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.021+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1667554509 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdb84103b60 msgr2=0x7fdb84103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.021+0000 7fdb8a8b0640 1 --2- 172.21.15.2:0/1667554509 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdb84103b60 0x7fdb84103f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009900 tx=0x7fdb7402a410 comp rx=0 tx=0).stop 2024-09-21T13:39:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.021+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1667554509 shutdown_connections 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.021+0000 7fdb8a8b0640 1 --2- 172.21.15.2:0/1667554509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8410d110 0x7fdb8410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.021+0000 7fdb8a8b0640 1 --2- 172.21.15.2:0/1667554509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84104560 0x7fdb8410cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.021+0000 7fdb8a8b0640 1 --2- 172.21.15.2:0/1667554509 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdb84103b60 0x7fdb84103f40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.021+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1667554509 >> 172.21.15.2:0/1667554509 conn(0x7fdb840fd6d0 msgr2=0x7fdb840ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.021+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1667554509 shutdown_connections 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.021+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1667554509 wait complete. 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb8a8b0640 1 Processor -- start 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb8a8b0640 1 -- start start 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb8a8b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84103b60 0x7fdb84198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb8a8b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb84104560 0x7fdb84198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb8a8b0640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdb8410d110 0x7fdb8419e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb8a8b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb84112440 con 0x7fdb84104560 2024-09-21T13:39:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb8a8b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841122c0 con 0x7fdb84103b60 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb8a8b0640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fdb841125c0 con 0x7fdb8410d110 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb84104560 0x7fdb84198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb88e4d640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdb8410d110 0x7fdb8419e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb84104560 0x7fdb84198f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47260/0 (socket says 172.21.15.2:47260) 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb88e4d640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdb8410d110 0x7fdb8419e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:37774/0 (socket says 172.21.15.2:37774) 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb7bfff640 1 -- 172.21.15.2:0/1158599196 learned_addr learned my addr 172.21.15.2:0/1158599196 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.022+0000 7fdb83fff640 1 --2- 172.21.15.2:0/1158599196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84103b60 0x7fdb84198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb88e4d640 1 -- 172.21.15.2:0/1158599196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84103b60 msgr2=0x7fdb84198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb88e4d640 1 --2- 172.21.15.2:0/1158599196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84103b60 0x7fdb84198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb88e4d640 1 -- 172.21.15.2:0/1158599196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb84104560 msgr2=0x7fdb84198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb88e4d640 1 --2- 172.21.15.2:0/1158599196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb84104560 0x7fdb84198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb88e4d640 1 -- 172.21.15.2:0/1158599196 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8419eab0 con 0x7fdb8410d110 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb7bfff640 1 --2- 172.21.15.2:0/1158599196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb84104560 0x7fdb84198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb88e4d640 1 --2- 172.21.15.2:0/1158599196 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdb8410d110 0x7fdb8419e2e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c005fd0 tx=0x7fdb7c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb81ffb640 1 -- 172.21.15.2:0/1158599196 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c003b70 con 0x7fdb8410d110 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb81ffb640 1 -- 172.21.15.2:0/1158599196 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fdb7c003d10 con 0x7fdb8410d110 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1158599196 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8419eda0 con 0x7fdb8410d110 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb81ffb640 1 -- 172.21.15.2:0/1158599196 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c010670 con 0x7fdb8410d110 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.023+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1158599196 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb841a5460 con 0x7fdb8410d110 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.024+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1158599196 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdb84063860 con 0x7fdb8410d110 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.025+0000 7fdb81ffb640 1 -- 172.21.15.2:0/1158599196 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 20) ==== 103007+0+0 (secure 0 0 0) 0x7fdb7c004020 con 0x7fdb8410d110 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.025+0000 7fdb81ffb640 1 --2- 172.21.15.2:0/1158599196 >> v2:172.21.15.2:6800/2394073254 conn(0x7fdb7007ae10 0x7fdb7007d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.025+0000 7fdb81ffb640 1 -- 172.21.15.2:0/1158599196 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7fdb7c09e350 con 0x7fdb8410d110 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.026+0000 7fdb83fff640 1 --2- 172.21.15.2:0/1158599196 >> v2:172.21.15.2:6800/2394073254 conn(0x7fdb7007ae10 0x7fdb7007d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.026+0000 7fdb81ffb640 1 --2- 172.21.15.2:0/1158599196 >> v2:172.21.15.162:6804/309339656 conn(0x7fdb70084630 0x7fdb70086a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.026+0000 7fdb81ffb640 1 -- 172.21.15.2:0/1158599196 --> v2:172.21.15.162:6804/309339656 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb70087100 con 0x7fdb70084630 2024-09-21T13:39:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.026+0000 7fdb81ffb640 1 -- 172.21.15.2:0/1158599196 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fdb7c0a5050 con 0x7fdb8410d110 2024-09-21T13:39:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.026+0000 7fdb7bfff640 1 --2- 172.21.15.2:0/1158599196 >> v2:172.21.15.162:6804/309339656 conn(0x7fdb70084630 0x7fdb70086a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.026+0000 7fdb83fff640 1 --2- 172.21.15.2:0/1158599196 >> v2:172.21.15.2:6800/2394073254 conn(0x7fdb7007ae10 0x7fdb7007d2d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdb74031440 tx=0x7fdb74005b50 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.026+0000 7fdb7bfff640 1 --2- 172.21.15.2:0/1158599196 >> v2:172.21.15.162:6804/309339656 conn(0x7fdb70084630 0x7fdb70086a70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.027+0000 7fdb81ffb640 1 -- 172.21.15.2:0/1158599196 <== osd.5 v2:172.21.15.162:6804/309339656 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb70087100 con 0x7fdb70084630 2024-09-21T13:39:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.050+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1158599196 --> v2:172.21.15.162:6804/309339656 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdb84063c60 con 0x7fdb70084630 2024-09-21T13:39:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb81ffb640 1 -- 172.21.15.2:0/1158599196 <== osd.5 v2:172.21.15.162:6804/309339656 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdb84063c60 con 0x7fdb70084630 2024-09-21T13:39:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1158599196 >> v2:172.21.15.162:6804/309339656 conn(0x7fdb70084630 msgr2=0x7fdb70086a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb8a8b0640 1 --2- 172.21.15.2:0/1158599196 >> v2:172.21.15.162:6804/309339656 conn(0x7fdb70084630 0x7fdb70086a70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1158599196 >> v2:172.21.15.2:6800/2394073254 conn(0x7fdb7007ae10 msgr2=0x7fdb7007d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb8a8b0640 1 --2- 172.21.15.2:0/1158599196 >> v2:172.21.15.2:6800/2394073254 conn(0x7fdb7007ae10 0x7fdb7007d2d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdb74031440 tx=0x7fdb74005b50 comp rx=0 tx=0).stop 2024-09-21T13:39:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1158599196 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdb8410d110 msgr2=0x7fdb8419e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb8a8b0640 1 --2- 172.21.15.2:0/1158599196 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdb8410d110 0x7fdb8419e2e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c005fd0 tx=0x7fdb7c00c6a0 comp rx=0 tx=0).stop 2024-09-21T13:39:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb88e4d640 1 -- 172.21.15.2:0/1158599196 reap_dead start 2024-09-21T13:39:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1158599196 shutdown_connections 2024-09-21T13:39:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1158599196 >> 172.21.15.2:0/1158599196 conn(0x7fdb840fd6d0 msgr2=0x7fdb84104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1158599196 shutdown_connections 2024-09-21T13:39:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:29.051+0000 7fdb8a8b0640 1 -- 172.21.15.2:0/1158599196 wait complete. 2024-09-21T13:39:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:39:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:39:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:39:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-21T13:39:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-21T13:39:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:28 smithi162 ceph-mon[33046]: mgrmap e20: y(active, since 1.01252s), standbys: x 2024-09-21T13:39:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:28 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:39:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:28 smithi162 ceph-mon[33046]: pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:39:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:28 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:29.632 INFO:teuthology.orchestra.run.smithi002.stdout:184683593743 2024-09-21T13:39:29.632 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T13:39:29.989 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:39:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:39:29.989 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: 2024-09-21T13:39:29.713+0000 7fbe4498a640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:13:39:29] ENGINE Error in HTTPServer.serve 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: Traceback (most recent call last): 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self._connections.run(self.expiration_interval) 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self._run(expiration_interval) 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: s = self.context.wrap_socket( 2024-09-21T13:39:29.990 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T13:39:29.991 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: return self.sslsocket_class._create( 2024-09-21T13:39:29.991 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T13:39:29.991 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self.do_handshake() 2024-09-21T13:39:29.991 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T13:39:29.991 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: self._sslobj.do_handshake() 2024-09-21T13:39:29.991 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T13:39:29.991 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: 2024-09-21T13:39:30.016 INFO:teuthology.orchestra.run.smithi002.stdout:158913789975 2024-09-21T13:39:30.016 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T13:39:30.584 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[40622]: [21/Sep/2024:13:39:29] ENGINE Bus STARTING 2024-09-21T13:39:30.584 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[40622]: [21/Sep/2024:13:39:29] ENGINE Serving on http://172.21.15.2:8765 2024-09-21T13:39:30.584 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[40622]: [21/Sep/2024:13:39:29] ENGINE Serving on https://172.21.15.2:7150 2024-09-21T13:39:30.584 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[40622]: [21/Sep/2024:13:39:29] ENGINE Bus STARTED 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[40622]: [21/Sep/2024:13:39:29] ENGINE Error in HTTPServer.serve 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: Traceback (most recent call last): 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: self._run(expiration_interval) 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: s = self.context.wrap_socket( 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T13:39:30.585 INFO:journalctl@ceph.mon.c.smithi002.stdout: return self.sslsocket_class._create( 2024-09-21T13:39:30.586 INFO:journalctl@ceph.mon.c.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T13:39:30.586 INFO:journalctl@ceph.mon.c.smithi002.stdout: self.do_handshake() 2024-09-21T13:39:30.586 INFO:journalctl@ceph.mon.c.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T13:39:30.586 INFO:journalctl@ceph.mon.c.smithi002.stdout: self._sslobj.do_handshake() 2024-09-21T13:39:30.586 INFO:journalctl@ceph.mon.c.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T13:39:30.586 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[40622]: mgrmap e21: y(active, since 2s), standbys: x 2024-09-21T13:39:30.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[30076]: [21/Sep/2024:13:39:29] ENGINE Bus STARTING 2024-09-21T13:39:30.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[30076]: [21/Sep/2024:13:39:29] ENGINE Serving on http://172.21.15.2:8765 2024-09-21T13:39:30.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[30076]: [21/Sep/2024:13:39:29] ENGINE Serving on https://172.21.15.2:7150 2024-09-21T13:39:30.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[30076]: [21/Sep/2024:13:39:29] ENGINE Bus STARTED 2024-09-21T13:39:30.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[30076]: [21/Sep/2024:13:39:29] ENGINE Error in HTTPServer.serve 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T13:39:30.587 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-21T13:39:30.588 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T13:39:30.588 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-21T13:39:30.588 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T13:39:30.588 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:30 smithi002 ceph-mon[30076]: mgrmap e21: y(active, since 2s), standbys: x 2024-09-21T13:39:30.611 INFO:teuthology.orchestra.run.smithi002.stdout:111669149729 2024-09-21T13:39:30.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T13:39:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:30 smithi162 ceph-mon[33046]: [21/Sep/2024:13:39:29] ENGINE Bus STARTING 2024-09-21T13:39:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:30 smithi162 ceph-mon[33046]: [21/Sep/2024:13:39:29] ENGINE Serving on http://172.21.15.2:8765 2024-09-21T13:39:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:30 smithi162 ceph-mon[33046]: [21/Sep/2024:13:39:29] ENGINE Serving on https://172.21.15.2:7150 2024-09-21T13:39:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:30 smithi162 ceph-mon[33046]: [21/Sep/2024:13:39:29] ENGINE Bus STARTED 2024-09-21T13:39:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:30 smithi162 ceph-mon[33046]: [21/Sep/2024:13:39:29] ENGINE Error in HTTPServer.serve 2024-09-21T13:39:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout: Traceback (most recent call last): 2024-09-21T13:39:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T13:39:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout: self._connections.run(self.expiration_interval) 2024-09-21T13:39:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T13:39:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout: self._run(expiration_interval) 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: s = self.context.wrap_socket( 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: return self.sslsocket_class._create( 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: self.do_handshake() 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: self._sslobj.do_handshake() 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T13:39:30.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:30 smithi162 ceph-mon[33046]: mgrmap e21: y(active, since 2s), standbys: x 2024-09-21T13:39:30.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.917+0000 7f633c2da640 1 -- 172.21.15.2:0/784370107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334101c60 msgr2=0x7f6334102040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.917+0000 7f633c2da640 1 --2- 172.21.15.2:0/784370107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334101c60 0x7f6334102040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6330009860 tx=0x7f633002a340 comp rx=0 tx=0).stop 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.917+0000 7f633c2da640 1 -- 172.21.15.2:0/784370107 shutdown_connections 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.917+0000 7f633c2da640 1 --2- 172.21.15.2:0/784370107 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6334107ff0 0x7f633410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.917+0000 7f633c2da640 1 --2- 172.21.15.2:0/784370107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6334107670 0x7f6334107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.917+0000 7f633c2da640 1 --2- 172.21.15.2:0/784370107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334101c60 0x7f6334102040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.917+0000 7f633c2da640 1 -- 172.21.15.2:0/784370107 >> 172.21.15.2:0/784370107 conn(0x7f63340fd6d0 msgr2=0x7f63340ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.917+0000 7f633c2da640 1 -- 172.21.15.2:0/784370107 shutdown_connections 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.917+0000 7f633c2da640 1 -- 172.21.15.2:0/784370107 wait complete. 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633c2da640 1 Processor -- start 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633c2da640 1 -- start start 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633c2da640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6334101c60 0x7f6334103520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633c2da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6334107670 0x7f6334103a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:30.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633c2da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334107ff0 0x7f6334103fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633c2da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63341113c0 con 0x7f6334107ff0 2024-09-21T13:39:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633c2da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6334111240 con 0x7f6334107670 2024-09-21T13:39:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633c2da640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f6334111540 con 0x7f6334101c60 2024-09-21T13:39:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633a076640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6334101c60 0x7f6334103520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633a877640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334107ff0 0x7f6334103fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633a076640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6334101c60 0x7f6334103520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:37756/0 (socket says 172.21.15.2:37756) 2024-09-21T13:39:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f633a076640 1 -- 172.21.15.2:0/4050703389 learned_addr learned my addr 172.21.15.2:0/4050703389 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.918+0000 7f6339875640 1 --2- 172.21.15.2:0/4050703389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6334107670 0x7f6334103a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f633a076640 1 -- 172.21.15.2:0/4050703389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6334107670 msgr2=0x7f6334103a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f633a076640 1 --2- 172.21.15.2:0/4050703389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6334107670 0x7f6334103a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f633a076640 1 -- 172.21.15.2:0/4050703389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334107ff0 msgr2=0x7f6334103fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f633a076640 1 --2- 172.21.15.2:0/4050703389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334107ff0 0x7f6334103fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f633a076640 1 -- 172.21.15.2:0/4050703389 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63341a6da0 con 0x7f6334101c60 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f633a877640 1 --2- 172.21.15.2:0/4050703389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334107ff0 0x7f6334103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f633a076640 1 --2- 172.21.15.2:0/4050703389 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6334101c60 0x7f6334103520 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6330035040 tx=0x7f6330033cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f632b7fe640 1 -- 172.21.15.2:0/4050703389 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330037040 con 0x7f6334101c60 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f633c2da640 1 -- 172.21.15.2:0/4050703389 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63341a7030 con 0x7f6334101c60 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f632b7fe640 1 -- 172.21.15.2:0/4050703389 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f6330040070 con 0x7f6334101c60 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f632b7fe640 1 -- 172.21.15.2:0/4050703389 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330003830 con 0x7f6334101c60 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.919+0000 7f633c2da640 1 -- 172.21.15.2:0/4050703389 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63341a7510 con 0x7f6334101c60 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.920+0000 7f633c2da640 1 -- 172.21.15.2:0/4050703389 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f633406b5f0 con 0x7f6334101c60 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.921+0000 7f632b7fe640 1 -- 172.21.15.2:0/4050703389 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 20) ==== 103007+0+0 (secure 0 0 0) 0x7f6330003a90 con 0x7f6334101c60 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.921+0000 7f632b7fe640 1 --2- 172.21.15.2:0/4050703389 >> v2:172.21.15.2:6800/2394073254 conn(0x7f632007ae10 0x7f632007d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.921+0000 7f6339875640 1 --2- 172.21.15.2:0/4050703389 >> v2:172.21.15.2:6800/2394073254 conn(0x7f632007ae10 0x7f632007d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.921+0000 7f632b7fe640 1 -- 172.21.15.2:0/4050703389 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7f63300be7f0 con 0x7f6334101c60 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.922+0000 7f632b7fe640 1 --2- 172.21.15.2:0/4050703389 >> v2:172.21.15.162:6800/2284803610 conn(0x7f6320084630 0x7f6320086a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.922+0000 7f632b7fe640 1 -- 172.21.15.2:0/4050703389 --> v2:172.21.15.162:6800/2284803610 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6330009030 con 0x7f6320084630 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.922+0000 7f632b7fe640 1 -- 172.21.15.2:0/4050703389 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f63300bec70 con 0x7f6334101c60 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.922+0000 7f6339875640 1 --2- 172.21.15.2:0/4050703389 >> v2:172.21.15.2:6800/2394073254 conn(0x7f632007ae10 0x7f632007d2d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6334105010 tx=0x7f632400b390 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.922+0000 7f633a877640 1 --2- 172.21.15.2:0/4050703389 >> v2:172.21.15.162:6800/2284803610 conn(0x7f6320084630 0x7f6320086a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.922+0000 7f633a877640 1 --2- 172.21.15.2:0/4050703389 >> v2:172.21.15.162:6800/2284803610 conn(0x7f6320084630 0x7f6320086a70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.923+0000 7f632b7fe640 1 -- 172.21.15.2:0/4050703389 <== osd.4 v2:172.21.15.162:6800/2284803610 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6330009030 con 0x7f6320084630 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.939+0000 7f633c2da640 1 -- 172.21.15.2:0/4050703389 --> v2:172.21.15.162:6800/2284803610 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6334102f10 con 0x7f6320084630 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.940+0000 7f632b7fe640 1 -- 172.21.15.2:0/4050703389 <== osd.4 v2:172.21.15.162:6800/2284803610 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6334102f10 con 0x7f6320084630 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.941+0000 7f633c2da640 1 -- 172.21.15.2:0/4050703389 >> v2:172.21.15.162:6800/2284803610 conn(0x7f6320084630 msgr2=0x7f6320086a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.941+0000 7f633c2da640 1 --2- 172.21.15.2:0/4050703389 >> v2:172.21.15.162:6800/2284803610 conn(0x7f6320084630 0x7f6320086a70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.941+0000 7f633c2da640 1 -- 172.21.15.2:0/4050703389 >> v2:172.21.15.2:6800/2394073254 conn(0x7f632007ae10 msgr2=0x7f632007d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.941+0000 7f633c2da640 1 --2- 172.21.15.2:0/4050703389 >> v2:172.21.15.2:6800/2394073254 conn(0x7f632007ae10 0x7f632007d2d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6334105010 tx=0x7f632400b390 comp rx=0 tx=0).stop 2024-09-21T13:39:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.941+0000 7f633c2da640 1 -- 172.21.15.2:0/4050703389 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6334101c60 msgr2=0x7f6334103520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:30.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.941+0000 7f633c2da640 1 --2- 172.21.15.2:0/4050703389 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f6334101c60 0x7f6334103520 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6330035040 tx=0x7f6330033cb0 comp rx=0 tx=0).stop 2024-09-21T13:39:30.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.941+0000 7f633a877640 1 -- 172.21.15.2:0/4050703389 reap_dead start 2024-09-21T13:39:30.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.941+0000 7f633c2da640 1 -- 172.21.15.2:0/4050703389 shutdown_connections 2024-09-21T13:39:30.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.941+0000 7f633c2da640 1 -- 172.21.15.2:0/4050703389 >> 172.21.15.2:0/4050703389 conn(0x7f63340fd6d0 msgr2=0x7f633406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:30.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.941+0000 7f633c2da640 1 -- 172.21.15.2:0/4050703389 shutdown_connections 2024-09-21T13:39:30.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:28.941+0000 7f633c2da640 1 -- 172.21.15.2:0/4050703389 wait complete. 2024-09-21T13:39:31.363 INFO:teuthology.orchestra.run.smithi002.stdout:133143986204 2024-09-21T13:39:31.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T13:39:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:31.412 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:31.478 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:32.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[30076]: pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:39:32.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi162 to 3760M 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[40622]: pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.039 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.040 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.040 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.040 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.040 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi162 to 3760M 2024-09-21T13:39:32.040 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:31 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:31 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:31 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:31 smithi162 ceph-mon[33046]: pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:39:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:31 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:31 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:31 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:31 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:31 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:31 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:31 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi162 to 3760M 2024-09-21T13:39:32.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:31 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:32.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.169+0000 7f85e3dd5640 1 -- 172.21.15.2:0/615209552 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f85dc10f3f0 msgr2=0x7f85dc1117e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:32.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.169+0000 7f85e3dd5640 1 --2- 172.21.15.2:0/615209552 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f85dc10f3f0 0x7f85dc1117e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009ca0 tx=0x7f85d402a950 comp rx=0 tx=0).stop 2024-09-21T13:39:32.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.170+0000 7f85e3dd5640 1 -- 172.21.15.2:0/615209552 shutdown_connections 2024-09-21T13:39:32.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.170+0000 7f85e3dd5640 1 --2- 172.21.15.2:0/615209552 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f85dc10f3f0 0x7f85dc1117e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.170+0000 7f85e3dd5640 1 --2- 172.21.15.2:0/615209552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85dc102160 0x7f85dc10eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.170+0000 7f85e3dd5640 1 --2- 172.21.15.2:0/615209552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc101840 0x7f85dc101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.170+0000 7f85e3dd5640 1 -- 172.21.15.2:0/615209552 >> 172.21.15.2:0/615209552 conn(0x7f85dc0fd710 msgr2=0x7f85dc0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:32.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.170+0000 7f85e3dd5640 1 -- 172.21.15.2:0/615209552 shutdown_connections 2024-09-21T13:39:32.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.170+0000 7f85e3dd5640 1 -- 172.21.15.2:0/615209552 wait complete. 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.170+0000 7f85e3dd5640 1 Processor -- start 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e3dd5640 1 -- start start 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e3dd5640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f85dc101840 0x7f85dc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e3dd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85dc102160 0x7f85dc19b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e3dd5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc10f3f0 0x7f85dc1a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e3dd5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc114680 con 0x7f85dc102160 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e3dd5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc114500 con 0x7f85dc10f3f0 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e3dd5640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f85dc114800 con 0x7f85dc101840 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e1b71640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f85dc101840 0x7f85dc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e1b71640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f85dc101840 0x7f85dc19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:37824/0 (socket says 172.21.15.2:37824) 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e1b71640 1 -- 172.21.15.2:0/382139436 learned_addr learned my addr 172.21.15.2:0/382139436 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e2372640 1 --2- 172.21.15.2:0/382139436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc10f3f0 0x7f85dc1a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e1b71640 1 -- 172.21.15.2:0/382139436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc10f3f0 msgr2=0x7f85dc1a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e1b71640 1 --2- 172.21.15.2:0/382139436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc10f3f0 0x7f85dc1a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e1b71640 1 -- 172.21.15.2:0/382139436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85dc102160 msgr2=0x7f85dc19b080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e1b71640 1 --2- 172.21.15.2:0/382139436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85dc102160 0x7f85dc19b080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e1b71640 1 -- 172.21.15.2:0/382139436 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85dc1a0bf0 con 0x7f85dc101840 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.171+0000 7f85e1b71640 1 --2- 172.21.15.2:0/382139436 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f85dc101840 0x7f85dc19ab40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f85d800d770 tx=0x7f85d800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.172+0000 7f85d2ffd640 1 -- 172.21.15.2:0/382139436 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8017070 con 0x7f85dc101840 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.172+0000 7f85d2ffd640 1 -- 172.21.15.2:0/382139436 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f85d80054a0 con 0x7f85dc101840 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.172+0000 7f85e3dd5640 1 -- 172.21.15.2:0/382139436 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85dc1a0ee0 con 0x7f85dc101840 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.172+0000 7f85d2ffd640 1 -- 172.21.15.2:0/382139436 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8004bb0 con 0x7f85dc101840 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.172+0000 7f85e3dd5640 1 -- 172.21.15.2:0/382139436 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f85dc1a75a0 con 0x7f85dc101840 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.173+0000 7f85e3dd5640 1 -- 172.21.15.2:0/382139436 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85dc101c20 con 0x7f85dc101840 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.174+0000 7f85d2ffd640 1 -- 172.21.15.2:0/382139436 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f85d8010460 con 0x7f85dc101840 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.174+0000 7f85d2ffd640 1 --2- 172.21.15.2:0/382139436 >> v2:172.21.15.2:6800/2394073254 conn(0x7f85c807b110 0x7f85c807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.174+0000 7f85d2ffd640 1 -- 172.21.15.2:0/382139436 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7f85d809dda0 con 0x7f85dc101840 2024-09-21T13:39:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.174+0000 7f85e1370640 1 --2- 172.21.15.2:0/382139436 >> v2:172.21.15.2:6800/2394073254 conn(0x7f85c807b110 0x7f85c807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:32.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.175+0000 7f85e1370640 1 --2- 172.21.15.2:0/382139436 >> v2:172.21.15.2:6800/2394073254 conn(0x7f85c807b110 0x7f85c807d5d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ffe30 tx=0x7f85cc005f90 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:32.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.179+0000 7f85d2ffd640 1 -- 172.21.15.2:0/382139436 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85d8069410 con 0x7f85dc101840 2024-09-21T13:39:32.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.371+0000 7f85e3dd5640 1 -- 172.21.15.2:0/382139436 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f85dc1a7910 con 0x7f85dc101840 2024-09-21T13:39:32.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.371+0000 7f85d2ffd640 1 -- 172.21.15.2:0/382139436 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85d806e2c0 con 0x7f85dc101840 2024-09-21T13:39:32.373 INFO:teuthology.orchestra.run.smithi002.stdout:34359738420 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 -- 172.21.15.2:0/382139436 >> v2:172.21.15.2:6800/2394073254 conn(0x7f85c807b110 msgr2=0x7f85c807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 --2- 172.21.15.2:0/382139436 >> v2:172.21.15.2:6800/2394073254 conn(0x7f85c807b110 0x7f85c807d5d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ffe30 tx=0x7f85cc005f90 comp rx=0 tx=0).stop 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 -- 172.21.15.2:0/382139436 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f85dc101840 msgr2=0x7f85dc19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 --2- 172.21.15.2:0/382139436 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f85dc101840 0x7f85dc19ab40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f85d800d770 tx=0x7f85d800dc30 comp rx=0 tx=0).stop 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 -- 172.21.15.2:0/382139436 shutdown_connections 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 --2- 172.21.15.2:0/382139436 >> v2:172.21.15.2:6800/2394073254 conn(0x7f85c807b110 0x7f85c807d5d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 --2- 172.21.15.2:0/382139436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85dc10f3f0 0x7f85dc1a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 --2- 172.21.15.2:0/382139436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85dc102160 0x7f85dc19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 --2- 172.21.15.2:0/382139436 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f85dc101840 0x7f85dc19ab40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 -- 172.21.15.2:0/382139436 >> 172.21.15.2:0/382139436 conn(0x7f85dc0fd710 msgr2=0x7f85dc10f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 -- 172.21.15.2:0/382139436 shutdown_connections 2024-09-21T13:39:32.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.374+0000 7f85e3dd5640 1 -- 172.21.15.2:0/382139436 wait complete. 2024-09-21T13:39:32.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.680+0000 7fa5304a5640 1 -- 172.21.15.2:0/2246359381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa528108030 msgr2=0x7fa52810e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.680+0000 7fa5304a5640 1 --2- 172.21.15.2:0/2246359381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa528108030 0x7fa52810e830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa520009ca0 tx=0x7fa52002a8c0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.681+0000 7fa5304a5640 1 -- 172.21.15.2:0/2246359381 shutdown_connections 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.681+0000 7fa5304a5640 1 --2- 172.21.15.2:0/2246359381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa528108030 0x7fa52810e830 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.681+0000 7fa5304a5640 1 --2- 172.21.15.2:0/2246359381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5281076b0 0x7fa528107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.681+0000 7fa5304a5640 1 --2- 172.21.15.2:0/2246359381 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa528101ca0 0x7fa528102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.681+0000 7fa5304a5640 1 -- 172.21.15.2:0/2246359381 >> 172.21.15.2:0/2246359381 conn(0x7fa5280fd710 msgr2=0x7fa5280ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.681+0000 7fa5304a5640 1 -- 172.21.15.2:0/2246359381 shutdown_connections 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.681+0000 7fa5304a5640 1 -- 172.21.15.2:0/2246359381 wait complete. 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.681+0000 7fa5304a5640 1 Processor -- start 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.681+0000 7fa5304a5640 1 -- start start 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa5304a5640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa528101ca0 0x7fa528198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa5304a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5281076b0 0x7fa528198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:32.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa5304a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa528108030 0x7fa52819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa5304a5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa528111400 con 0x7fa5281076b0 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa5304a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa528111280 con 0x7fa528108030 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa5304a5640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fa528111580 con 0x7fa528101ca0 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52e241640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa528101ca0 0x7fa528198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52da40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5281076b0 0x7fa528198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52e241640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa528101ca0 0x7fa528198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:37842/0 (socket says 172.21.15.2:37842) 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52da40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5281076b0 0x7fa528198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47296/0 (socket says 172.21.15.2:47296) 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52e241640 1 -- 172.21.15.2:0/1255732516 learned_addr learned my addr 172.21.15.2:0/1255732516 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52ea42640 1 --2- 172.21.15.2:0/1255732516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa528108030 0x7fa52819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52e241640 1 -- 172.21.15.2:0/1255732516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa528108030 msgr2=0x7fa52819e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52e241640 1 --2- 172.21.15.2:0/1255732516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa528108030 0x7fa52819e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52e241640 1 -- 172.21.15.2:0/1255732516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5281076b0 msgr2=0x7fa528198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52e241640 1 --2- 172.21.15.2:0/1255732516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5281076b0 0x7fa528198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52e241640 1 -- 172.21.15.2:0/1255732516 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52819ea30 con 0x7fa528101ca0 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52da40640 1 --2- 172.21.15.2:0/1255732516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5281076b0 0x7fa528198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa52e241640 1 --2- 172.21.15.2:0/1255732516 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa528101ca0 0x7fa528198980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa52400ea60 tx=0x7fa52400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.682+0000 7fa51f7fe640 1 -- 172.21.15.2:0/1255732516 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52400cd20 con 0x7fa528101ca0 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.683+0000 7fa5304a5640 1 -- 172.21.15.2:0/1255732516 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa52819ed20 con 0x7fa528101ca0 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.683+0000 7fa51f7fe640 1 -- 172.21.15.2:0/1255732516 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fa5240035f0 con 0x7fa528101ca0 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.683+0000 7fa5304a5640 1 -- 172.21.15.2:0/1255732516 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5281a5460 con 0x7fa528101ca0 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.683+0000 7fa51f7fe640 1 -- 172.21.15.2:0/1255732516 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240044a0 con 0x7fa528101ca0 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.684+0000 7fa5304a5640 1 -- 172.21.15.2:0/1255732516 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa528102080 con 0x7fa528101ca0 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.684+0000 7fa51f7fe640 1 -- 172.21.15.2:0/1255732516 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7fa524004000 con 0x7fa528101ca0 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.685+0000 7fa51f7fe640 1 --2- 172.21.15.2:0/1255732516 >> v2:172.21.15.2:6800/2394073254 conn(0x7fa51407b110 0x7fa51407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.685+0000 7fa51f7fe640 1 -- 172.21.15.2:0/1255732516 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7fa52409e680 con 0x7fa528101ca0 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.685+0000 7fa52da40640 1 --2- 172.21.15.2:0/1255732516 >> v2:172.21.15.2:6800/2394073254 conn(0x7fa51407b110 0x7fa51407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.685+0000 7fa52da40640 1 --2- 172.21.15.2:0/1255732516 >> v2:172.21.15.2:6800/2394073254 conn(0x7fa51407b110 0x7fa51407d5d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa528103c60 tx=0x7fa518009110 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.689+0000 7fa51f7fe640 1 -- 172.21.15.2:0/1255732516 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa524069c70 con 0x7fa528101ca0 2024-09-21T13:39:32.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.880+0000 7fa5304a5640 1 -- 172.21.15.2:0/1255732516 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa5281a5770 con 0x7fa528101ca0 2024-09-21T13:39:32.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.880+0000 7fa51f7fe640 1 -- 172.21.15.2:0/1255732516 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa52406eb20 con 0x7fa528101ca0 2024-09-21T13:39:32.882 INFO:teuthology.orchestra.run.smithi002.stdout:111669149730 2024-09-21T13:39:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.882+0000 7fa5304a5640 1 -- 172.21.15.2:0/1255732516 >> v2:172.21.15.2:6800/2394073254 conn(0x7fa51407b110 msgr2=0x7fa51407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.882+0000 7fa5304a5640 1 --2- 172.21.15.2:0/1255732516 >> v2:172.21.15.2:6800/2394073254 conn(0x7fa51407b110 0x7fa51407d5d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa528103c60 tx=0x7fa518009110 comp rx=0 tx=0).stop 2024-09-21T13:39:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.882+0000 7fa5304a5640 1 -- 172.21.15.2:0/1255732516 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa528101ca0 msgr2=0x7fa528198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.882+0000 7fa5304a5640 1 --2- 172.21.15.2:0/1255732516 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa528101ca0 0x7fa528198980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa52400ea60 tx=0x7fa52400ee60 comp rx=0 tx=0).stop 2024-09-21T13:39:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.882+0000 7fa5304a5640 1 -- 172.21.15.2:0/1255732516 shutdown_connections 2024-09-21T13:39:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.882+0000 7fa5304a5640 1 --2- 172.21.15.2:0/1255732516 >> v2:172.21.15.2:6800/2394073254 conn(0x7fa51407b110 0x7fa51407d5d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.882+0000 7fa5304a5640 1 --2- 172.21.15.2:0/1255732516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa528108030 0x7fa52819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.882+0000 7fa5304a5640 1 --2- 172.21.15.2:0/1255732516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5281076b0 0x7fa528198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.882+0000 7fa5304a5640 1 --2- 172.21.15.2:0/1255732516 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fa528101ca0 0x7fa528198980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:32.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.882+0000 7fa5304a5640 1 -- 172.21.15.2:0/1255732516 >> 172.21.15.2:0/1255732516 conn(0x7fa5280fd710 msgr2=0x7fa5280ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:32.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.883+0000 7fa5304a5640 1 -- 172.21.15.2:0/1255732516 shutdown_connections 2024-09-21T13:39:32.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.883+0000 7fa5304a5640 1 -- 172.21.15.2:0/1255732516 wait complete. 2024-09-21T13:39:33.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:32 smithi162 ceph-mon[33046]: mgrmap e22: y(active, since 4s), standbys: x 2024-09-21T13:39:33.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/382139436' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T13:39:33.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1255732516' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T13:39:33.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:32 smithi002 ceph-mon[30076]: mgrmap e22: y(active, since 4s), standbys: x 2024-09-21T13:39:33.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/382139436' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T13:39:33.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1255732516' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T13:39:33.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:32 smithi002 ceph-mon[40622]: mgrmap e22: y(active, since 4s), standbys: x 2024-09-21T13:39:33.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/382139436' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T13:39:33.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1255732516' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T13:39:33.506 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149729 got 111669149730 for osd.3 2024-09-21T13:39:33.506 DEBUG:teuthology.parallel:result is None 2024-09-21T13:39:34.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2750558676' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T13:39:34.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:33 smithi002 ceph-mon[40622]: pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:39:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2750558676' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T13:39:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:33 smithi002 ceph-mon[30076]: pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:39:34.193 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738419 got 34359738420 for osd.0 2024-09-21T13:39:34.193 DEBUG:teuthology.parallel:result is None 2024-09-21T13:39:34.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2750558676' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T13:39:34.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:33 smithi162 ceph-mon[33046]: pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:39:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.791+0000 7f1df4cb0640 1 -- 172.21.15.2:0/4241691154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df010d0d0 msgr2=0x7f1df010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.791+0000 7f1df4cb0640 1 --2- 172.21.15.2:0/4241691154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df010d0d0 0x7f1df010f530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009ca0 tx=0x7f1de802a8c0 comp rx=0 tx=0).stop 2024-09-21T13:39:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.791+0000 7f1df4cb0640 1 -- 172.21.15.2:0/4241691154 shutdown_connections 2024-09-21T13:39:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.791+0000 7f1df4cb0640 1 --2- 172.21.15.2:0/4241691154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df010d0d0 0x7f1df010f530 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.791+0000 7f1df4cb0640 1 --2- 172.21.15.2:0/4241691154 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f1df0104590 0x7f1df010ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.791+0000 7f1df4cb0640 1 --2- 172.21.15.2:0/4241691154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df0103c70 0x7f1df0104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.791+0000 7f1df4cb0640 1 -- 172.21.15.2:0/4241691154 >> 172.21.15.2:0/4241691154 conn(0x7f1df00fd6d0 msgr2=0x7f1df00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.791+0000 7f1df4cb0640 1 -- 172.21.15.2:0/4241691154 shutdown_connections 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.791+0000 7f1df4cb0640 1 -- 172.21.15.2:0/4241691154 wait complete. 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.791+0000 7f1df4cb0640 1 Processor -- start 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.791+0000 7f1df4cb0640 1 -- start start 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1df4cb0640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f1df0103c70 0x7f1df0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1df4cb0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df0104590 0x7f1df0198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1df4cb0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df010d0d0 0x7f1df019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1df4cb0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1df0112450 con 0x7f1df010d0d0 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1df4cb0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1df01122d0 con 0x7f1df0104590 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1df4cb0640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f1df01125d0 con 0x7f1df0103c70 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1dee59c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f1df0103c70 0x7f1df0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1deed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df010d0d0 0x7f1df019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1deed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df010d0d0 0x7f1df019e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47338/0 (socket says 172.21.15.2:47338) 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1dee59c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f1df0103c70 0x7f1df0198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:37876/0 (socket says 172.21.15.2:37876) 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1deed9d640 1 -- 172.21.15.2:0/1458161129 learned_addr learned my addr 172.21.15.2:0/1458161129 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1de7fff640 1 --2- 172.21.15.2:0/1458161129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df0104590 0x7f1df0198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1dee59c640 1 -- 172.21.15.2:0/1458161129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df0104590 msgr2=0x7f1df0198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1dee59c640 1 --2- 172.21.15.2:0/1458161129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df0104590 0x7f1df0198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1dee59c640 1 -- 172.21.15.2:0/1458161129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df010d0d0 msgr2=0x7f1df019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1dee59c640 1 --2- 172.21.15.2:0/1458161129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df010d0d0 0x7f1df019e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1dee59c640 1 -- 172.21.15.2:0/1458161129 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df019ea20 con 0x7f1df0103c70 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1deed9d640 1 --2- 172.21.15.2:0/1458161129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df010d0d0 0x7f1df019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1dee59c640 1 --2- 172.21.15.2:0/1458161129 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f1df0103c70 0x7f1df0198970 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1de000b3f0 tx=0x7f1de000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.792+0000 7f1de77fe640 1 -- 172.21.15.2:0/1458161129 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de0015020 con 0x7f1df0103c70 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.793+0000 7f1df4cb0640 1 -- 172.21.15.2:0/1458161129 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df019ed10 con 0x7f1df0103c70 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.793+0000 7f1df4cb0640 1 -- 172.21.15.2:0/1458161129 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df01a55a0 con 0x7f1df0103c70 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.793+0000 7f1de77fe640 1 -- 172.21.15.2:0/1458161129 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f1de0011cb0 con 0x7f1df0103c70 2024-09-21T13:39:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.793+0000 7f1de77fe640 1 -- 172.21.15.2:0/1458161129 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de0010c90 con 0x7f1df0103c70 2024-09-21T13:39:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.794+0000 7f1df4cb0640 1 -- 172.21.15.2:0/1458161129 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1df0104050 con 0x7f1df0103c70 2024-09-21T13:39:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.794+0000 7f1de77fe640 1 -- 172.21.15.2:0/1458161129 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f1de0018020 con 0x7f1df0103c70 2024-09-21T13:39:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.795+0000 7f1de77fe640 1 --2- 172.21.15.2:0/1458161129 >> v2:172.21.15.2:6800/2394073254 conn(0x7f1ddc07b110 0x7f1ddc07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.795+0000 7f1de77fe640 1 -- 172.21.15.2:0/1458161129 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7f1de009da90 con 0x7f1df0103c70 2024-09-21T13:39:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.795+0000 7f1de7fff640 1 --2- 172.21.15.2:0/1458161129 >> v2:172.21.15.2:6800/2394073254 conn(0x7f1ddc07b110 0x7f1ddc07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.795+0000 7f1de7fff640 1 --2- 172.21.15.2:0/1458161129 >> v2:172.21.15.2:6800/2394073254 conn(0x7f1ddc07b110 0x7f1ddc07d5d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1df010e610 tx=0x7f1dd8005f90 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.799+0000 7f1de77fe640 1 -- 172.21.15.2:0/1458161129 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1de001f020 con 0x7f1df0103c70 2024-09-21T13:39:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.988+0000 7f1df4cb0640 1 -- 172.21.15.2:0/1458161129 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1df0107800 con 0x7f1df0103c70 2024-09-21T13:39:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.988+0000 7f1de77fe640 1 -- 172.21.15.2:0/1458161129 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1de0068fe0 con 0x7f1df0103c70 2024-09-21T13:39:34.989 INFO:teuthology.orchestra.run.smithi002.stdout:184683593744 2024-09-21T13:39:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.990+0000 7f1df4cb0640 1 -- 172.21.15.2:0/1458161129 >> v2:172.21.15.2:6800/2394073254 conn(0x7f1ddc07b110 msgr2=0x7f1ddc07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.990+0000 7f1df4cb0640 1 --2- 172.21.15.2:0/1458161129 >> v2:172.21.15.2:6800/2394073254 conn(0x7f1ddc07b110 0x7f1ddc07d5d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1df010e610 tx=0x7f1dd8005f90 comp rx=0 tx=0).stop 2024-09-21T13:39:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.990+0000 7f1df4cb0640 1 -- 172.21.15.2:0/1458161129 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f1df0103c70 msgr2=0x7f1df0198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.990+0000 7f1df4cb0640 1 --2- 172.21.15.2:0/1458161129 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f1df0103c70 0x7f1df0198970 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1de000b3f0 tx=0x7f1de000b8b0 comp rx=0 tx=0).stop 2024-09-21T13:39:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.990+0000 7f1df4cb0640 1 -- 172.21.15.2:0/1458161129 shutdown_connections 2024-09-21T13:39:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.990+0000 7f1df4cb0640 1 --2- 172.21.15.2:0/1458161129 >> v2:172.21.15.2:6800/2394073254 conn(0x7f1ddc07b110 0x7f1ddc07d5d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.990+0000 7f1df4cb0640 1 --2- 172.21.15.2:0/1458161129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df010d0d0 0x7f1df019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.990+0000 7f1df4cb0640 1 --2- 172.21.15.2:0/1458161129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1df0104590 0x7f1df0198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.990+0000 7f1df4cb0640 1 --2- 172.21.15.2:0/1458161129 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f1df0103c70 0x7f1df0198970 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.991+0000 7f1df4cb0640 1 -- 172.21.15.2:0/1458161129 >> 172.21.15.2:0/1458161129 conn(0x7f1df00fd6d0 msgr2=0x7f1df01049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.991+0000 7f1df4cb0640 1 -- 172.21.15.2:0/1458161129 shutdown_connections 2024-09-21T13:39:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:34.991+0000 7f1df4cb0640 1 -- 172.21.15.2:0/1458161129 wait complete. 2024-09-21T13:39:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.976+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2861058782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b04108030 msgr2=0x7f7b0410e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.976+0000 7f7b09bd5640 1 --2- 172.21.15.2:0/2861058782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b04108030 0x7f7b0410e830 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009ca0 tx=0x7f7afc02a8c0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.976+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2861058782 shutdown_connections 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.976+0000 7f7b09bd5640 1 --2- 172.21.15.2:0/2861058782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b04108030 0x7f7b0410e830 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.976+0000 7f7b09bd5640 1 --2- 172.21.15.2:0/2861058782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b041076b0 0x7f7b04107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.976+0000 7f7b09bd5640 1 --2- 172.21.15.2:0/2861058782 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7b04101ca0 0x7f7b04102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.976+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2861058782 >> 172.21.15.2:0/2861058782 conn(0x7f7b040fd710 msgr2=0x7f7b040ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.976+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2861058782 shutdown_connections 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.976+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2861058782 wait complete. 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b09bd5640 1 Processor -- start 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b09bd5640 1 -- start start 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b09bd5640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7b04101ca0 0x7f7b041989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b09bd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b041076b0 0x7f7b04198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b09bd5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b04108030 0x7f7b0419e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b09bd5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7b04111450 con 0x7f7b041076b0 2024-09-21T13:39:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b09bd5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b041112d0 con 0x7f7b04108030 2024-09-21T13:39:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b09bd5640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f7b041115d0 con 0x7f7b04101ca0 2024-09-21T13:39:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b02ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b041076b0 0x7f7b04198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b037fe640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7b04101ca0 0x7f7b041989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b02ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b041076b0 0x7f7b04198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47310/0 (socket says 172.21.15.2:47310) 2024-09-21T13:39:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b02ffd640 1 -- 172.21.15.2:0/2750558676 learned_addr learned my addr 172.21.15.2:0/2750558676 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:35.016 INFO:teuthology.orchestra.run.smithi002.stdout:77309411367 2024-09-21T13:39:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b03fff640 1 --2- 172.21.15.2:0/2750558676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b04108030 0x7f7b0419e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b037fe640 1 -- 172.21.15.2:0/2750558676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b04108030 msgr2=0x7f7b0419e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b037fe640 1 --2- 172.21.15.2:0/2750558676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b04108030 0x7f7b0419e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b037fe640 1 -- 172.21.15.2:0/2750558676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b041076b0 msgr2=0x7f7b04198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b037fe640 1 --2- 172.21.15.2:0/2750558676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b041076b0 0x7f7b04198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b037fe640 1 -- 172.21.15.2:0/2750558676 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0419ea80 con 0x7f7b04101ca0 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.977+0000 7f7b02ffd640 1 --2- 172.21.15.2:0/2750558676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b041076b0 0x7f7b04198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.978+0000 7f7b03fff640 1 --2- 172.21.15.2:0/2750558676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b04108030 0x7f7b0419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.978+0000 7f7b037fe640 1 --2- 172.21.15.2:0/2750558676 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7b04101ca0 0x7f7b041989d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7af400e9f0 tx=0x7f7af400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.978+0000 7f7b00ff9640 1 -- 172.21.15.2:0/2750558676 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af400cd80 con 0x7f7b04101ca0 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.978+0000 7f7b00ff9640 1 -- 172.21.15.2:0/2750558676 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7af40035f0 con 0x7f7b04101ca0 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.978+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2750558676 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0419ed70 con 0x7f7b04101ca0 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.978+0000 7f7b00ff9640 1 -- 172.21.15.2:0/2750558676 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af40044a0 con 0x7f7b04101ca0 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.978+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2750558676 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b041a54b0 con 0x7f7b04101ca0 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.979+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2750558676 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b04102080 con 0x7f7b04101ca0 2024-09-21T13:39:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.979+0000 7f7b00ff9640 1 -- 172.21.15.2:0/2750558676 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f7af4004000 con 0x7f7b04101ca0 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.980+0000 7f7b00ff9640 1 --2- 172.21.15.2:0/2750558676 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7aec07b110 0x7f7aec07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.980+0000 7f7b02ffd640 1 --2- 172.21.15.2:0/2750558676 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7aec07b110 0x7f7aec07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.980+0000 7f7b00ff9640 1 -- 172.21.15.2:0/2750558676 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7f7af409e6a0 con 0x7f7b04101ca0 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.981+0000 7f7b02ffd640 1 --2- 172.21.15.2:0/2750558676 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7aec07b110 0x7f7aec07d5d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7b04103e60 tx=0x7f7af80091c0 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:32.985+0000 7f7b00ff9640 1 -- 172.21.15.2:0/2750558676 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7af4069c90 con 0x7f7b04101ca0 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.180+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2750558676 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7b041a5770 con 0x7f7b04101ca0 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.180+0000 7f7b00ff9640 1 -- 172.21.15.2:0/2750558676 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7af406ae20 con 0x7f7b04101ca0 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.182+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2750558676 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7aec07b110 msgr2=0x7f7aec07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.182+0000 7f7b09bd5640 1 --2- 172.21.15.2:0/2750558676 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7aec07b110 0x7f7aec07d5d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7b04103e60 tx=0x7f7af80091c0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.182+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2750558676 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7b04101ca0 msgr2=0x7f7b041989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.182+0000 7f7b09bd5640 1 --2- 172.21.15.2:0/2750558676 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7b04101ca0 0x7f7b041989d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7af400e9f0 tx=0x7f7af400eeb0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.182+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2750558676 shutdown_connections 2024-09-21T13:39:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.182+0000 7f7b09bd5640 1 --2- 172.21.15.2:0/2750558676 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7aec07b110 0x7f7aec07d5d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.182+0000 7f7b09bd5640 1 --2- 172.21.15.2:0/2750558676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b04108030 0x7f7b0419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.182+0000 7f7b09bd5640 1 --2- 172.21.15.2:0/2750558676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b041076b0 0x7f7b04198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.182+0000 7f7b09bd5640 1 --2- 172.21.15.2:0/2750558676 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7b04101ca0 0x7f7b041989d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.183+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2750558676 >> 172.21.15.2:0/2750558676 conn(0x7f7b040fd710 msgr2=0x7f7b04100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.183+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2750558676 shutdown_connections 2024-09-21T13:39:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:33.183+0000 7f7b09bd5640 1 -- 172.21.15.2:0/2750558676 wait complete. 2024-09-21T13:39:35.293 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1458161129' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T13:39:35.294 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1458161129' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T13:39:35.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1458161129' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T13:39:35.678 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411366 got 77309411367 for osd.2 2024-09-21T13:39:35.679 DEBUG:teuthology.parallel:result is None 2024-09-21T13:39:36.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.071+0000 7f03fddf2640 1 -- 172.21.15.2:0/4058338289 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f03f8102180 msgr2=0x7f03f810eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:36.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.071+0000 7f03fddf2640 1 --2- 172.21.15.2:0/4058338289 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f03f8102180 0x7f03f810eed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009860 tx=0x7f03ec02a3d0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.071+0000 7f03fddf2640 1 -- 172.21.15.2:0/4058338289 shutdown_connections 2024-09-21T13:39:36.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.071+0000 7f03fddf2640 1 --2- 172.21.15.2:0/4058338289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f810f410 0x7f03f8111800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.071+0000 7f03fddf2640 1 --2- 172.21.15.2:0/4058338289 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f03f8102180 0x7f03f810eed0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.071+0000 7f03fddf2640 1 --2- 172.21.15.2:0/4058338289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f8101860 0x7f03f8101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.071+0000 7f03fddf2640 1 -- 172.21.15.2:0/4058338289 >> 172.21.15.2:0/4058338289 conn(0x7f03f80fd6d0 msgr2=0x7f03f80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:36.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.071+0000 7f03fddf2640 1 -- 172.21.15.2:0/4058338289 shutdown_connections 2024-09-21T13:39:36.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.071+0000 7f03fddf2640 1 -- 172.21.15.2:0/4058338289 wait complete. 2024-09-21T13:39:36.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.071+0000 7f03fddf2640 1 Processor -- start 2024-09-21T13:39:36.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03fddf2640 1 -- start start 2024-09-21T13:39:36.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03fddf2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f8101860 0x7f03f819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:36.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03fddf2640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f03f8102180 0x7f03f819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:36.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03fddf2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f810f410 0x7f03f81a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:36.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03fddf2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f03f8114670 con 0x7f03f8101860 2024-09-21T13:39:36.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03fddf2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03f81144f0 con 0x7f03f810f410 2024-09-21T13:39:36.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03fddf2640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f03f81147f0 con 0x7f03f8102180 2024-09-21T13:39:36.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03f77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f8101860 0x7f03f819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:36.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03f6ffd640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f03f8102180 0x7f03f819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:36.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03f6ffd640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f03f8102180 0x7f03f819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:37904/0 (socket says 172.21.15.2:37904) 2024-09-21T13:39:36.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03f77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f8101860 0x7f03f819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47360/0 (socket says 172.21.15.2:47360) 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.072+0000 7f03f77fe640 1 -- 172.21.15.2:0/363931712 learned_addr learned my addr 172.21.15.2:0/363931712 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03f7fff640 1 --2- 172.21.15.2:0/363931712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f810f410 0x7f03f81a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03f77fe640 1 -- 172.21.15.2:0/363931712 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f03f8102180 msgr2=0x7f03f819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03f77fe640 1 --2- 172.21.15.2:0/363931712 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f03f8102180 0x7f03f819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03f77fe640 1 -- 172.21.15.2:0/363931712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f810f410 msgr2=0x7f03f81a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03f77fe640 1 --2- 172.21.15.2:0/363931712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f810f410 0x7f03f81a0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03f77fe640 1 -- 172.21.15.2:0/363931712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f81a0ce0 con 0x7f03f8101860 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03f6ffd640 1 --2- 172.21.15.2:0/363931712 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f03f8102180 0x7f03f819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03f77fe640 1 --2- 172.21.15.2:0/363931712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f8101860 0x7f03f819ac30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03e800c920 tx=0x7f03e800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03f4ff9640 1 -- 172.21.15.2:0/363931712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e8007c70 con 0x7f03f8101860 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03fddf2640 1 -- 172.21.15.2:0/363931712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f81a0fd0 con 0x7f03f8101860 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03f4ff9640 1 -- 172.21.15.2:0/363931712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f03e8007e10 con 0x7f03f8101860 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03fddf2640 1 -- 172.21.15.2:0/363931712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f81a7860 con 0x7f03f8101860 2024-09-21T13:39:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.073+0000 7f03f4ff9640 1 -- 172.21.15.2:0/363931712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e8018700 con 0x7f03f8101860 2024-09-21T13:39:36.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.074+0000 7f03fddf2640 1 -- 172.21.15.2:0/363931712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f8101c40 con 0x7f03f8101860 2024-09-21T13:39:36.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.075+0000 7f03f4ff9640 1 -- 172.21.15.2:0/363931712 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f03e800f450 con 0x7f03f8101860 2024-09-21T13:39:36.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.075+0000 7f03f4ff9640 1 --2- 172.21.15.2:0/363931712 >> v2:172.21.15.2:6800/2394073254 conn(0x7f03e007b110 0x7f03e007d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:36.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.076+0000 7f03f6ffd640 1 --2- 172.21.15.2:0/363931712 >> v2:172.21.15.2:6800/2394073254 conn(0x7f03e007b110 0x7f03e007d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:36.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.076+0000 7f03f4ff9640 1 -- 172.21.15.2:0/363931712 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7f03e809e450 con 0x7f03f8101860 2024-09-21T13:39:36.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.076+0000 7f03f6ffd640 1 --2- 172.21.15.2:0/363931712 >> v2:172.21.15.2:6800/2394073254 conn(0x7f03e007b110 0x7f03e007d5d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f03f8111b40 tx=0x7f03ec005c90 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:36.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.080+0000 7f03f4ff9640 1 -- 172.21.15.2:0/363931712 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03e8014030 con 0x7f03f8101860 2024-09-21T13:39:36.173 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:36 smithi002 ceph-mon[30076]: pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T13:39:36.173 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:36 smithi002 ceph-mon[40622]: pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T13:39:36.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.258+0000 7fb35191c640 1 -- 172.21.15.2:0/579088910 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb34c108790 msgr2=0x7fb34c108bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:36.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.258+0000 7fb35191c640 1 --2- 172.21.15.2:0/579088910 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb34c108790 0x7fb34c108bd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb334009900 tx=0x7fb33402a410 comp rx=0 tx=0).stop 2024-09-21T13:39:36.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.258+0000 7fb35191c640 1 -- 172.21.15.2:0/579088910 shutdown_connections 2024-09-21T13:39:36.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.258+0000 7fb35191c640 1 --2- 172.21.15.2:0/579088910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb34c109110 0x7fb34c10f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.258+0000 7fb35191c640 1 --2- 172.21.15.2:0/579088910 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb34c108790 0x7fb34c108bd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.258+0000 7fb35191c640 1 --2- 172.21.15.2:0/579088910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c102d80 0x7fb34c103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.258+0000 7fb35191c640 1 -- 172.21.15.2:0/579088910 >> 172.21.15.2:0/579088910 conn(0x7fb34c0fe7d0 msgr2=0x7fb34c100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.258+0000 7fb35191c640 1 -- 172.21.15.2:0/579088910 shutdown_connections 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.258+0000 7fb35191c640 1 -- 172.21.15.2:0/579088910 wait complete. 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb35191c640 1 Processor -- start 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb35191c640 1 -- start start 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb35191c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c102d80 0x7fb34c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb35191c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb34c108790 0x7fb34c198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb35191c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb34c109110 0x7fb34c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb35191c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c1124e0 con 0x7fb34c102d80 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb35191c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c112360 con 0x7fb34c109110 2024-09-21T13:39:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb35191c640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fb34c112660 con 0x7fb34c108790 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb343fff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb34c108790 0x7fb34c198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb34affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c102d80 0x7fb34c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb343fff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb34c108790 0x7fb34c198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:47708/0 (socket says 172.21.15.2:47708) 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb343fff640 1 -- 172.21.15.2:0/3954904872 learned_addr learned my addr 172.21.15.2:0/3954904872 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.259+0000 7fb34b7fe640 1 --2- 172.21.15.2:0/3954904872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb34c109110 0x7fb34c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb34affd640 1 -- 172.21.15.2:0/3954904872 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb34c108790 msgr2=0x7fb34c198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb34affd640 1 --2- 172.21.15.2:0/3954904872 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb34c108790 0x7fb34c198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb34affd640 1 -- 172.21.15.2:0/3954904872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb34c109110 msgr2=0x7fb34c19e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb34affd640 1 --2- 172.21.15.2:0/3954904872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb34c109110 0x7fb34c19e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb34affd640 1 -- 172.21.15.2:0/3954904872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c19ea40 con 0x7fb34c102d80 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb343fff640 1 --2- 172.21.15.2:0/3954904872 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb34c108790 0x7fb34c198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:36.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb34affd640 1 --2- 172.21.15.2:0/3954904872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c102d80 0x7fb34c198990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00e9f0 tx=0x7fb33c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:36.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb35091a640 1 -- 172.21.15.2:0/3954904872 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00cd80 con 0x7fb34c102d80 2024-09-21T13:39:36.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb35191c640 1 -- 172.21.15.2:0/3954904872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34c19ed30 con 0x7fb34c102d80 2024-09-21T13:39:36.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb35091a640 1 -- 172.21.15.2:0/3954904872 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fb33c0035f0 con 0x7fb34c102d80 2024-09-21T13:39:36.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb35091a640 1 -- 172.21.15.2:0/3954904872 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0044a0 con 0x7fb34c102d80 2024-09-21T13:39:36.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.260+0000 7fb35191c640 1 -- 172.21.15.2:0/3954904872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb34c1a53f0 con 0x7fb34c102d80 2024-09-21T13:39:36.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.261+0000 7fb35191c640 1 -- 172.21.15.2:0/3954904872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34c103160 con 0x7fb34c102d80 2024-09-21T13:39:36.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.263+0000 7fb35091a640 1 -- 172.21.15.2:0/3954904872 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7fb33c004000 con 0x7fb34c102d80 2024-09-21T13:39:36.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.263+0000 7fb35091a640 1 --2- 172.21.15.2:0/3954904872 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb33807b110 0x7fb33807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:36.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.263+0000 7fb35091a640 1 -- 172.21.15.2:0/3954904872 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7fb33c09e560 con 0x7fb34c102d80 2024-09-21T13:39:36.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.263+0000 7fb343fff640 1 --2- 172.21.15.2:0/3954904872 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb33807b110 0x7fb33807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:36.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.264+0000 7fb343fff640 1 --2- 172.21.15.2:0/3954904872 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb33807b110 0x7fb33807d5d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb334031440 tx=0x7fb3340058d0 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.272+0000 7fb35091a640 1 -- 172.21.15.2:0/3954904872 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb33c069b50 con 0x7fb34c102d80 2024-09-21T13:39:36.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.279+0000 7f03fddf2640 1 -- 172.21.15.2:0/363931712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f03f81a7a30 con 0x7f03f8101860 2024-09-21T13:39:36.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.279+0000 7f03f4ff9640 1 -- 172.21.15.2:0/363931712 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f03e8069a20 con 0x7f03f8101860 2024-09-21T13:39:36.280 INFO:teuthology.orchestra.run.smithi002.stdout:158913789976 2024-09-21T13:39:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 -- 172.21.15.2:0/363931712 >> v2:172.21.15.2:6800/2394073254 conn(0x7f03e007b110 msgr2=0x7f03e007d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 --2- 172.21.15.2:0/363931712 >> v2:172.21.15.2:6800/2394073254 conn(0x7f03e007b110 0x7f03e007d5d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f03f8111b40 tx=0x7f03ec005c90 comp rx=0 tx=0).stop 2024-09-21T13:39:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 -- 172.21.15.2:0/363931712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f8101860 msgr2=0x7f03f819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 --2- 172.21.15.2:0/363931712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f8101860 0x7f03f819ac30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03e800c920 tx=0x7f03e800cde0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 -- 172.21.15.2:0/363931712 shutdown_connections 2024-09-21T13:39:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 --2- 172.21.15.2:0/363931712 >> v2:172.21.15.2:6800/2394073254 conn(0x7f03e007b110 0x7f03e007d5d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 --2- 172.21.15.2:0/363931712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f810f410 0x7f03f81a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 --2- 172.21.15.2:0/363931712 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f03f8102180 0x7f03f819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 --2- 172.21.15.2:0/363931712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f8101860 0x7f03f819ac30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 -- 172.21.15.2:0/363931712 >> 172.21.15.2:0/363931712 conn(0x7f03f80fd6d0 msgr2=0x7f03f810fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 -- 172.21.15.2:0/363931712 shutdown_connections 2024-09-21T13:39:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.282+0000 7f03fddf2640 1 -- 172.21.15.2:0/363931712 wait complete. 2024-09-21T13:39:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.465+0000 7fb35191c640 1 -- 172.21.15.2:0/3954904872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb34c10aef0 con 0x7fb34c102d80 2024-09-21T13:39:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.465+0000 7fb35091a640 1 -- 172.21.15.2:0/3954904872 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb33c06ea00 con 0x7fb34c102d80 2024-09-21T13:39:36.465 INFO:teuthology.orchestra.run.smithi002.stdout:55834574893 2024-09-21T13:39:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 -- 172.21.15.2:0/3954904872 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb33807b110 msgr2=0x7fb33807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 --2- 172.21.15.2:0/3954904872 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb33807b110 0x7fb33807d5d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb334031440 tx=0x7fb3340058d0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 -- 172.21.15.2:0/3954904872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c102d80 msgr2=0x7fb34c198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 --2- 172.21.15.2:0/3954904872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c102d80 0x7fb34c198990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00e9f0 tx=0x7fb33c00eeb0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 -- 172.21.15.2:0/3954904872 shutdown_connections 2024-09-21T13:39:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 --2- 172.21.15.2:0/3954904872 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb33807b110 0x7fb33807d5d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 --2- 172.21.15.2:0/3954904872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb34c109110 0x7fb34c19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 --2- 172.21.15.2:0/3954904872 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb34c108790 0x7fb34c198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 --2- 172.21.15.2:0/3954904872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c102d80 0x7fb34c198990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 -- 172.21.15.2:0/3954904872 >> 172.21.15.2:0/3954904872 conn(0x7fb34c0fe7d0 msgr2=0x7fb34c100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:36.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 -- 172.21.15.2:0/3954904872 shutdown_connections 2024-09-21T13:39:36.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:36.467+0000 7fb35191c640 1 -- 172.21.15.2:0/3954904872 wait complete. 2024-09-21T13:39:36.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:36 smithi162 ceph-mon[33046]: pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T13:39:37.076 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574891 got 55834574893 for osd.1 2024-09-21T13:39:37.076 DEBUG:teuthology.parallel:result is None 2024-09-21T13:39:37.299 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/363931712' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T13:39:37.300 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3954904872' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T13:39:37.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/363931712' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T13:39:37.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3954904872' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T13:39:37.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/363931712' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T13:39:37.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3954904872' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T13:39:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.655+0000 7f125cf35640 1 -- 172.21.15.2:0/986233561 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f125810d0b0 msgr2=0x7f125810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.655+0000 7f125cf35640 1 --2- 172.21.15.2:0/986233561 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f125810d0b0 0x7f125810f520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1250009ca0 tx=0x7f125002a8c0 comp rx=0 tx=0).stop 2024-09-21T13:39:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.655+0000 7f125cf35640 1 -- 172.21.15.2:0/986233561 shutdown_connections 2024-09-21T13:39:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.655+0000 7f125cf35640 1 --2- 172.21.15.2:0/986233561 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f125810d0b0 0x7f125810f520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.655+0000 7f125cf35640 1 --2- 172.21.15.2:0/986233561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258104500 0x7f125810cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.655+0000 7f125cf35640 1 --2- 172.21.15.2:0/986233561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1258103b00 0x7f1258103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.655+0000 7f125cf35640 1 -- 172.21.15.2:0/986233561 >> 172.21.15.2:0/986233561 conn(0x7f12580fd6d0 msgr2=0x7f12580ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.655+0000 7f125cf35640 1 -- 172.21.15.2:0/986233561 shutdown_connections 2024-09-21T13:39:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.655+0000 7f125cf35640 1 -- 172.21.15.2:0/986233561 wait complete. 2024-09-21T13:39:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.656+0000 7f125cf35640 1 Processor -- start 2024-09-21T13:39:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.656+0000 7f125cf35640 1 -- start start 2024-09-21T13:39:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.656+0000 7f125cf35640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1258103b00 0x7f1258101980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125cf35640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258104500 0x7f1258101ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125cf35640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f125810d0b0 0x7f1258102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125cf35640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1258112440 con 0x7f1258103b00 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125cf35640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12581122c0 con 0x7f1258104500 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125cf35640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f12581125c0 con 0x7f125810d0b0 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1258103b00 0x7f1258101980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1258103b00 0x7f1258101980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51946/0 (socket says 172.21.15.2:51946) 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f1256d9d640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f125810d0b0 0x7f1258102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125659c640 1 -- 172.21.15.2:0/2282574844 learned_addr learned my addr 172.21.15.2:0/2282574844 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f1255d9b640 1 --2- 172.21.15.2:0/2282574844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258104500 0x7f1258101ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125659c640 1 -- 172.21.15.2:0/2282574844 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f125810d0b0 msgr2=0x7f1258102400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125659c640 1 --2- 172.21.15.2:0/2282574844 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f125810d0b0 0x7f1258102400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125659c640 1 -- 172.21.15.2:0/2282574844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258104500 msgr2=0x7f1258101ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125659c640 1 --2- 172.21.15.2:0/2282574844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258104500 0x7f1258101ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125659c640 1 -- 172.21.15.2:0/2282574844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12581a6cf0 con 0x7f1258103b00 2024-09-21T13:39:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f125659c640 1 --2- 172.21.15.2:0/2282574844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1258103b00 0x7f1258101980 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f124800ea60 tx=0x7f124800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.657+0000 7f12477fe640 1 -- 172.21.15.2:0/2282574844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124800cde0 con 0x7f1258103b00 2024-09-21T13:39:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.658+0000 7f125cf35640 1 -- 172.21.15.2:0/2282574844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12581a6fe0 con 0x7f1258103b00 2024-09-21T13:39:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.658+0000 7f12477fe640 1 -- 172.21.15.2:0/2282574844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f12480035f0 con 0x7f1258103b00 2024-09-21T13:39:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.658+0000 7f12477fe640 1 -- 172.21.15.2:0/2282574844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12480044a0 con 0x7f1258103b00 2024-09-21T13:39:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.658+0000 7f125cf35640 1 -- 172.21.15.2:0/2282574844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12581a7490 con 0x7f1258103b00 2024-09-21T13:39:37.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.659+0000 7f125cf35640 1 -- 172.21.15.2:0/2282574844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1258103ee0 con 0x7f1258103b00 2024-09-21T13:39:37.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.659+0000 7f12477fe640 1 -- 172.21.15.2:0/2282574844 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f1248004000 con 0x7f1258103b00 2024-09-21T13:39:37.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.660+0000 7f12477fe640 1 --2- 172.21.15.2:0/2282574844 >> v2:172.21.15.2:6800/2394073254 conn(0x7f124007b110 0x7f124007d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:37.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.660+0000 7f1255d9b640 1 --2- 172.21.15.2:0/2282574844 >> v2:172.21.15.2:6800/2394073254 conn(0x7f124007b110 0x7f124007d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:37.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.660+0000 7f12477fe640 1 -- 172.21.15.2:0/2282574844 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7f124809e650 con 0x7f1258103b00 2024-09-21T13:39:37.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.660+0000 7f1255d9b640 1 --2- 172.21.15.2:0/2282574844 >> v2:172.21.15.2:6800/2394073254 conn(0x7f124007b110 0x7f124007d5d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1258103470 tx=0x7f124c00b390 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:37.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.664+0000 7f12477fe640 1 -- 172.21.15.2:0/2282574844 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1248069c40 con 0x7f1258103b00 2024-09-21T13:39:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.855+0000 7f125cf35640 1 -- 172.21.15.2:0/2282574844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f12581a7720 con 0x7f1258103b00 2024-09-21T13:39:37.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.855+0000 7f12477fe640 1 -- 172.21.15.2:0/2282574844 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f124806eaf0 con 0x7f1258103b00 2024-09-21T13:39:37.856 INFO:teuthology.orchestra.run.smithi002.stdout:210453397516 2024-09-21T13:39:37.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.857+0000 7f125cf35640 1 -- 172.21.15.2:0/2282574844 >> v2:172.21.15.2:6800/2394073254 conn(0x7f124007b110 msgr2=0x7f124007d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:37.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.857+0000 7f125cf35640 1 --2- 172.21.15.2:0/2282574844 >> v2:172.21.15.2:6800/2394073254 conn(0x7f124007b110 0x7f124007d5d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1258103470 tx=0x7f124c00b390 comp rx=0 tx=0).stop 2024-09-21T13:39:37.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.857+0000 7f125cf35640 1 -- 172.21.15.2:0/2282574844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1258103b00 msgr2=0x7f1258101980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:37.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.857+0000 7f125cf35640 1 --2- 172.21.15.2:0/2282574844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1258103b00 0x7f1258101980 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f124800ea60 tx=0x7f124800ef20 comp rx=0 tx=0).stop 2024-09-21T13:39:37.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.858+0000 7f125cf35640 1 -- 172.21.15.2:0/2282574844 shutdown_connections 2024-09-21T13:39:37.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.858+0000 7f125cf35640 1 --2- 172.21.15.2:0/2282574844 >> v2:172.21.15.2:6800/2394073254 conn(0x7f124007b110 0x7f124007d5d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:37.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.858+0000 7f125cf35640 1 --2- 172.21.15.2:0/2282574844 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f125810d0b0 0x7f1258102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:37.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.858+0000 7f125cf35640 1 --2- 172.21.15.2:0/2282574844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258104500 0x7f1258101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:37.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.858+0000 7f125cf35640 1 --2- 172.21.15.2:0/2282574844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1258103b00 0x7f1258101980 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:37.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.858+0000 7f125cf35640 1 -- 172.21.15.2:0/2282574844 >> 172.21.15.2:0/2282574844 conn(0x7f12580fd6d0 msgr2=0x7f12580fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:37.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.858+0000 7f125cf35640 1 -- 172.21.15.2:0/2282574844 shutdown_connections 2024-09-21T13:39:37.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:37.858+0000 7f125cf35640 1 -- 172.21.15.2:0/2282574844 wait complete. 2024-09-21T13:39:38.251 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:38 smithi002 ceph-mon[30076]: pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T13:39:38.251 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2282574844' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T13:39:38.251 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:38 smithi002 ceph-mon[40622]: pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T13:39:38.251 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2282574844' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T13:39:38.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:38 smithi162 ceph-mon[33046]: pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T13:39:38.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2282574844' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T13:39:38.547 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397514 got 210453397516 for osd.7 2024-09-21T13:39:38.547 DEBUG:teuthology.parallel:result is None 2024-09-21T13:39:38.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:39:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:39 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:39 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:39.399 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593743 got 184683593744 for osd.6 2024-09-21T13:39:39.400 DEBUG:teuthology.parallel:result is None 2024-09-21T13:39:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:39.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:39 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:39.788 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789975 got 158913789976 for osd.5 2024-09-21T13:39:39.788 DEBUG:teuthology.parallel:result is None 2024-09-21T13:39:39.985 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:39:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:39:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.195+0000 7ff38236a640 1 -- 172.21.15.2:0/2399259835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff37c104560 msgr2=0x7ff37c10cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.195+0000 7ff38236a640 1 --2- 172.21.15.2:0/2399259835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff37c104560 0x7ff37c10cb40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff370009860 tx=0x7ff37002a340 comp rx=0 tx=0).stop 2024-09-21T13:39:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.195+0000 7ff38236a640 1 -- 172.21.15.2:0/2399259835 shutdown_connections 2024-09-21T13:39:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.195+0000 7ff38236a640 1 --2- 172.21.15.2:0/2399259835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff37c10d110 0x7ff37c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.195+0000 7ff38236a640 1 --2- 172.21.15.2:0/2399259835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff37c104560 0x7ff37c10cb40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.195+0000 7ff38236a640 1 --2- 172.21.15.2:0/2399259835 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff37c103b60 0x7ff37c103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.195+0000 7ff38236a640 1 -- 172.21.15.2:0/2399259835 >> 172.21.15.2:0/2399259835 conn(0x7ff37c0fd6d0 msgr2=0x7ff37c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.195+0000 7ff38236a640 1 -- 172.21.15.2:0/2399259835 shutdown_connections 2024-09-21T13:39:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.195+0000 7ff38236a640 1 -- 172.21.15.2:0/2399259835 wait complete. 2024-09-21T13:39:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff38236a640 1 Processor -- start 2024-09-21T13:39:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff38236a640 1 -- start start 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff38236a640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff37c103b60 0x7ff37c1019e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff38236a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff37c104560 0x7ff37c101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff38236a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff37c10d110 0x7ff37c102460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff38236a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff37c112440 con 0x7ff37c104560 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff38236a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff37c1122c0 con 0x7ff37c10d110 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff38236a640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7ff37c1125c0 con 0x7ff37c103b60 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff37bfff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff37c103b60 0x7ff37c1019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff37b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff37c104560 0x7ff37c101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff37bfff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff37c103b60 0x7ff37c1019e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:47728/0 (socket says 172.21.15.2:47728) 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff37b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff37c104560 0x7ff37c101f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51954/0 (socket says 172.21.15.2:51954) 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff37bfff640 1 -- 172.21.15.2:0/4284814983 learned_addr learned my addr 172.21.15.2:0/4284814983 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.196+0000 7ff380907640 1 --2- 172.21.15.2:0/4284814983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff37c10d110 0x7ff37c102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.197+0000 7ff37bfff640 1 -- 172.21.15.2:0/4284814983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff37c10d110 msgr2=0x7ff37c102460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.197+0000 7ff37bfff640 1 --2- 172.21.15.2:0/4284814983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff37c10d110 0x7ff37c102460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.197+0000 7ff37bfff640 1 -- 172.21.15.2:0/4284814983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff37c104560 msgr2=0x7ff37c101f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.197+0000 7ff37bfff640 1 --2- 172.21.15.2:0/4284814983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff37c104560 0x7ff37c101f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.197+0000 7ff37bfff640 1 -- 172.21.15.2:0/4284814983 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37c1a6da0 con 0x7ff37c103b60 2024-09-21T13:39:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.197+0000 7ff37bfff640 1 --2- 172.21.15.2:0/4284814983 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff37c103b60 0x7ff37c1019e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00e9c0 tx=0x7ff36c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.197+0000 7ff3797fa640 1 -- 172.21.15.2:0/4284814983 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00cde0 con 0x7ff37c103b60 2024-09-21T13:39:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.197+0000 7ff3797fa640 1 -- 172.21.15.2:0/4284814983 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff36c0035f0 con 0x7ff37c103b60 2024-09-21T13:39:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.197+0000 7ff38236a640 1 -- 172.21.15.2:0/4284814983 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff37c1a7090 con 0x7ff37c103b60 2024-09-21T13:39:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.197+0000 7ff3797fa640 1 -- 172.21.15.2:0/4284814983 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c0044a0 con 0x7ff37c103b60 2024-09-21T13:39:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.197+0000 7ff38236a640 1 -- 172.21.15.2:0/4284814983 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff37c1a75a0 con 0x7ff37c103b60 2024-09-21T13:39:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.198+0000 7ff38236a640 1 -- 172.21.15.2:0/4284814983 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff37c103f40 con 0x7ff37c103b60 2024-09-21T13:39:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.199+0000 7ff3797fa640 1 -- 172.21.15.2:0/4284814983 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7ff36c004000 con 0x7ff37c103b60 2024-09-21T13:39:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.199+0000 7ff3797fa640 1 --2- 172.21.15.2:0/4284814983 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff36407b110 0x7ff36407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.199+0000 7ff3797fa640 1 -- 172.21.15.2:0/4284814983 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7ff36c09e630 con 0x7ff37c103b60 2024-09-21T13:39:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.199+0000 7ff37b7fe640 1 --2- 172.21.15.2:0/4284814983 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff36407b110 0x7ff36407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.200+0000 7ff37b7fe640 1 --2- 172.21.15.2:0/4284814983 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff36407b110 0x7ff36407d5d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff37002a930 tx=0x7ff3700056d0 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:40.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.204+0000 7ff3797fa640 1 -- 172.21.15.2:0/4284814983 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff36c069c20 con 0x7ff37c103b60 2024-09-21T13:39:40.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:40 smithi002 ceph-mon[30076]: pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T13:39:40.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:40 smithi002 ceph-mon[40622]: pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T13:39:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.465+0000 7ff38236a640 1 -- 172.21.15.2:0/4284814983 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff37c107890 con 0x7ff37c103b60 2024-09-21T13:39:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.465+0000 7ff3797fa640 1 -- 172.21.15.2:0/4284814983 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff36c06ead0 con 0x7ff37c103b60 2024-09-21T13:39:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:133143986206 2024-09-21T13:39:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.467+0000 7ff38236a640 1 -- 172.21.15.2:0/4284814983 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff36407b110 msgr2=0x7ff36407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.467+0000 7ff38236a640 1 --2- 172.21.15.2:0/4284814983 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff36407b110 0x7ff36407d5d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff37002a930 tx=0x7ff3700056d0 comp rx=0 tx=0).stop 2024-09-21T13:39:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.467+0000 7ff38236a640 1 -- 172.21.15.2:0/4284814983 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff37c103b60 msgr2=0x7ff37c1019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.467+0000 7ff38236a640 1 --2- 172.21.15.2:0/4284814983 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff37c103b60 0x7ff37c1019e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00e9c0 tx=0x7ff36c00ee80 comp rx=0 tx=0).stop 2024-09-21T13:39:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.468+0000 7ff38236a640 1 -- 172.21.15.2:0/4284814983 shutdown_connections 2024-09-21T13:39:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.468+0000 7ff38236a640 1 --2- 172.21.15.2:0/4284814983 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff36407b110 0x7ff36407d5d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.468+0000 7ff38236a640 1 --2- 172.21.15.2:0/4284814983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff37c10d110 0x7ff37c102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.468+0000 7ff38236a640 1 --2- 172.21.15.2:0/4284814983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff37c104560 0x7ff37c101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.468+0000 7ff38236a640 1 --2- 172.21.15.2:0/4284814983 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff37c103b60 0x7ff37c1019e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.468+0000 7ff38236a640 1 -- 172.21.15.2:0/4284814983 >> 172.21.15.2:0/4284814983 conn(0x7ff37c0fd6d0 msgr2=0x7ff37c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.468+0000 7ff38236a640 1 -- 172.21.15.2:0/4284814983 shutdown_connections 2024-09-21T13:39:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:40.468+0000 7ff38236a640 1 -- 172.21.15.2:0/4284814983 wait complete. 2024-09-21T13:39:40.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:40 smithi162 ceph-mon[33046]: pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T13:39:41.100 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986204 got 133143986206 for osd.4 2024-09-21T13:39:41.100 DEBUG:teuthology.parallel:result is None 2024-09-21T13:39:41.100 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T13:39:41.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T13:39:41.380 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:41.675 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4284814983' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T13:39:41.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:39:41.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4284814983' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:39:41.677 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:39:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4284814983' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T13:39:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T13:39:41.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:41.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:39:41.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:39:41.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.932+0000 7f9a1106e640 1 -- 172.21.15.2:0/2373882977 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9a0c10d0d0 msgr2=0x7f9a0c10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:41.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.932+0000 7f9a1106e640 1 --2- 172.21.15.2:0/2373882977 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9a0c10d0d0 0x7f9a0c10f530 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009ca0 tx=0x7f9a0402a8c0 comp rx=0 tx=0).stop 2024-09-21T13:39:41.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.932+0000 7f9a1106e640 1 -- 172.21.15.2:0/2373882977 shutdown_connections 2024-09-21T13:39:41.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.932+0000 7f9a1106e640 1 --2- 172.21.15.2:0/2373882977 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9a0c10d0d0 0x7f9a0c10f530 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:41.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.932+0000 7f9a1106e640 1 --2- 172.21.15.2:0/2373882977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0c104590 0x7f9a0c10ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:41.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.932+0000 7f9a1106e640 1 --2- 172.21.15.2:0/2373882977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c103c70 0x7f9a0c104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:41.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.932+0000 7f9a1106e640 1 -- 172.21.15.2:0/2373882977 >> 172.21.15.2:0/2373882977 conn(0x7f9a0c0fd6d0 msgr2=0x7f9a0c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:41.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.932+0000 7f9a1106e640 1 -- 172.21.15.2:0/2373882977 shutdown_connections 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.932+0000 7f9a1106e640 1 -- 172.21.15.2:0/2373882977 wait complete. 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.933+0000 7f9a1106e640 1 Processor -- start 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.933+0000 7f9a1106e640 1 -- start start 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.933+0000 7f9a1106e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c103c70 0x7f9a0c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.933+0000 7f9a1106e640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9a0c104590 0x7f9a0c198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.933+0000 7f9a1106e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0c10d0d0 0x7f9a0c19e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.933+0000 7f9a1106e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c112450 con 0x7f9a0c103c70 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.933+0000 7f9a1106e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c1122d0 con 0x7f9a0c10d0d0 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.933+0000 7f9a1106e640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0c1125d0 con 0x7f9a0c104590 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c103c70 0x7f9a0c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0a59c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9a0c104590 0x7f9a0c198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c103c70 0x7f9a0c198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51978/0 (socket says 172.21.15.2:51978) 2024-09-21T13:39:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0ad9d640 1 -- 172.21.15.2:0/1384154304 learned_addr learned my addr 172.21.15.2:0/1384154304 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0b59e640 1 --2- 172.21.15.2:0/1384154304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0c10d0d0 0x7f9a0c19e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0ad9d640 1 -- 172.21.15.2:0/1384154304 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9a0c104590 msgr2=0x7f9a0c198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0ad9d640 1 --2- 172.21.15.2:0/1384154304 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9a0c104590 0x7f9a0c198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0ad9d640 1 -- 172.21.15.2:0/1384154304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0c10d0d0 msgr2=0x7f9a0c19e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0ad9d640 1 --2- 172.21.15.2:0/1384154304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0c10d0d0 0x7f9a0c19e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0ad9d640 1 -- 172.21.15.2:0/1384154304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c19e9b0 con 0x7f9a0c103c70 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0a59c640 1 --2- 172.21.15.2:0/1384154304 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9a0c104590 0x7f9a0c198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0b59e640 1 --2- 172.21.15.2:0/1384154304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0c10d0d0 0x7f9a0c19e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f9a0ad9d640 1 --2- 172.21.15.2:0/1384154304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c103c70 0x7f9a0c198900 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00ea60 tx=0x7f99fc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.934+0000 7f99f3fff640 1 -- 172.21.15.2:0/1384154304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00cde0 con 0x7f9a0c103c70 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.935+0000 7f9a1106e640 1 -- 172.21.15.2:0/1384154304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0c19eca0 con 0x7f9a0c103c70 2024-09-21T13:39:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.935+0000 7f99f3fff640 1 -- 172.21.15.2:0/1384154304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f99fc0035f0 con 0x7f9a0c103c70 2024-09-21T13:39:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.935+0000 7f99f3fff640 1 -- 172.21.15.2:0/1384154304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0044a0 con 0x7f9a0c103c70 2024-09-21T13:39:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.935+0000 7f9a1106e640 1 -- 172.21.15.2:0/1384154304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0c1a5530 con 0x7f9a0c103c70 2024-09-21T13:39:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.936+0000 7f9a1106e640 1 -- 172.21.15.2:0/1384154304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0c104050 con 0x7f9a0c103c70 2024-09-21T13:39:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.937+0000 7f99f3fff640 1 -- 172.21.15.2:0/1384154304 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f99fc004000 con 0x7f9a0c103c70 2024-09-21T13:39:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.937+0000 7f99f3fff640 1 --2- 172.21.15.2:0/1384154304 >> v2:172.21.15.2:6800/2394073254 conn(0x7f99f407b110 0x7f99f407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.937+0000 7f99f3fff640 1 -- 172.21.15.2:0/1384154304 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7f99fc09e650 con 0x7f9a0c103c70 2024-09-21T13:39:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.938+0000 7f9a0a59c640 1 --2- 172.21.15.2:0/1384154304 >> v2:172.21.15.2:6800/2394073254 conn(0x7f99f407b110 0x7f99f407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.938+0000 7f9a0a59c640 1 --2- 172.21.15.2:0/1384154304 >> v2:172.21.15.2:6800/2394073254 conn(0x7f99f407b110 0x7f99f407d5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c101290 tx=0x7f9a0000b2e0 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:41.942+0000 7f99f3fff640 1 -- 172.21.15.2:0/1384154304 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99fc069c40 con 0x7f9a0c103c70 2024-09-21T13:39:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.163+0000 7f9a1106e640 1 -- 172.21.15.2:0/1384154304 --> v2:172.21.15.2:6800/2394073254 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a0c0ff9f0 con 0x7f99f407b110 2024-09-21T13:39:42.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.169+0000 7f99f3fff640 1 -- 172.21.15.2:0/1384154304 <== mgr.14607 v2:172.21.15.2:6800/2394073254 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346461 (secure 0 0 0) 0x7f9a0c0ff9f0 con 0x7f99f407b110 2024-09-21T13:39:42.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:39:42.175 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-21T13:39:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 -- 172.21.15.2:0/1384154304 >> v2:172.21.15.2:6800/2394073254 conn(0x7f99f407b110 msgr2=0x7f99f407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 --2- 172.21.15.2:0/1384154304 >> v2:172.21.15.2:6800/2394073254 conn(0x7f99f407b110 0x7f99f407d5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c101290 tx=0x7f9a0000b2e0 comp rx=0 tx=0).stop 2024-09-21T13:39:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 -- 172.21.15.2:0/1384154304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c103c70 msgr2=0x7f9a0c198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 --2- 172.21.15.2:0/1384154304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c103c70 0x7f9a0c198900 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00ea60 tx=0x7f99fc00ef20 comp rx=0 tx=0).stop 2024-09-21T13:39:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 -- 172.21.15.2:0/1384154304 shutdown_connections 2024-09-21T13:39:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 --2- 172.21.15.2:0/1384154304 >> v2:172.21.15.2:6800/2394073254 conn(0x7f99f407b110 0x7f99f407d5d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 --2- 172.21.15.2:0/1384154304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0c10d0d0 0x7f9a0c19e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 --2- 172.21.15.2:0/1384154304 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9a0c104590 0x7f9a0c198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:42.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 --2- 172.21.15.2:0/1384154304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c103c70 0x7f9a0c198900 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:42.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 -- 172.21.15.2:0/1384154304 >> 172.21.15.2:0/1384154304 conn(0x7f9a0c0fd6d0 msgr2=0x7f9a0c0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:42.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 -- 172.21.15.2:0/1384154304 shutdown_connections 2024-09-21T13:39:42.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:42.173+0000 7f9a1106e640 1 -- 172.21.15.2:0/1384154304 wait complete. 2024-09-21T13:39:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi002 to 3761M 2024-09-21T13:39:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-21T13:39:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T13:39:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: Updating smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:39:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:39:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T13:39:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:39:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:39:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T13:39:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: Updating smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T13:39:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[30076]: Deploying daemon alertmanager.a on smithi002 2024-09-21T13:39:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi002 to 3761M 2024-09-21T13:39:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-21T13:39:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T13:39:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: Updating smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:39:42.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:39:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T13:39:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:39:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:39:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T13:39:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: Updating smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T13:39:42.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:42 smithi002 ceph-mon[40622]: Deploying daemon alertmanager.a on smithi002 2024-09-21T13:39:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-21T13:39:41.427569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":883,"num_read_kb":740,"num_write":549,"num_write_kb":1673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":552,"ondisk_log_size":552,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":239600,"kb_used_data":6748,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":749721616,"statfs":{"total":767960285184,"available":767714934784,"internally_reserved":0,"allocated":6909952,"data_stored":3694729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":186,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003006"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710679+0000","last_change":"2024-09-21T13:38:57.652668+0000","last_active":"2024-09-21T13:39:27.710679+0000","last_peered":"2024-09-21T13:39:27.710679+0000","last_clean":"2024-09-21T13:39:27.710679+0000","last_became_active":"2024-09-21T13:38:57.651883+0000","last_became_peered":"2024-09-21T13:38:57.651883+0000","last_unstale":"2024-09-21T13:39:27.710679+0000","last_undegraded":"2024-09-21T13:39:27.710679+0000","last_fullsized":"2024-09-21T13:39:27.710679+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:07.061037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711825+0000","last_change":"2024-09-21T13:38:59.660861+0000","last_active":"2024-09-21T13:39:27.711825+0000","last_peered":"2024-09-21T13:39:27.711825+0000","last_clean":"2024-09-21T13:39:27.711825+0000","last_became_active":"2024-09-21T13:38:59.660471+0000","last_became_peered":"2024-09-21T13:38:59.660471+0000","last_unstale":"2024-09-21T13:39:27.711825+0000","last_undegraded":"2024-09-21T13:39:27.711825+0000","last_fullsized":"2024-09-21T13:39:27.711825+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:04.142420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709924+0000","last_change":"2024-09-21T13:39:01.676745+0000","last_active":"2024-09-21T13:39:27.709924+0000","last_peered":"2024-09-21T13:39:27.709924+0000","last_clean":"2024-09-21T13:39:27.709924+0000","last_became_active":"2024-09-21T13:39:01.676443+0000","last_became_peered":"2024-09-21T13:39:01.676443+0000","last_unstale":"2024-09-21T13:39:27.709924+0000","last_undegraded":"2024-09-21T13:39:27.709924+0000","last_fullsized":"2024-09-21T13:39:27.709924+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:08:29.869404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710899+0000","last_change":"2024-09-21T13:39:03.692384+0000","last_active":"2024-09-21T13:39:27.710899+0000","last_peered":"2024-09-21T13:39:27.710899+0000","last_clean":"2024-09-21T13:39:27.710899+0000","last_became_active":"2024-09-21T13:39:03.690771+0000","last_became_peered":"2024-09-21T13:39:03.690771+0000","last_unstale":"2024-09-21T13:39:27.710899+0000","last_undegraded":"2024-09-21T13:39:27.710899+0000","last_fullsized":"2024-09-21T13:39:27.710899+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:08.467765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414367+0000","last_change":"2024-09-21T13:39:03.694775+0000","last_active":"2024-09-21T13:39:27.414367+0000","last_peered":"2024-09-21T13:39:27.414367+0000","last_clean":"2024-09-21T13:39:27.414367+0000","last_became_active":"2024-09-21T13:39:03.687363+0000","last_became_peered":"2024-09-21T13:39:03.687363+0000","last_unstale":"2024-09-21T13:39:27.414367+0000","last_undegraded":"2024-09-21T13:39:27.414367+0000","last_fullsized":"2024-09-21T13:39:27.414367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:05.078737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416371+0000","last_change":"2024-09-21T13:38:57.654567+0000","last_active":"2024-09-21T13:39:27.416371+0000","last_peered":"2024-09-21T13:39:27.416371+0000","last_clean":"2024-09-21T13:39:27.416371+0000","last_became_active":"2024-09-21T13:38:57.654298+0000","last_became_peered":"2024-09-21T13:38:57.654298+0000","last_unstale":"2024-09-21T13:39:27.416371+0000","last_undegraded":"2024-09-21T13:39:27.416371+0000","last_fullsized":"2024-09-21T13:39:27.416371+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:42.011115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"61'15","reported_seq":51,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414919+0000","last_change":"2024-09-21T13:38:59.652263+0000","last_active":"2024-09-21T13:39:27.414919+0000","last_peered":"2024-09-21T13:39:27.414919+0000","last_clean":"2024-09-21T13:39:27.414919+0000","last_became_active":"2024-09-21T13:38:59.651930+0000","last_became_peered":"2024-09-21T13:38:59.651930+0000","last_unstale":"2024-09-21T13:39:27.414919+0000","last_undegraded":"2024-09-21T13:39:27.414919+0000","last_fullsized":"2024-09-21T13:39:27.414919+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:46.654124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711713+0000","last_change":"2024-09-21T13:39:01.676569+0000","last_active":"2024-09-21T13:39:27.711713+0000","last_peered":"2024-09-21T13:39:27.711713+0000","last_clean":"2024-09-21T13:39:27.711713+0000","last_became_active":"2024-09-21T13:39:01.676331+0000","last_became_peered":"2024-09-21T13:39:01.676331+0000","last_unstale":"2024-09-21T13:39:27.711713+0000","last_undegraded":"2024-09-21T13:39:27.711713+0000","last_fullsized":"2024-09-21T13:39:27.711713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:37:24.808617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711425+0000","last_change":"2024-09-21T13:38:57.647233+0000","last_active":"2024-09-21T13:39:27.711425+0000","last_peered":"2024-09-21T13:39:27.711425+0000","last_clean":"2024-09-21T13:39:27.711425+0000","last_became_active":"2024-09-21T13:38:57.646918+0000","last_became_peered":"2024-09-21T13:38:57.646918+0000","last_unstale":"2024-09-21T13:39:27.711425+0000","last_undegraded":"2024-09-21T13:39:27.711425+0000","last_fullsized":"2024-09-21T13:39:27.711425+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:11.989903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711155+0000","last_change":"2024-09-21T13:38:59.651688+0000","last_active":"2024-09-21T13:39:27.711155+0000","last_peered":"2024-09-21T13:39:27.711155+0000","last_clean":"2024-09-21T13:39:27.711155+0000","last_became_active":"2024-09-21T13:38:59.651100+0000","last_became_peered":"2024-09-21T13:38:59.651100+0000","last_unstale":"2024-09-21T13:39:27.711155+0000","last_undegraded":"2024-09-21T13:39:27.711155+0000","last_fullsized":"2024-09-21T13:39:27.711155+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:08:57.230493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710062+0000","last_change":"2024-09-21T13:39:01.679132+0000","last_active":"2024-09-21T13:39:27.710062+0000","last_peered":"2024-09-21T13:39:27.710062+0000","last_clean":"2024-09-21T13:39:27.710062+0000","last_became_active":"2024-09-21T13:39:01.678817+0000","last_became_peered":"2024-09-21T13:39:01.678817+0000","last_unstale":"2024-09-21T13:39:27.710062+0000","last_undegraded":"2024-09-21T13:39:27.710062+0000","last_fullsized":"2024-09-21T13:39:27.710062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:17:49.590743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711210+0000","last_change":"2024-09-21T13:39:03.691789+0000","last_active":"2024-09-21T13:39:27.711210+0000","last_peered":"2024-09-21T13:39:27.711210+0000","last_clean":"2024-09-21T13:39:27.711210+0000","last_became_active":"2024-09-21T13:39:03.691431+0000","last_became_peered":"2024-09-21T13:39:03.691431+0000","last_unstale":"2024-09-21T13:39:27.711210+0000","last_undegraded":"2024-09-21T13:39:27.711210+0000","last_fullsized":"2024-09-21T13:39:27.711210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:20.741822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710137+0000","last_change":"2024-09-21T13:38:57.653620+0000","last_active":"2024-09-21T13:39:27.710137+0000","last_peered":"2024-09-21T13:39:27.710137+0000","last_clean":"2024-09-21T13:39:27.710137+0000","last_became_active":"2024-09-21T13:38:57.653286+0000","last_became_peered":"2024-09-21T13:38:57.653286+0000","last_unstale":"2024-09-21T13:39:27.710137+0000","last_undegraded":"2024-09-21T13:39:27.710137+0000","last_fullsized":"2024-09-21T13:39:27.710137+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:05:56.567983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"61'5","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710980+0000","last_change":"2024-09-21T13:38:59.661169+0000","last_active":"2024-09-21T13:39:27.710980+0000","last_peered":"2024-09-21T13:39:27.710980+0000","last_clean":"2024-09-21T13:39:27.710980+0000","last_became_active":"2024-09-21T13:38:59.660514+0000","last_became_peered":"2024-09-21T13:38:59.660514+0000","last_unstale":"2024-09-21T13:39:27.710980+0000","last_undegraded":"2024-09-21T13:39:27.710980+0000","last_fullsized":"2024-09-21T13:39:27.710980+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:26.457569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416730+0000","last_change":"2024-09-21T13:39:01.681895+0000","last_active":"2024-09-21T13:39:27.416730+0000","last_peered":"2024-09-21T13:39:27.416730+0000","last_clean":"2024-09-21T13:39:27.416730+0000","last_became_active":"2024-09-21T13:39:01.681590+0000","last_became_peered":"2024-09-21T13:39:01.681590+0000","last_unstale":"2024-09-21T13:39:27.416730+0000","last_undegraded":"2024-09-21T13:39:27.416730+0000","last_fullsized":"2024-09-21T13:39:27.416730+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:42:18.974778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709087+0000","last_change":"2024-09-21T13:39:03.692723+0000","last_active":"2024-09-21T13:39:27.709087+0000","last_peered":"2024-09-21T13:39:27.709087+0000","last_clean":"2024-09-21T13:39:27.709087+0000","last_became_active":"2024-09-21T13:39:03.692319+0000","last_became_peered":"2024-09-21T13:39:03.692319+0000","last_unstale":"2024-09-21T13:39:27.709087+0000","last_undegraded":"2024-09-21T13:39:27.709087+0000","last_fullsized":"2024-09-21T13:39:27.709087+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:34.617850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711793+0000","last_change":"2024-09-21T13:39:03.686938+0000","last_active":"2024-09-21T13:39:27.711793+0000","last_peered":"2024-09-21T13:39:27.711793+0000","last_clean":"2024-09-21T13:39:27.711793+0000","last_became_active":"2024-09-21T13:39:03.686649+0000","last_became_peered":"2024-09-21T13:39:03.686649+0000","last_unstale":"2024-09-21T13:39:27.711793+0000","last_undegraded":"2024-09-21T13:39:27.711793+0000","last_fullsized":"2024-09-21T13:39:27.711793+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:33.033587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712928+0000","last_change":"2024-09-21T13:38:57.648238+0000","last_active":"2024-09-21T13:39:27.712928+0000","last_peered":"2024-09-21T13:39:27.712928+0000","last_clean":"2024-09-21T13:39:27.712928+0000","last_became_active":"2024-09-21T13:38:57.647482+0000","last_became_peered":"2024-09-21T13:38:57.647482+0000","last_unstale":"2024-09-21T13:39:27.712928+0000","last_undegraded":"2024-09-21T13:39:27.712928+0000","last_fullsized":"2024-09-21T13:39:27.712928+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:01:34.707995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"61'15","reported_seq":51,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416012+0000","last_change":"2024-09-21T13:38:59.656652+0000","last_active":"2024-09-21T13:39:27.416012+0000","last_peered":"2024-09-21T13:39:27.416012+0000","last_clean":"2024-09-21T13:39:27.416012+0000","last_became_active":"2024-09-21T13:38:59.656238+0000","last_became_peered":"2024-09-21T13:38:59.656238+0000","last_unstale":"2024-09-21T13:39:27.416012+0000","last_undegraded":"2024-09-21T13:39:27.416012+0000","last_fullsized":"2024-09-21T13:39:27.416012+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:58:32.310250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711036+0000","last_change":"2024-09-21T13:39:01.685632+0000","last_active":"2024-09-21T13:39:27.711036+0000","last_peered":"2024-09-21T13:39:27.711036+0000","last_clean":"2024-09-21T13:39:27.711036+0000","last_became_active":"2024-09-21T13:39:01.685080+0000","last_became_peered":"2024-09-21T13:39:01.685080+0000","last_unstale":"2024-09-21T13:39:27.711036+0000","last_undegraded":"2024-09-21T13:39:27.711036+0000","last_fullsized":"2024-09-21T13:39:27.711036+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:17.920636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416471+0000","last_change":"2024-09-21T13:39:03.688577+0000","last_active":"2024-09-21T13:39:27.416471+0000","last_peered":"2024-09-21T13:39:27.416471+0000","last_clean":"2024-09-21T13:39:27.416471+0000","last_became_active":"2024-09-21T13:39:03.688283+0000","last_became_peered":"2024-09-21T13:39:03.688283+0000","last_unstale":"2024-09-21T13:39:27.416471+0000","last_undegraded":"2024-09-21T13:39:27.416471+0000","last_fullsized":"2024-09-21T13:39:27.416471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:21:58.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"54'2","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711309+0000","last_change":"2024-09-21T13:38:57.645402+0000","last_active":"2024-09-21T13:39:27.711309+0000","last_peered":"2024-09-21T13:39:27.711309+0000","last_clean":"2024-09-21T13:39:27.711309+0000","last_became_active":"2024-09-21T13:38:57.645079+0000","last_became_peered":"2024-09-21T13:38:57.645079+0000","last_unstale":"2024-09-21T13:39:27.711309+0000","last_undegraded":"2024-09-21T13:39:27.711309+0000","last_fullsized":"2024-09-21T13:39:27.711309+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:48.562578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"61'12","reported_seq":49,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.415645+0000","last_change":"2024-09-21T13:38:59.659212+0000","last_active":"2024-09-21T13:39:27.415645+0000","last_peered":"2024-09-21T13:39:27.415645+0000","last_clean":"2024-09-21T13:39:27.415645+0000","last_became_active":"2024-09-21T13:38:59.658620+0000","last_became_peered":"2024-09-21T13:38:59.658620+0000","last_unstale":"2024-09-21T13:39:27.415645+0000","last_undegraded":"2024-09-21T13:39:27.415645+0000","last_fullsized":"2024-09-21T13:39:27.415645+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:24.108982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711186+0000","last_change":"2024-09-21T13:39:01.677191+0000","last_active":"2024-09-21T13:39:27.711186+0000","last_peered":"2024-09-21T13:39:27.711186+0000","last_clean":"2024-09-21T13:39:27.711186+0000","last_became_active":"2024-09-21T13:39:01.676778+0000","last_became_peered":"2024-09-21T13:39:01.676778+0000","last_unstale":"2024-09-21T13:39:27.711186+0000","last_undegraded":"2024-09-21T13:39:27.711186+0000","last_fullsized":"2024-09-21T13:39:27.711186+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:24.984729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"61'1","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416894+0000","last_change":"2024-09-21T13:39:03.690615+0000","last_active":"2024-09-21T13:39:27.416894+0000","last_peered":"2024-09-21T13:39:27.416894+0000","last_clean":"2024-09-21T13:39:27.416894+0000","last_became_active":"2024-09-21T13:39:03.690326+0000","last_became_peered":"2024-09-21T13:39:03.690326+0000","last_unstale":"2024-09-21T13:39:27.416894+0000","last_undegraded":"2024-09-21T13:39:27.416894+0000","last_fullsized":"2024-09-21T13:39:27.416894+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:46:59.408341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"54'1","reported_seq":31,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709825+0000","last_change":"2024-09-21T13:38:57.648548+0000","last_active":"2024-09-21T13:39:27.709825+0000","last_peered":"2024-09-21T13:39:27.709825+0000","last_clean":"2024-09-21T13:39:27.709825+0000","last_became_active":"2024-09-21T13:38:57.648247+0000","last_became_peered":"2024-09-21T13:38:57.648247+0000","last_unstale":"2024-09-21T13:39:27.709825+0000","last_undegraded":"2024-09-21T13:39:27.709825+0000","last_fullsized":"2024-09-21T13:39:27.709825+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:21:57.402439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"61'10","reported_seq":41,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712282+0000","last_change":"2024-09-21T13:38:59.792735+0000","last_active":"2024-09-21T13:39:27.712282+0000","last_peered":"2024-09-21T13:39:27.712282+0000","last_clean":"2024-09-21T13:39:27.712282+0000","last_became_active":"2024-09-21T13:38:59.792396+0000","last_became_peered":"2024-09-21T13:38:59.792396+0000","last_unstale":"2024-09-21T13:39:27.712282+0000","last_undegraded":"2024-09-21T13:39:27.712282+0000","last_fullsized":"2024-09-21T13:39:27.712282+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:03.202359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"61'8","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709149+0000","last_change":"2024-09-21T13:39:01.676568+0000","last_active":"2024-09-21T13:39:32.709149+0000","last_peered":"2024-09-21T13:39:32.709149+0000","last_clean":"2024-09-21T13:39:32.709149+0000","last_became_active":"2024-09-21T13:39:01.674558+0000","last_became_peered":"2024-09-21T13:39:01.674558+0000","last_unstale":"2024-09-21T13:39:32.709149+0000","last_undegraded":"2024-09-21T13:39:32.709149+0000","last_fullsized":"2024-09-21T13:39:32.709149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:19:45.773500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"61'15","reported_seq":51,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711416+0000","last_change":"2024-09-21T13:38:59.662120+0000","last_active":"2024-09-21T13:39:27.711416+0000","last_peered":"2024-09-21T13:39:27.711416+0000","last_clean":"2024-09-21T13:39:27.711416+0000","last_became_active":"2024-09-21T13:38:59.661827+0000","last_became_peered":"2024-09-21T13:38:59.661827+0000","last_unstale":"2024-09-21T13:39:27.711416+0000","last_undegraded":"2024-09-21T13:39:27.711416+0000","last_fullsized":"2024-09-21T13:39:27.711416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:51.551677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414709+0000","last_change":"2024-09-21T13:38:57.647793+0000","last_active":"2024-09-21T13:39:27.414709+0000","last_peered":"2024-09-21T13:39:27.414709+0000","last_clean":"2024-09-21T13:39:27.414709+0000","last_became_active":"2024-09-21T13:38:57.647473+0000","last_became_peered":"2024-09-21T13:38:57.647473+0000","last_unstale":"2024-09-21T13:39:27.414709+0000","last_undegraded":"2024-09-21T13:39:27.414709+0000","last_fullsized":"2024-09-21T13:39:27.414709+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:25:29.767080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709141+0000","last_change":"2024-09-21T13:39:01.679661+0000","last_active":"2024-09-21T13:39:32.709141+0000","last_peered":"2024-09-21T13:39:32.709141+0000","last_clean":"2024-09-21T13:39:32.709141+0000","last_became_active":"2024-09-21T13:39:01.679360+0000","last_became_peered":"2024-09-21T13:39:01.679360+0000","last_unstale":"2024-09-21T13:39:32.709141+0000","last_undegraded":"2024-09-21T13:39:32.709141+0000","last_fullsized":"2024-09-21T13:39:32.709141+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:44:12.275781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710820+0000","last_change":"2024-09-21T13:39:03.690094+0000","last_active":"2024-09-21T13:39:27.710820+0000","last_peered":"2024-09-21T13:39:27.710820+0000","last_clean":"2024-09-21T13:39:27.710820+0000","last_became_active":"2024-09-21T13:39:03.689824+0000","last_became_peered":"2024-09-21T13:39:03.689824+0000","last_unstale":"2024-09-21T13:39:27.710820+0000","last_undegraded":"2024-09-21T13:39:27.710820+0000","last_fullsized":"2024-09-21T13:39:27.710820+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:13:58.061595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"61'18","reported_seq":58,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414420+0000","last_change":"2024-09-21T13:38:59.789784+0000","last_active":"2024-09-21T13:39:27.414420+0000","last_peered":"2024-09-21T13:39:27.414420+0000","last_clean":"2024-09-21T13:39:27.414420+0000","last_became_active":"2024-09-21T13:38:59.789144+0000","last_became_peered":"2024-09-21T13:38:59.789144+0000","last_unstale":"2024-09-21T13:39:27.414420+0000","last_undegraded":"2024-09-21T13:39:27.414420+0000","last_fullsized":"2024-09-21T13:39:27.414420+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:12:08.530369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416877+0000","last_change":"2024-09-21T13:38:57.650742+0000","last_active":"2024-09-21T13:39:27.416877+0000","last_peered":"2024-09-21T13:39:27.416877+0000","last_clean":"2024-09-21T13:39:27.416877+0000","last_became_active":"2024-09-21T13:38:57.650407+0000","last_became_peered":"2024-09-21T13:38:57.650407+0000","last_unstale":"2024-09-21T13:39:27.416877+0000","last_undegraded":"2024-09-21T13:39:27.416877+0000","last_fullsized":"2024-09-21T13:39:27.416877+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:27:53.726110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711733+0000","last_change":"2024-09-21T13:39:01.676163+0000","last_active":"2024-09-21T13:39:27.711733+0000","last_peered":"2024-09-21T13:39:27.711733+0000","last_clean":"2024-09-21T13:39:27.711733+0000","last_became_active":"2024-09-21T13:39:01.675737+0000","last_became_peered":"2024-09-21T13:39:01.675737+0000","last_unstale":"2024-09-21T13:39:27.711733+0000","last_undegraded":"2024-09-21T13:39:27.711733+0000","last_fullsized":"2024-09-21T13:39:27.711733+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:01:41.504495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.708994+0000","last_change":"2024-09-21T13:39:03.686911+0000","last_active":"2024-09-21T13:39:27.708994+0000","last_peered":"2024-09-21T13:39:27.708994+0000","last_clean":"2024-09-21T13:39:27.708994+0000","last_became_active":"2024-09-21T13:39:03.686618+0000","last_became_peered":"2024-09-21T13:39:03.686618+0000","last_unstale":"2024-09-21T13:39:27.708994+0000","last_undegraded":"2024-09-21T13:39:27.708994+0000","last_fullsized":"2024-09-21T13:39:27.708994+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:09.692365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"61'14","reported_seq":47,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712197+0000","last_change":"2024-09-21T13:38:59.652621+0000","last_active":"2024-09-21T13:39:27.712197+0000","last_peered":"2024-09-21T13:39:27.712197+0000","last_clean":"2024-09-21T13:39:27.712197+0000","last_became_active":"2024-09-21T13:38:59.652246+0000","last_became_peered":"2024-09-21T13:38:59.652246+0000","last_unstale":"2024-09-21T13:39:27.712197+0000","last_undegraded":"2024-09-21T13:39:27.712197+0000","last_fullsized":"2024-09-21T13:39:27.712197+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:51:54.589353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"54'1","reported_seq":31,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712705+0000","last_change":"2024-09-21T13:38:57.645771+0000","last_active":"2024-09-21T13:39:27.712705+0000","last_peered":"2024-09-21T13:39:27.712705+0000","last_clean":"2024-09-21T13:39:27.712705+0000","last_became_active":"2024-09-21T13:38:57.645463+0000","last_became_peered":"2024-09-21T13:38:57.645463+0000","last_unstale":"2024-09-21T13:39:27.712705+0000","last_undegraded":"2024-09-21T13:39:27.712705+0000","last_fullsized":"2024-09-21T13:39:27.712705+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:53:01.301240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"61'8","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.708921+0000","last_change":"2024-09-21T13:39:01.677552+0000","last_active":"2024-09-21T13:39:32.708921+0000","last_peered":"2024-09-21T13:39:32.708921+0000","last_clean":"2024-09-21T13:39:32.708921+0000","last_became_active":"2024-09-21T13:39:01.677230+0000","last_became_peered":"2024-09-21T13:39:01.677230+0000","last_unstale":"2024-09-21T13:39:32.708921+0000","last_undegraded":"2024-09-21T13:39:32.708921+0000","last_fullsized":"2024-09-21T13:39:32.708921+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:19:08.146664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416991+0000","last_change":"2024-09-21T13:39:03.688503+0000","last_active":"2024-09-21T13:39:27.416991+0000","last_peered":"2024-09-21T13:39:27.416991+0000","last_clean":"2024-09-21T13:39:27.416991+0000","last_became_active":"2024-09-21T13:39:03.688200+0000","last_became_peered":"2024-09-21T13:39:03.688200+0000","last_unstale":"2024-09-21T13:39:27.416991+0000","last_undegraded":"2024-09-21T13:39:27.416991+0000","last_fullsized":"2024-09-21T13:39:27.416991+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:10.398736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"61'10","reported_seq":41,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709329+0000","last_change":"2024-09-21T13:38:59.662308+0000","last_active":"2024-09-21T13:39:27.709329+0000","last_peered":"2024-09-21T13:39:27.709329+0000","last_clean":"2024-09-21T13:39:27.709329+0000","last_became_active":"2024-09-21T13:38:59.661563+0000","last_became_peered":"2024-09-21T13:38:59.661563+0000","last_unstale":"2024-09-21T13:39:27.709329+0000","last_undegraded":"2024-09-21T13:39:27.709329+0000","last_fullsized":"2024-09-21T13:39:27.709329+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:46:27.702673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711515+0000","last_change":"2024-09-21T13:38:57.648779+0000","last_active":"2024-09-21T13:39:27.711515+0000","last_peered":"2024-09-21T13:39:27.711515+0000","last_clean":"2024-09-21T13:39:27.711515+0000","last_became_active":"2024-09-21T13:38:57.648482+0000","last_became_peered":"2024-09-21T13:38:57.648482+0000","last_unstale":"2024-09-21T13:39:27.711515+0000","last_undegraded":"2024-09-21T13:39:27.711515+0000","last_fullsized":"2024-09-21T13:39:27.711515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:58.152769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.708809+0000","last_change":"2024-09-21T13:39:01.681574+0000","last_active":"2024-09-21T13:39:32.708809+0000","last_peered":"2024-09-21T13:39:32.708809+0000","last_clean":"2024-09-21T13:39:32.708809+0000","last_became_active":"2024-09-21T13:39:01.681254+0000","last_became_peered":"2024-09-21T13:39:01.681254+0000","last_unstale":"2024-09-21T13:39:32.708809+0000","last_undegraded":"2024-09-21T13:39:32.708809+0000","last_fullsized":"2024-09-21T13:39:32.708809+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:25.741553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711070+0000","last_change":"2024-09-21T13:39:03.687178+0000","last_active":"2024-09-21T13:39:27.711070+0000","last_peered":"2024-09-21T13:39:27.711070+0000","last_clean":"2024-09-21T13:39:27.711070+0000","last_became_active":"2024-09-21T13:39:03.686877+0000","last_became_peered":"2024-09-21T13:39:03.686877+0000","last_unstale":"2024-09-21T13:39:27.711070+0000","last_undegraded":"2024-09-21T13:39:27.711070+0000","last_fullsized":"2024-09-21T13:39:27.711070+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:07.289379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"61'19","reported_seq":62,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712601+0000","last_change":"2024-09-21T13:38:59.791291+0000","last_active":"2024-09-21T13:39:27.712601+0000","last_peered":"2024-09-21T13:39:27.712601+0000","last_clean":"2024-09-21T13:39:27.712601+0000","last_became_active":"2024-09-21T13:38:59.790860+0000","last_became_peered":"2024-09-21T13:38:59.790860+0000","last_unstale":"2024-09-21T13:39:27.712601+0000","last_undegraded":"2024-09-21T13:39:27.712601+0000","last_fullsized":"2024-09-21T13:39:27.712601+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:14.469246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710765+0000","last_change":"2024-09-21T13:38:57.654352+0000","last_active":"2024-09-21T13:39:27.710765+0000","last_peered":"2024-09-21T13:39:27.710765+0000","last_clean":"2024-09-21T13:39:27.710765+0000","last_became_active":"2024-09-21T13:38:57.653872+0000","last_became_peered":"2024-09-21T13:38:57.653872+0000","last_unstale":"2024-09-21T13:39:27.710765+0000","last_undegraded":"2024-09-21T13:39:27.710765+0000","last_fullsized":"2024-09-21T13:39:27.710765+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:15.672888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709533+0000","last_change":"2024-09-21T13:39:01.678125+0000","last_active":"2024-09-21T13:39:27.709533+0000","last_peered":"2024-09-21T13:39:27.709533+0000","last_clean":"2024-09-21T13:39:27.709533+0000","last_became_active":"2024-09-21T13:39:01.677858+0000","last_became_peered":"2024-09-21T13:39:01.677858+0000","last_unstale":"2024-09-21T13:39:27.709533+0000","last_undegraded":"2024-09-21T13:39:27.709533+0000","last_fullsized":"2024-09-21T13:39:27.709533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:55:24.227276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.708881+0000","last_change":"2024-09-21T13:39:03.691121+0000","last_active":"2024-09-21T13:39:27.708881+0000","last_peered":"2024-09-21T13:39:27.708881+0000","last_clean":"2024-09-21T13:39:27.708881+0000","last_became_active":"2024-09-21T13:39:03.690831+0000","last_became_peered":"2024-09-21T13:39:03.690831+0000","last_unstale":"2024-09-21T13:39:27.708881+0000","last_undegraded":"2024-09-21T13:39:27.708881+0000","last_fullsized":"2024-09-21T13:39:27.708881+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:06:49.661307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"61'28","reported_seq":83,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.708825+0000","last_change":"2024-09-21T13:38:59.663682+0000","last_active":"2024-09-21T13:39:32.708825+0000","last_peered":"2024-09-21T13:39:32.708825+0000","last_clean":"2024-09-21T13:39:32.708825+0000","last_became_active":"2024-09-21T13:38:59.663364+0000","last_became_peered":"2024-09-21T13:38:59.663364+0000","last_unstale":"2024-09-21T13:39:32.708825+0000","last_undegraded":"2024-09-21T13:39:32.708825+0000","last_fullsized":"2024-09-21T13:39:32.708825+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:18:30.131139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711232+0000","last_change":"2024-09-21T13:38:57.645420+0000","last_active":"2024-09-21T13:39:27.711232+0000","last_peered":"2024-09-21T13:39:27.711232+0000","last_clean":"2024-09-21T13:39:27.711232+0000","last_became_active":"2024-09-21T13:38:57.645112+0000","last_became_peered":"2024-09-21T13:38:57.645112+0000","last_unstale":"2024-09-21T13:39:27.711232+0000","last_undegraded":"2024-09-21T13:39:27.711232+0000","last_fullsized":"2024-09-21T13:39:27.711232+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:35.799087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"56'2","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710163+0000","last_change":"2024-09-21T13:38:59.650223+0000","last_active":"2024-09-21T13:39:27.710163+0000","last_peered":"2024-09-21T13:39:27.710163+0000","last_clean":"2024-09-21T13:39:27.710163+0000","last_became_active":"2024-09-21T13:38:56.639700+0000","last_became_peered":"2024-09-21T13:38:56.639700+0000","last_unstale":"2024-09-21T13:39:27.710163+0000","last_undegraded":"2024-09-21T13:39:27.710163+0000","last_fullsized":"2024-09-21T13:39:27.710163+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_clean_scrub_stamp":"2024-09-21T13:38:55.616207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:47.645996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017482470000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710335+0000","last_change":"2024-09-21T13:39:01.683348+0000","last_active":"2024-09-21T13:39:27.710335+0000","last_peered":"2024-09-21T13:39:27.710335+0000","last_clean":"2024-09-21T13:39:27.710335+0000","last_became_active":"2024-09-21T13:39:01.682604+0000","last_became_peered":"2024-09-21T13:39:01.682604+0000","last_unstale":"2024-09-21T13:39:27.710335+0000","last_undegraded":"2024-09-21T13:39:27.710335+0000","last_fullsized":"2024-09-21T13:39:27.710335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:19:55.026716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416100+0000","last_change":"2024-09-21T13:39:03.689985+0000","last_active":"2024-09-21T13:39:27.416100+0000","last_peered":"2024-09-21T13:39:27.416100+0000","last_clean":"2024-09-21T13:39:27.416100+0000","last_became_active":"2024-09-21T13:39:03.689304+0000","last_became_peered":"2024-09-21T13:39:03.689304+0000","last_unstale":"2024-09-21T13:39:27.416100+0000","last_undegraded":"2024-09-21T13:39:27.416100+0000","last_fullsized":"2024-09-21T13:39:27.416100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:30:04.475735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'13","reported_seq":53,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711478+0000","last_change":"2024-09-21T13:38:59.660943+0000","last_active":"2024-09-21T13:39:27.711478+0000","last_peered":"2024-09-21T13:39:27.711478+0000","last_clean":"2024-09-21T13:39:27.711478+0000","last_became_active":"2024-09-21T13:38:59.660587+0000","last_became_peered":"2024-09-21T13:38:59.660587+0000","last_unstale":"2024-09-21T13:39:27.711478+0000","last_undegraded":"2024-09-21T13:39:27.711478+0000","last_fullsized":"2024-09-21T13:39:27.711478+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:20.002123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710038+0000","last_change":"2024-09-21T13:38:57.645289+0000","last_active":"2024-09-21T13:39:27.710038+0000","last_peered":"2024-09-21T13:39:27.710038+0000","last_clean":"2024-09-21T13:39:27.710038+0000","last_became_active":"2024-09-21T13:38:57.644958+0000","last_became_peered":"2024-09-21T13:38:57.644958+0000","last_unstale":"2024-09-21T13:39:27.710038+0000","last_undegraded":"2024-09-21T13:39:27.710038+0000","last_fullsized":"2024-09-21T13:39:27.710038+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:32.996013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"54'1","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414082+0000","last_change":"2024-09-21T13:38:59.643281+0000","last_active":"2024-09-21T13:39:27.414082+0000","last_peered":"2024-09-21T13:39:27.414082+0000","last_clean":"2024-09-21T13:39:27.414082+0000","last_became_active":"2024-09-21T13:38:56.640592+0000","last_became_peered":"2024-09-21T13:38:56.640592+0000","last_unstale":"2024-09-21T13:39:27.414082+0000","last_undegraded":"2024-09-21T13:39:27.414082+0000","last_fullsized":"2024-09-21T13:39:27.414082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_clean_scrub_stamp":"2024-09-21T13:38:55.616207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:46.243563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057461199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.415530+0000","last_change":"2024-09-21T13:39:01.673159+0000","last_active":"2024-09-21T13:39:27.415530+0000","last_peered":"2024-09-21T13:39:27.415530+0000","last_clean":"2024-09-21T13:39:27.415530+0000","last_became_active":"2024-09-21T13:39:01.672829+0000","last_became_peered":"2024-09-21T13:39:01.672829+0000","last_unstale":"2024-09-21T13:39:27.415530+0000","last_undegraded":"2024-09-21T13:39:27.415530+0000","last_fullsized":"2024-09-21T13:39:27.415530+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:25.765536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417409+0000","last_change":"2024-09-21T13:39:03.693296+0000","last_active":"2024-09-21T13:39:27.417409+0000","last_peered":"2024-09-21T13:39:27.417409+0000","last_clean":"2024-09-21T13:39:27.417409+0000","last_became_active":"2024-09-21T13:39:03.693005+0000","last_became_peered":"2024-09-21T13:39:03.693005+0000","last_unstale":"2024-09-21T13:39:27.417409+0000","last_undegraded":"2024-09-21T13:39:27.417409+0000","last_fullsized":"2024-09-21T13:39:27.417409+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:45.158722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"61'12","reported_seq":44,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712419+0000","last_change":"2024-09-21T13:38:59.661986+0000","last_active":"2024-09-21T13:39:27.712419+0000","last_peered":"2024-09-21T13:39:27.712419+0000","last_clean":"2024-09-21T13:39:27.712419+0000","last_became_active":"2024-09-21T13:38:59.661634+0000","last_became_peered":"2024-09-21T13:38:59.661634+0000","last_unstale":"2024-09-21T13:39:27.712419+0000","last_undegraded":"2024-09-21T13:39:27.712419+0000","last_fullsized":"2024-09-21T13:39:27.712419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:40:52.869372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709559+0000","last_change":"2024-09-21T13:38:57.646808+0000","last_active":"2024-09-21T13:39:27.709559+0000","last_peered":"2024-09-21T13:39:27.709559+0000","last_clean":"2024-09-21T13:39:27.709559+0000","last_became_active":"2024-09-21T13:38:57.646538+0000","last_became_peered":"2024-09-21T13:38:57.646538+0000","last_unstale":"2024-09-21T13:39:27.709559+0000","last_undegraded":"2024-09-21T13:39:27.709559+0000","last_fullsized":"2024-09-21T13:39:27.709559+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:17:41.823491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"62'5","reported_seq":76,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:36.526046+0000","last_change":"2024-09-21T13:38:59.789486+0000","last_active":"2024-09-21T13:39:36.526046+0000","last_peered":"2024-09-21T13:39:36.526046+0000","last_clean":"2024-09-21T13:39:36.526046+0000","last_became_active":"2024-09-21T13:38:56.640603+0000","last_became_peered":"2024-09-21T13:38:56.640603+0000","last_unstale":"2024-09-21T13:39:36.526046+0000","last_undegraded":"2024-09-21T13:39:36.526046+0000","last_fullsized":"2024-09-21T13:39:36.526046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_clean_scrub_stamp":"2024-09-21T13:38:55.616207+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:28.529824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047441699999999998,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710666+0000","last_change":"2024-09-21T13:39:01.680411+0000","last_active":"2024-09-21T13:39:27.710666+0000","last_peered":"2024-09-21T13:39:27.710666+0000","last_clean":"2024-09-21T13:39:27.710666+0000","last_became_active":"2024-09-21T13:39:01.680149+0000","last_became_peered":"2024-09-21T13:39:01.680149+0000","last_unstale":"2024-09-21T13:39:27.710666+0000","last_undegraded":"2024-09-21T13:39:27.710666+0000","last_fullsized":"2024-09-21T13:39:27.710666+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:34:25.503933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.708881+0000","last_change":"2024-09-21T13:39:03.694846+0000","last_active":"2024-09-21T13:39:27.708881+0000","last_peered":"2024-09-21T13:39:27.708881+0000","last_clean":"2024-09-21T13:39:27.708881+0000","last_became_active":"2024-09-21T13:39:03.694433+0000","last_became_peered":"2024-09-21T13:39:03.694433+0000","last_unstale":"2024-09-21T13:39:27.708881+0000","last_undegraded":"2024-09-21T13:39:27.708881+0000","last_fullsized":"2024-09-21T13:39:27.708881+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:15.078059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"61'16","reported_seq":57,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709276+0000","last_change":"2024-09-21T13:38:59.789499+0000","last_active":"2024-09-21T13:39:32.709276+0000","last_peered":"2024-09-21T13:39:32.709276+0000","last_clean":"2024-09-21T13:39:32.709276+0000","last_became_active":"2024-09-21T13:38:59.789140+0000","last_became_peered":"2024-09-21T13:38:59.789140+0000","last_unstale":"2024-09-21T13:39:32.709276+0000","last_undegraded":"2024-09-21T13:39:32.709276+0000","last_fullsized":"2024-09-21T13:39:32.709276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:45.973666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.415185+0000","last_change":"2024-09-21T13:38:57.646724+0000","last_active":"2024-09-21T13:39:27.415185+0000","last_peered":"2024-09-21T13:39:27.415185+0000","last_clean":"2024-09-21T13:39:27.415185+0000","last_became_active":"2024-09-21T13:38:57.646423+0000","last_became_peered":"2024-09-21T13:38:57.646423+0000","last_unstale":"2024-09-21T13:39:27.415185+0000","last_undegraded":"2024-09-21T13:39:27.415185+0000","last_fullsized":"2024-09-21T13:39:27.415185+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:02:13.517329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"63'79","reported_seq":67,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:29.896354+0000","last_change":"2024-09-21T13:38:48.251077+0000","last_active":"2024-09-21T13:39:29.896354+0000","last_peered":"2024-09-21T13:39:29.896354+0000","last_clean":"2024-09-21T13:39:29.896354+0000","last_became_active":"2024-09-21T13:38:48.244809+0000","last_became_peered":"2024-09-21T13:38:48.244809+0000","last_unstale":"2024-09-21T13:39:29.896354+0000","last_undegraded":"2024-09-21T13:39:29.896354+0000","last_fullsized":"2024-09-21T13:39:29.896354+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:36:22.764708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:36:22.764708+0000","last_clean_scrub_stamp":"2024-09-21T13:36:22.764708+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:22:02.756737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417068+0000","last_change":"2024-09-21T13:39:01.677460+0000","last_active":"2024-09-21T13:39:27.417068+0000","last_peered":"2024-09-21T13:39:27.417068+0000","last_clean":"2024-09-21T13:39:27.417068+0000","last_became_active":"2024-09-21T13:39:01.677161+0000","last_became_peered":"2024-09-21T13:39:01.677161+0000","last_unstale":"2024-09-21T13:39:27.417068+0000","last_undegraded":"2024-09-21T13:39:27.417068+0000","last_fullsized":"2024-09-21T13:39:27.417068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:57.704114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709529+0000","last_change":"2024-09-21T13:39:03.691400+0000","last_active":"2024-09-21T13:39:27.709529+0000","last_peered":"2024-09-21T13:39:27.709529+0000","last_clean":"2024-09-21T13:39:27.709529+0000","last_became_active":"2024-09-21T13:39:03.691138+0000","last_became_peered":"2024-09-21T13:39:03.691138+0000","last_unstale":"2024-09-21T13:39:27.709529+0000","last_undegraded":"2024-09-21T13:39:27.709529+0000","last_fullsized":"2024-09-21T13:39:27.709529+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:38.972300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"61'11","reported_seq":45,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711890+0000","last_change":"2024-09-21T13:38:59.660953+0000","last_active":"2024-09-21T13:39:27.711890+0000","last_peered":"2024-09-21T13:39:27.711890+0000","last_clean":"2024-09-21T13:39:27.711890+0000","last_became_active":"2024-09-21T13:38:59.660632+0000","last_became_peered":"2024-09-21T13:38:59.660632+0000","last_unstale":"2024-09-21T13:39:27.711890+0000","last_undegraded":"2024-09-21T13:39:27.711890+0000","last_fullsized":"2024-09-21T13:39:27.711890+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:51.183416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712268+0000","last_change":"2024-09-21T13:38:57.646323+0000","last_active":"2024-09-21T13:39:27.712268+0000","last_peered":"2024-09-21T13:39:27.712268+0000","last_clean":"2024-09-21T13:39:27.712268+0000","last_became_active":"2024-09-21T13:38:57.645231+0000","last_became_peered":"2024-09-21T13:38:57.645231+0000","last_unstale":"2024-09-21T13:39:27.712268+0000","last_undegraded":"2024-09-21T13:39:27.712268+0000","last_fullsized":"2024-09-21T13:39:27.712268+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:09:08.259046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710471+0000","last_change":"2024-09-21T13:39:01.677897+0000","last_active":"2024-09-21T13:39:27.710471+0000","last_peered":"2024-09-21T13:39:27.710471+0000","last_clean":"2024-09-21T13:39:27.710471+0000","last_became_active":"2024-09-21T13:39:01.677610+0000","last_became_peered":"2024-09-21T13:39:01.677610+0000","last_unstale":"2024-09-21T13:39:27.710471+0000","last_undegraded":"2024-09-21T13:39:27.710471+0000","last_fullsized":"2024-09-21T13:39:27.710471+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:43:10.163034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414383+0000","last_change":"2024-09-21T13:39:03.689712+0000","last_active":"2024-09-21T13:39:27.414383+0000","last_peered":"2024-09-21T13:39:27.414383+0000","last_clean":"2024-09-21T13:39:27.414383+0000","last_became_active":"2024-09-21T13:39:03.689235+0000","last_became_peered":"2024-09-21T13:39:03.689235+0000","last_unstale":"2024-09-21T13:39:27.414383+0000","last_undegraded":"2024-09-21T13:39:27.414383+0000","last_fullsized":"2024-09-21T13:39:27.414383+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:53:50.539723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"61'17","reported_seq":54,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711768+0000","last_change":"2024-09-21T13:38:59.660935+0000","last_active":"2024-09-21T13:39:27.711768+0000","last_peered":"2024-09-21T13:39:27.711768+0000","last_clean":"2024-09-21T13:39:27.711768+0000","last_became_active":"2024-09-21T13:38:59.660495+0000","last_became_peered":"2024-09-21T13:38:59.660495+0000","last_unstale":"2024-09-21T13:39:27.711768+0000","last_undegraded":"2024-09-21T13:39:27.711768+0000","last_fullsized":"2024-09-21T13:39:27.711768+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:17.839892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711390+0000","last_change":"2024-09-21T13:38:57.645390+0000","last_active":"2024-09-21T13:39:27.711390+0000","last_peered":"2024-09-21T13:39:27.711390+0000","last_clean":"2024-09-21T13:39:27.711390+0000","last_became_active":"2024-09-21T13:38:57.645099+0000","last_became_peered":"2024-09-21T13:38:57.645099+0000","last_unstale":"2024-09-21T13:39:27.711390+0000","last_undegraded":"2024-09-21T13:39:27.711390+0000","last_fullsized":"2024-09-21T13:39:27.711390+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:18:51.057863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710446+0000","last_change":"2024-09-21T13:39:01.684307+0000","last_active":"2024-09-21T13:39:27.710446+0000","last_peered":"2024-09-21T13:39:27.710446+0000","last_clean":"2024-09-21T13:39:27.710446+0000","last_became_active":"2024-09-21T13:39:01.683639+0000","last_became_peered":"2024-09-21T13:39:01.683639+0000","last_unstale":"2024-09-21T13:39:27.710446+0000","last_undegraded":"2024-09-21T13:39:27.710446+0000","last_fullsized":"2024-09-21T13:39:27.710446+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:30.764260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"61'1","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.415311+0000","last_change":"2024-09-21T13:39:03.683755+0000","last_active":"2024-09-21T13:39:27.415311+0000","last_peered":"2024-09-21T13:39:27.415311+0000","last_clean":"2024-09-21T13:39:27.415311+0000","last_became_active":"2024-09-21T13:39:03.683205+0000","last_became_peered":"2024-09-21T13:39:03.683205+0000","last_unstale":"2024-09-21T13:39:27.415311+0000","last_undegraded":"2024-09-21T13:39:27.415311+0000","last_fullsized":"2024-09-21T13:39:27.415311+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:02.939627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"61'10","reported_seq":41,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711266+0000","last_change":"2024-09-21T13:38:59.652416+0000","last_active":"2024-09-21T13:39:27.711266+0000","last_peered":"2024-09-21T13:39:27.711266+0000","last_clean":"2024-09-21T13:39:27.711266+0000","last_became_active":"2024-09-21T13:38:59.652073+0000","last_became_peered":"2024-09-21T13:38:59.652073+0000","last_unstale":"2024-09-21T13:39:27.711266+0000","last_undegraded":"2024-09-21T13:39:27.711266+0000","last_fullsized":"2024-09-21T13:39:27.711266+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:59:21.998572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414806+0000","last_change":"2024-09-21T13:38:57.648893+0000","last_active":"2024-09-21T13:39:27.414806+0000","last_peered":"2024-09-21T13:39:27.414806+0000","last_clean":"2024-09-21T13:39:27.414806+0000","last_became_active":"2024-09-21T13:38:57.648616+0000","last_became_peered":"2024-09-21T13:38:57.648616+0000","last_unstale":"2024-09-21T13:39:27.414806+0000","last_undegraded":"2024-09-21T13:39:27.414806+0000","last_fullsized":"2024-09-21T13:39:27.414806+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:33:30.876024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.708811+0000","last_change":"2024-09-21T13:39:01.673245+0000","last_active":"2024-09-21T13:39:32.708811+0000","last_peered":"2024-09-21T13:39:32.708811+0000","last_clean":"2024-09-21T13:39:32.708811+0000","last_became_active":"2024-09-21T13:39:01.672945+0000","last_became_peered":"2024-09-21T13:39:01.672945+0000","last_unstale":"2024-09-21T13:39:32.708811+0000","last_undegraded":"2024-09-21T13:39:32.708811+0000","last_fullsized":"2024-09-21T13:39:32.708811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:09.393635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709330+0000","last_change":"2024-09-21T13:39:03.691156+0000","last_active":"2024-09-21T13:39:27.709330+0000","last_peered":"2024-09-21T13:39:27.709330+0000","last_clean":"2024-09-21T13:39:27.709330+0000","last_became_active":"2024-09-21T13:39:03.690530+0000","last_became_peered":"2024-09-21T13:39:03.690530+0000","last_unstale":"2024-09-21T13:39:27.709330+0000","last_undegraded":"2024-09-21T13:39:27.709330+0000","last_fullsized":"2024-09-21T13:39:27.709330+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:39.116971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712480+0000","last_change":"2024-09-21T13:38:59.660854+0000","last_active":"2024-09-21T13:39:27.712480+0000","last_peered":"2024-09-21T13:39:27.712480+0000","last_clean":"2024-09-21T13:39:27.712480+0000","last_became_active":"2024-09-21T13:38:59.660538+0000","last_became_peered":"2024-09-21T13:38:59.660538+0000","last_unstale":"2024-09-21T13:39:27.712480+0000","last_undegraded":"2024-09-21T13:39:27.712480+0000","last_fullsized":"2024-09-21T13:39:27.712480+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:14:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710295+0000","last_change":"2024-09-21T13:38:57.649803+0000","last_active":"2024-09-21T13:39:27.710295+0000","last_peered":"2024-09-21T13:39:27.710295+0000","last_clean":"2024-09-21T13:39:27.710295+0000","last_became_active":"2024-09-21T13:38:57.649517+0000","last_became_peered":"2024-09-21T13:38:57.649517+0000","last_unstale":"2024-09-21T13:39:27.710295+0000","last_undegraded":"2024-09-21T13:39:27.710295+0000","last_fullsized":"2024-09-21T13:39:27.710295+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:48.659250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414324+0000","last_change":"2024-09-21T13:39:01.677035+0000","last_active":"2024-09-21T13:39:27.414324+0000","last_peered":"2024-09-21T13:39:27.414324+0000","last_clean":"2024-09-21T13:39:27.414324+0000","last_became_active":"2024-09-21T13:39:01.676736+0000","last_became_peered":"2024-09-21T13:39:01.676736+0000","last_unstale":"2024-09-21T13:39:27.414324+0000","last_undegraded":"2024-09-21T13:39:27.414324+0000","last_fullsized":"2024-09-21T13:39:27.414324+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:57.795491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709250+0000","last_change":"2024-09-21T13:39:03.682689+0000","last_active":"2024-09-21T13:39:27.709250+0000","last_peered":"2024-09-21T13:39:27.709250+0000","last_clean":"2024-09-21T13:39:27.709250+0000","last_became_active":"2024-09-21T13:39:03.682236+0000","last_became_peered":"2024-09-21T13:39:03.682236+0000","last_unstale":"2024-09-21T13:39:27.709250+0000","last_undegraded":"2024-09-21T13:39:27.709250+0000","last_fullsized":"2024-09-21T13:39:27.709250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:55:09.357067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'19","reported_seq":57,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709633+0000","last_change":"2024-09-21T13:38:59.790127+0000","last_active":"2024-09-21T13:39:27.709633+0000","last_peered":"2024-09-21T13:39:27.709633+0000","last_clean":"2024-09-21T13:39:27.709633+0000","last_became_active":"2024-09-21T13:38:59.789058+0000","last_became_peered":"2024-09-21T13:38:59.789058+0000","last_unstale":"2024-09-21T13:39:27.709633+0000","last_undegraded":"2024-09-21T13:39:27.709633+0000","last_fullsized":"2024-09-21T13:39:27.709633+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:49.837292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417507+0000","last_change":"2024-09-21T13:38:57.649599+0000","last_active":"2024-09-21T13:39:27.417507+0000","last_peered":"2024-09-21T13:39:27.417507+0000","last_clean":"2024-09-21T13:39:27.417507+0000","last_became_active":"2024-09-21T13:38:57.649117+0000","last_became_peered":"2024-09-21T13:38:57.649117+0000","last_unstale":"2024-09-21T13:39:27.417507+0000","last_undegraded":"2024-09-21T13:39:27.417507+0000","last_fullsized":"2024-09-21T13:39:27.417507+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:51.120545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414610+0000","last_change":"2024-09-21T13:39:01.674861+0000","last_active":"2024-09-21T13:39:27.414610+0000","last_peered":"2024-09-21T13:39:27.414610+0000","last_clean":"2024-09-21T13:39:27.414610+0000","last_became_active":"2024-09-21T13:39:01.674474+0000","last_became_peered":"2024-09-21T13:39:01.674474+0000","last_unstale":"2024-09-21T13:39:27.414610+0000","last_undegraded":"2024-09-21T13:39:27.414610+0000","last_fullsized":"2024-09-21T13:39:27.414610+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:22.309358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416995+0000","last_change":"2024-09-21T13:39:03.691973+0000","last_active":"2024-09-21T13:39:27.416995+0000","last_peered":"2024-09-21T13:39:27.416995+0000","last_clean":"2024-09-21T13:39:27.416995+0000","last_became_active":"2024-09-21T13:39:03.691706+0000","last_became_peered":"2024-09-21T13:39:03.691706+0000","last_unstale":"2024-09-21T13:39:27.416995+0000","last_undegraded":"2024-09-21T13:39:27.416995+0000","last_fullsized":"2024-09-21T13:39:27.416995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:47.560852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"61'12","reported_seq":49,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711849+0000","last_change":"2024-09-21T13:38:59.655671+0000","last_active":"2024-09-21T13:39:27.711849+0000","last_peered":"2024-09-21T13:39:27.711849+0000","last_clean":"2024-09-21T13:39:27.711849+0000","last_became_active":"2024-09-21T13:38:59.655330+0000","last_became_peered":"2024-09-21T13:38:59.655330+0000","last_unstale":"2024-09-21T13:39:27.711849+0000","last_undegraded":"2024-09-21T13:39:27.711849+0000","last_fullsized":"2024-09-21T13:39:27.711849+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:41.686785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417580+0000","last_change":"2024-09-21T13:38:57.649099+0000","last_active":"2024-09-21T13:39:27.417580+0000","last_peered":"2024-09-21T13:39:27.417580+0000","last_clean":"2024-09-21T13:39:27.417580+0000","last_became_active":"2024-09-21T13:38:57.648359+0000","last_became_peered":"2024-09-21T13:38:57.648359+0000","last_unstale":"2024-09-21T13:39:27.417580+0000","last_undegraded":"2024-09-21T13:39:27.417580+0000","last_fullsized":"2024-09-21T13:39:27.417580+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:16:41.087159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.413734+0000","last_change":"2024-09-21T13:39:01.675796+0000","last_active":"2024-09-21T13:39:27.413734+0000","last_peered":"2024-09-21T13:39:27.413734+0000","last_clean":"2024-09-21T13:39:27.413734+0000","last_became_active":"2024-09-21T13:39:01.675479+0000","last_became_peered":"2024-09-21T13:39:01.675479+0000","last_unstale":"2024-09-21T13:39:27.413734+0000","last_undegraded":"2024-09-21T13:39:27.413734+0000","last_fullsized":"2024-09-21T13:39:27.413734+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:19.478817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414475+0000","last_change":"2024-09-21T13:39:03.691639+0000","last_active":"2024-09-21T13:39:27.414475+0000","last_peered":"2024-09-21T13:39:27.414475+0000","last_clean":"2024-09-21T13:39:27.414475+0000","last_became_active":"2024-09-21T13:39:03.691292+0000","last_became_peered":"2024-09-21T13:39:03.691292+0000","last_unstale":"2024-09-21T13:39:27.414475+0000","last_undegraded":"2024-09-21T13:39:27.414475+0000","last_fullsized":"2024-09-21T13:39:27.414475+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:26.458975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"61'15","reported_seq":51,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709325+0000","last_change":"2024-09-21T13:38:59.791572+0000","last_active":"2024-09-21T13:39:27.709325+0000","last_peered":"2024-09-21T13:39:27.709325+0000","last_clean":"2024-09-21T13:39:27.709325+0000","last_became_active":"2024-09-21T13:38:59.791151+0000","last_became_peered":"2024-09-21T13:38:59.791151+0000","last_unstale":"2024-09-21T13:39:27.709325+0000","last_undegraded":"2024-09-21T13:39:27.709325+0000","last_fullsized":"2024-09-21T13:39:27.709325+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:35.741448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"54'2","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417305+0000","last_change":"2024-09-21T13:38:57.647884+0000","last_active":"2024-09-21T13:39:27.417305+0000","last_peered":"2024-09-21T13:39:27.417305+0000","last_clean":"2024-09-21T13:39:27.417305+0000","last_became_active":"2024-09-21T13:38:57.647574+0000","last_became_peered":"2024-09-21T13:38:57.647574+0000","last_unstale":"2024-09-21T13:39:27.417305+0000","last_undegraded":"2024-09-21T13:39:27.417305+0000","last_fullsized":"2024-09-21T13:39:27.417305+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:47.771647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709150+0000","last_change":"2024-09-21T13:39:01.680978+0000","last_active":"2024-09-21T13:39:32.709150+0000","last_peered":"2024-09-21T13:39:32.709150+0000","last_clean":"2024-09-21T13:39:32.709150+0000","last_became_active":"2024-09-21T13:39:01.680705+0000","last_became_peered":"2024-09-21T13:39:01.680705+0000","last_unstale":"2024-09-21T13:39:32.709150+0000","last_undegraded":"2024-09-21T13:39:32.709150+0000","last_fullsized":"2024-09-21T13:39:32.709150+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:03.135300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710274+0000","last_change":"2024-09-21T13:39:03.689091+0000","last_active":"2024-09-21T13:39:27.710274+0000","last_peered":"2024-09-21T13:39:27.710274+0000","last_clean":"2024-09-21T13:39:27.710274+0000","last_became_active":"2024-09-21T13:39:03.688817+0000","last_became_peered":"2024-09-21T13:39:03.688817+0000","last_unstale":"2024-09-21T13:39:27.710274+0000","last_undegraded":"2024-09-21T13:39:27.710274+0000","last_fullsized":"2024-09-21T13:39:27.710274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:52.677852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710101+0000","last_change":"2024-09-21T13:38:57.652979+0000","last_active":"2024-09-21T13:39:27.710101+0000","last_peered":"2024-09-21T13:39:27.710101+0000","last_clean":"2024-09-21T13:39:27.710101+0000","last_became_active":"2024-09-21T13:38:57.652478+0000","last_became_peered":"2024-09-21T13:38:57.652478+0000","last_unstale":"2024-09-21T13:39:27.710101+0000","last_undegraded":"2024-09-21T13:39:27.710101+0000","last_fullsized":"2024-09-21T13:39:27.710101+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:40.768120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"61'6","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416696+0000","last_change":"2024-09-21T13:38:59.790997+0000","last_active":"2024-09-21T13:39:27.416696+0000","last_peered":"2024-09-21T13:39:27.416696+0000","last_clean":"2024-09-21T13:39:27.416696+0000","last_became_active":"2024-09-21T13:38:59.790654+0000","last_became_peered":"2024-09-21T13:38:59.790654+0000","last_unstale":"2024-09-21T13:39:27.416696+0000","last_undegraded":"2024-09-21T13:39:27.416696+0000","last_fullsized":"2024-09-21T13:39:27.416696+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:52.848558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710492+0000","last_change":"2024-09-21T13:39:01.677603+0000","last_active":"2024-09-21T13:39:27.710492+0000","last_peered":"2024-09-21T13:39:27.710492+0000","last_clean":"2024-09-21T13:39:27.710492+0000","last_became_active":"2024-09-21T13:39:01.677330+0000","last_became_peered":"2024-09-21T13:39:01.677330+0000","last_unstale":"2024-09-21T13:39:27.710492+0000","last_undegraded":"2024-09-21T13:39:27.710492+0000","last_fullsized":"2024-09-21T13:39:27.710492+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:18:45.256565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417178+0000","last_change":"2024-09-21T13:39:03.683885+0000","last_active":"2024-09-21T13:39:27.417178+0000","last_peered":"2024-09-21T13:39:27.417178+0000","last_clean":"2024-09-21T13:39:27.417178+0000","last_became_active":"2024-09-21T13:39:03.683606+0000","last_became_peered":"2024-09-21T13:39:03.683606+0000","last_unstale":"2024-09-21T13:39:27.417178+0000","last_undegraded":"2024-09-21T13:39:27.417178+0000","last_fullsized":"2024-09-21T13:39:27.417178+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:52.760001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712558+0000","last_change":"2024-09-21T13:38:59.791917+0000","last_active":"2024-09-21T13:39:27.712558+0000","last_peered":"2024-09-21T13:39:27.712558+0000","last_clean":"2024-09-21T13:39:27.712558+0000","last_became_active":"2024-09-21T13:38:59.791620+0000","last_became_peered":"2024-09-21T13:38:59.791620+0000","last_unstale":"2024-09-21T13:39:27.712558+0000","last_undegraded":"2024-09-21T13:39:27.712558+0000","last_fullsized":"2024-09-21T13:39:27.712558+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:04.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417052+0000","last_change":"2024-09-21T13:38:57.647148+0000","last_active":"2024-09-21T13:39:27.417052+0000","last_peered":"2024-09-21T13:39:27.417052+0000","last_clean":"2024-09-21T13:39:27.417052+0000","last_became_active":"2024-09-21T13:38:57.646854+0000","last_became_peered":"2024-09-21T13:38:57.646854+0000","last_unstale":"2024-09-21T13:39:27.417052+0000","last_undegraded":"2024-09-21T13:39:27.417052+0000","last_fullsized":"2024-09-21T13:39:27.417052+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:56.436211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416555+0000","last_change":"2024-09-21T13:39:01.678258+0000","last_active":"2024-09-21T13:39:27.416555+0000","last_peered":"2024-09-21T13:39:27.416555+0000","last_clean":"2024-09-21T13:39:27.416555+0000","last_became_active":"2024-09-21T13:39:01.677908+0000","last_became_peered":"2024-09-21T13:39:01.677908+0000","last_unstale":"2024-09-21T13:39:27.416555+0000","last_undegraded":"2024-09-21T13:39:27.416555+0000","last_fullsized":"2024-09-21T13:39:27.416555+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:00.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.415671+0000","last_change":"2024-09-21T13:39:03.684061+0000","last_active":"2024-09-21T13:39:27.415671+0000","last_peered":"2024-09-21T13:39:27.415671+0000","last_clean":"2024-09-21T13:39:27.415671+0000","last_became_active":"2024-09-21T13:39:03.683742+0000","last_became_peered":"2024-09-21T13:39:03.683742+0000","last_unstale":"2024-09-21T13:39:27.415671+0000","last_undegraded":"2024-09-21T13:39:27.415671+0000","last_fullsized":"2024-09-21T13:39:27.415671+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:12:46.448180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711310+0000","last_change":"2024-09-21T13:38:59.790634+0000","last_active":"2024-09-21T13:39:27.711310+0000","last_peered":"2024-09-21T13:39:27.711310+0000","last_clean":"2024-09-21T13:39:27.711310+0000","last_became_active":"2024-09-21T13:38:59.790332+0000","last_became_peered":"2024-09-21T13:38:59.790332+0000","last_unstale":"2024-09-21T13:39:27.711310+0000","last_undegraded":"2024-09-21T13:39:27.711310+0000","last_fullsized":"2024-09-21T13:39:27.711310+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:26:59.003873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709962+0000","last_change":"2024-09-21T13:38:57.652780+0000","last_active":"2024-09-21T13:39:27.709962+0000","last_peered":"2024-09-21T13:39:27.709962+0000","last_clean":"2024-09-21T13:39:27.709962+0000","last_became_active":"2024-09-21T13:38:57.652332+0000","last_became_peered":"2024-09-21T13:38:57.652332+0000","last_unstale":"2024-09-21T13:39:27.709962+0000","last_undegraded":"2024-09-21T13:39:27.709962+0000","last_fullsized":"2024-09-21T13:39:27.709962+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:59:09.995840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709133+0000","last_change":"2024-09-21T13:39:01.672948+0000","last_active":"2024-09-21T13:39:32.709133+0000","last_peered":"2024-09-21T13:39:32.709133+0000","last_clean":"2024-09-21T13:39:32.709133+0000","last_became_active":"2024-09-21T13:39:01.672617+0000","last_became_peered":"2024-09-21T13:39:01.672617+0000","last_unstale":"2024-09-21T13:39:32.709133+0000","last_undegraded":"2024-09-21T13:39:32.709133+0000","last_fullsized":"2024-09-21T13:39:32.709133+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:31:28.048267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711524+0000","last_change":"2024-09-21T13:39:03.686340+0000","last_active":"2024-09-21T13:39:27.711524+0000","last_peered":"2024-09-21T13:39:27.711524+0000","last_clean":"2024-09-21T13:39:27.711524+0000","last_became_active":"2024-09-21T13:39:03.686070+0000","last_became_peered":"2024-09-21T13:39:03.686070+0000","last_unstale":"2024-09-21T13:39:27.711524+0000","last_undegraded":"2024-09-21T13:39:27.711524+0000","last_fullsized":"2024-09-21T13:39:27.711524+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:23.371425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"61'10","reported_seq":41,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417350+0000","last_change":"2024-09-21T13:38:59.789464+0000","last_active":"2024-09-21T13:39:27.417350+0000","last_peered":"2024-09-21T13:39:27.417350+0000","last_clean":"2024-09-21T13:39:27.417350+0000","last_became_active":"2024-09-21T13:38:59.788995+0000","last_became_peered":"2024-09-21T13:38:59.788995+0000","last_unstale":"2024-09-21T13:39:27.417350+0000","last_undegraded":"2024-09-21T13:39:27.417350+0000","last_fullsized":"2024-09-21T13:39:27.417350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:33.252492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417330+0000","last_change":"2024-09-21T13:38:57.649887+0000","last_active":"2024-09-21T13:39:27.417330+0000","last_peered":"2024-09-21T13:39:27.417330+0000","last_clean":"2024-09-21T13:39:27.417330+0000","last_became_active":"2024-09-21T13:38:57.649579+0000","last_became_peered":"2024-09-21T13:38:57.649579+0000","last_unstale":"2024-09-21T13:39:27.417330+0000","last_undegraded":"2024-09-21T13:39:27.417330+0000","last_fullsized":"2024-09-21T13:39:27.417330+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:45.949628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709138+0000","last_change":"2024-09-21T13:39:01.676756+0000","last_active":"2024-09-21T13:39:32.709138+0000","last_peered":"2024-09-21T13:39:32.709138+0000","last_clean":"2024-09-21T13:39:32.709138+0000","last_became_active":"2024-09-21T13:39:01.676495+0000","last_became_peered":"2024-09-21T13:39:01.676495+0000","last_unstale":"2024-09-21T13:39:32.709138+0000","last_undegraded":"2024-09-21T13:39:32.709138+0000","last_fullsized":"2024-09-21T13:39:32.709138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:19:59.783997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711979+0000","last_change":"2024-09-21T13:39:03.688094+0000","last_active":"2024-09-21T13:39:27.711979+0000","last_peered":"2024-09-21T13:39:27.711979+0000","last_clean":"2024-09-21T13:39:27.711979+0000","last_became_active":"2024-09-21T13:39:03.687808+0000","last_became_peered":"2024-09-21T13:39:03.687808+0000","last_unstale":"2024-09-21T13:39:27.711979+0000","last_undegraded":"2024-09-21T13:39:27.711979+0000","last_fullsized":"2024-09-21T13:39:27.711979+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:33.488203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"61'11","reported_seq":45,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711008+0000","last_change":"2024-09-21T13:38:59.661418+0000","last_active":"2024-09-21T13:39:27.711008+0000","last_peered":"2024-09-21T13:39:27.711008+0000","last_clean":"2024-09-21T13:39:27.711008+0000","last_became_active":"2024-09-21T13:38:59.661014+0000","last_became_peered":"2024-09-21T13:38:59.661014+0000","last_unstale":"2024-09-21T13:39:27.711008+0000","last_undegraded":"2024-09-21T13:39:27.711008+0000","last_fullsized":"2024-09-21T13:39:27.711008+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:08.614122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711376+0000","last_change":"2024-09-21T13:38:57.651750+0000","last_active":"2024-09-21T13:39:27.711376+0000","last_peered":"2024-09-21T13:39:27.711376+0000","last_clean":"2024-09-21T13:39:27.711376+0000","last_became_active":"2024-09-21T13:38:57.651453+0000","last_became_peered":"2024-09-21T13:38:57.651453+0000","last_unstale":"2024-09-21T13:39:27.711376+0000","last_undegraded":"2024-09-21T13:39:27.711376+0000","last_fullsized":"2024-09-21T13:39:27.711376+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:02:20.629729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709245+0000","last_change":"2024-09-21T13:39:01.677645+0000","last_active":"2024-09-21T13:39:27.709245+0000","last_peered":"2024-09-21T13:39:27.709245+0000","last_clean":"2024-09-21T13:39:27.709245+0000","last_became_active":"2024-09-21T13:39:01.677350+0000","last_became_peered":"2024-09-21T13:39:01.677350+0000","last_unstale":"2024-09-21T13:39:27.709245+0000","last_undegraded":"2024-09-21T13:39:27.709245+0000","last_fullsized":"2024-09-21T13:39:27.709245+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:42:52.813465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414447+0000","last_change":"2024-09-21T13:39:03.687545+0000","last_active":"2024-09-21T13:39:27.414447+0000","last_peered":"2024-09-21T13:39:27.414447+0000","last_clean":"2024-09-21T13:39:27.414447+0000","last_became_active":"2024-09-21T13:39:03.687193+0000","last_became_peered":"2024-09-21T13:39:03.687193+0000","last_unstale":"2024-09-21T13:39:27.414447+0000","last_undegraded":"2024-09-21T13:39:27.414447+0000","last_fullsized":"2024-09-21T13:39:27.414447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:00:57.992645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709477+0000","last_change":"2024-09-21T13:38:59.662581+0000","last_active":"2024-09-21T13:39:27.709477+0000","last_peered":"2024-09-21T13:39:27.709477+0000","last_clean":"2024-09-21T13:39:27.709477+0000","last_became_active":"2024-09-21T13:38:59.661997+0000","last_became_peered":"2024-09-21T13:38:59.661997+0000","last_unstale":"2024-09-21T13:39:27.709477+0000","last_undegraded":"2024-09-21T13:39:27.709477+0000","last_fullsized":"2024-09-21T13:39:27.709477+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:18:39.759833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417413+0000","last_change":"2024-09-21T13:38:57.648866+0000","last_active":"2024-09-21T13:39:27.417413+0000","last_peered":"2024-09-21T13:39:27.417413+0000","last_clean":"2024-09-21T13:39:27.417413+0000","last_became_active":"2024-09-21T13:38:57.648328+0000","last_became_peered":"2024-09-21T13:38:57.648328+0000","last_unstale":"2024-09-21T13:39:27.417413+0000","last_undegraded":"2024-09-21T13:39:27.417413+0000","last_fullsized":"2024-09-21T13:39:27.417413+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:40.338748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414569+0000","last_change":"2024-09-21T13:39:01.678735+0000","last_active":"2024-09-21T13:39:27.414569+0000","last_peered":"2024-09-21T13:39:27.414569+0000","last_clean":"2024-09-21T13:39:27.414569+0000","last_became_active":"2024-09-21T13:39:01.678144+0000","last_became_peered":"2024-09-21T13:39:01.678144+0000","last_unstale":"2024-09-21T13:39:27.414569+0000","last_undegraded":"2024-09-21T13:39:27.414569+0000","last_fullsized":"2024-09-21T13:39:27.414569+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:35.364014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711574+0000","last_change":"2024-09-21T13:39:03.692425+0000","last_active":"2024-09-21T13:39:27.711574+0000","last_peered":"2024-09-21T13:39:27.711574+0000","last_clean":"2024-09-21T13:39:27.711574+0000","last_became_active":"2024-09-21T13:39:03.692086+0000","last_became_peered":"2024-09-21T13:39:03.692086+0000","last_unstale":"2024-09-21T13:39:27.711574+0000","last_undegraded":"2024-09-21T13:39:27.711574+0000","last_fullsized":"2024-09-21T13:39:27.711574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:29:39.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'11","reported_seq":45,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414600+0000","last_change":"2024-09-21T13:38:59.789412+0000","last_active":"2024-09-21T13:39:27.414600+0000","last_peered":"2024-09-21T13:39:27.414600+0000","last_clean":"2024-09-21T13:39:27.414600+0000","last_became_active":"2024-09-21T13:38:59.789010+0000","last_became_peered":"2024-09-21T13:38:59.789010+0000","last_unstale":"2024-09-21T13:39:27.414600+0000","last_undegraded":"2024-09-21T13:39:27.414600+0000","last_fullsized":"2024-09-21T13:39:27.414600+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:21:02.158333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710491+0000","last_change":"2024-09-21T13:38:57.644684+0000","last_active":"2024-09-21T13:39:27.710491+0000","last_peered":"2024-09-21T13:39:27.710491+0000","last_clean":"2024-09-21T13:39:27.710491+0000","last_became_active":"2024-09-21T13:38:57.644411+0000","last_became_peered":"2024-09-21T13:38:57.644411+0000","last_unstale":"2024-09-21T13:39:27.710491+0000","last_undegraded":"2024-09-21T13:39:27.710491+0000","last_fullsized":"2024-09-21T13:39:27.710491+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:19.778069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416561+0000","last_change":"2024-09-21T13:39:01.680976+0000","last_active":"2024-09-21T13:39:27.416561+0000","last_peered":"2024-09-21T13:39:27.416561+0000","last_clean":"2024-09-21T13:39:27.416561+0000","last_became_active":"2024-09-21T13:39:01.680674+0000","last_became_peered":"2024-09-21T13:39:01.680674+0000","last_unstale":"2024-09-21T13:39:27.416561+0000","last_undegraded":"2024-09-21T13:39:27.416561+0000","last_fullsized":"2024-09-21T13:39:27.416561+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:52.374102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414717+0000","last_change":"2024-09-21T13:39:03.687837+0000","last_active":"2024-09-21T13:39:27.414717+0000","last_peered":"2024-09-21T13:39:27.414717+0000","last_clean":"2024-09-21T13:39:27.414717+0000","last_became_active":"2024-09-21T13:39:03.687521+0000","last_became_peered":"2024-09-21T13:39:03.687521+0000","last_unstale":"2024-09-21T13:39:27.414717+0000","last_undegraded":"2024-09-21T13:39:27.414717+0000","last_fullsized":"2024-09-21T13:39:27.414717+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:32.381734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"61'4","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414300+0000","last_change":"2024-09-21T13:38:59.663022+0000","last_active":"2024-09-21T13:39:27.414300+0000","last_peered":"2024-09-21T13:39:27.414300+0000","last_clean":"2024-09-21T13:39:27.414300+0000","last_became_active":"2024-09-21T13:38:59.662701+0000","last_became_peered":"2024-09-21T13:38:59.662701+0000","last_unstale":"2024-09-21T13:39:27.414300+0000","last_undegraded":"2024-09-21T13:39:27.414300+0000","last_fullsized":"2024-09-21T13:39:27.414300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:17:29.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710770+0000","last_change":"2024-09-21T13:38:57.652998+0000","last_active":"2024-09-21T13:39:27.710770+0000","last_peered":"2024-09-21T13:39:27.710770+0000","last_clean":"2024-09-21T13:39:27.710770+0000","last_became_active":"2024-09-21T13:38:57.652230+0000","last_became_peered":"2024-09-21T13:38:57.652230+0000","last_unstale":"2024-09-21T13:39:27.710770+0000","last_undegraded":"2024-09-21T13:39:27.710770+0000","last_fullsized":"2024-09-21T13:39:27.710770+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:52.398414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709673+0000","last_change":"2024-09-21T13:39:01.672785+0000","last_active":"2024-09-21T13:39:27.709673+0000","last_peered":"2024-09-21T13:39:27.709673+0000","last_clean":"2024-09-21T13:39:27.709673+0000","last_became_active":"2024-09-21T13:39:01.672502+0000","last_became_peered":"2024-09-21T13:39:01.672502+0000","last_unstale":"2024-09-21T13:39:27.709673+0000","last_undegraded":"2024-09-21T13:39:27.709673+0000","last_fullsized":"2024-09-21T13:39:27.709673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:20.880535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416697+0000","last_change":"2024-09-21T13:39:03.687754+0000","last_active":"2024-09-21T13:39:27.416697+0000","last_peered":"2024-09-21T13:39:27.416697+0000","last_clean":"2024-09-21T13:39:27.416697+0000","last_became_active":"2024-09-21T13:39:03.687475+0000","last_became_peered":"2024-09-21T13:39:03.687475+0000","last_unstale":"2024-09-21T13:39:27.416697+0000","last_undegraded":"2024-09-21T13:39:27.416697+0000","last_fullsized":"2024-09-21T13:39:27.416697+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:49.138276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710487+0000","last_change":"2024-09-21T13:39:03.690418+0000","last_active":"2024-09-21T13:39:27.710487+0000","last_peered":"2024-09-21T13:39:27.710487+0000","last_clean":"2024-09-21T13:39:27.710487+0000","last_became_active":"2024-09-21T13:39:03.690105+0000","last_became_peered":"2024-09-21T13:39:03.690105+0000","last_unstale":"2024-09-21T13:39:27.710487+0000","last_undegraded":"2024-09-21T13:39:27.710487+0000","last_fullsized":"2024-09-21T13:39:27.710487+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:36.723746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414625+0000","last_change":"2024-09-21T13:38:57.643671+0000","last_active":"2024-09-21T13:39:27.414625+0000","last_peered":"2024-09-21T13:39:27.414625+0000","last_clean":"2024-09-21T13:39:27.414625+0000","last_became_active":"2024-09-21T13:38:57.643366+0000","last_became_peered":"2024-09-21T13:38:57.643366+0000","last_unstale":"2024-09-21T13:39:27.414625+0000","last_undegraded":"2024-09-21T13:39:27.414625+0000","last_fullsized":"2024-09-21T13:39:27.414625+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:23:03.650078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"61'11","reported_seq":45,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710923+0000","last_change":"2024-09-21T13:38:59.664785+0000","last_active":"2024-09-21T13:39:27.710923+0000","last_peered":"2024-09-21T13:39:27.710923+0000","last_clean":"2024-09-21T13:39:27.710923+0000","last_became_active":"2024-09-21T13:38:59.664401+0000","last_became_peered":"2024-09-21T13:38:59.664401+0000","last_unstale":"2024-09-21T13:39:27.710923+0000","last_undegraded":"2024-09-21T13:39:27.710923+0000","last_fullsized":"2024-09-21T13:39:27.710923+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:11.152256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712626+0000","last_change":"2024-09-21T13:39:01.683792+0000","last_active":"2024-09-21T13:39:27.712626+0000","last_peered":"2024-09-21T13:39:27.712626+0000","last_clean":"2024-09-21T13:39:27.712626+0000","last_became_active":"2024-09-21T13:39:01.683452+0000","last_became_peered":"2024-09-21T13:39:01.683452+0000","last_unstale":"2024-09-21T13:39:27.712626+0000","last_undegraded":"2024-09-21T13:39:27.712626+0000","last_fullsized":"2024-09-21T13:39:27.712626+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:03.835654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397517,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32384,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712768,"statfs":{"total":95995035648,"available":95961874432,"internally_reserved":0,"allocated":1228800,"data_stored":830657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593746,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28204,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716948,"statfs":{"total":95995035648,"available":95966154752,"internally_reserved":0,"allocated":1208320,"data_stored":829572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789977,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31792,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713360,"statfs":{"total":95995035648,"available":95962480640,"internally_reserved":0,"allocated":618496,"data_stored":239563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986206,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717484,"statfs":{"total":95995035648,"available":95966703616,"internally_reserved":0,"allocated":655360,"data_stored":241251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149732,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31828,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713324,"statfs":{"total":95995035648,"available":95962443776,"internally_reserved":0,"allocated":655360,"data_stored":240108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411369,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27636,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717516,"statfs":{"total":95995035648,"available":95966736384,"internally_reserved":0,"allocated":622592,"data_stored":240794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717452,"statfs":{"total":95995035648,"available":95966670848,"internally_reserved":0,"allocated":688128,"data_stored":242418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32388,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712764,"statfs":{"total":95995035648,"available":95961870336,"internally_reserved":0,"allocated":1232896,"data_stored":830366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T13:39:42.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T13:39:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi002 to 3761M 2024-09-21T13:39:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-21T13:39:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T13:39:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: Updating smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:39:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T13:39:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T13:39:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:39:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-21T13:39:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: Updating smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T13:39:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: Updating smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T13:39:42.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:42.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:42 smithi162 ceph-mon[33046]: Deploying daemon alertmanager.a on smithi002 2024-09-21T13:39:43.181 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:43.878 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:43 smithi002 ceph-mon[30076]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T13:39:43.878 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:39:43.878 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:43 smithi002 ceph-mon[40622]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T13:39:43.878 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:39:43.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.877+0000 7f63fb349640 1 -- 172.21.15.2:0/663381601 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f63f4101c60 msgr2=0x7f63f4102040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:43.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.877+0000 7f63fb349640 1 --2- 172.21.15.2:0/663381601 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f63f4101c60 0x7f63f4102040 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009900 tx=0x7f63f002a410 comp rx=0 tx=0).stop 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.877+0000 7f63fb349640 1 -- 172.21.15.2:0/663381601 shutdown_connections 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.877+0000 7f63fb349640 1 --2- 172.21.15.2:0/663381601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f4107ff0 0x7f63f410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.877+0000 7f63fb349640 1 --2- 172.21.15.2:0/663381601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63f4107670 0x7f63f4107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.877+0000 7f63fb349640 1 --2- 172.21.15.2:0/663381601 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f63f4101c60 0x7f63f4102040 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.877+0000 7f63fb349640 1 -- 172.21.15.2:0/663381601 >> 172.21.15.2:0/663381601 conn(0x7f63f40fd6d0 msgr2=0x7f63f40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.877+0000 7f63fb349640 1 -- 172.21.15.2:0/663381601 shutdown_connections 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.877+0000 7f63fb349640 1 -- 172.21.15.2:0/663381601 wait complete. 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63fb349640 1 Processor -- start 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63fb349640 1 -- start start 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63fb349640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63f4101c60 0x7f63f410f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63fb349640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f63f4107670 0x7f63f410f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63fb349640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f4107ff0 0x7f63f410fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63fb349640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41124c0 con 0x7f63f4107ff0 2024-09-21T13:39:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63fb349640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4112340 con 0x7f63f4101c60 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63fb349640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f63f4112640 con 0x7f63f4107670 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63f88e4640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f63f4107670 0x7f63f410f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63f98e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f4107ff0 0x7f63f410fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63f88e4640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f63f4107670 0x7f63f410f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:47760/0 (socket says 172.21.15.2:47760) 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63f88e4640 1 -- 172.21.15.2:0/1301926266 learned_addr learned my addr 172.21.15.2:0/1301926266 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63f98e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f4107ff0 0x7f63f410fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52006/0 (socket says 172.21.15.2:52006) 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.878+0000 7f63f90e5640 1 --2- 172.21.15.2:0/1301926266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63f4101c60 0x7f63f410f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63f88e4640 1 -- 172.21.15.2:0/1301926266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63f4101c60 msgr2=0x7f63f410f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63f88e4640 1 --2- 172.21.15.2:0/1301926266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63f4101c60 0x7f63f410f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63f88e4640 1 -- 172.21.15.2:0/1301926266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f4107ff0 msgr2=0x7f63f410fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63f88e4640 1 --2- 172.21.15.2:0/1301926266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f4107ff0 0x7f63f410fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63f88e4640 1 -- 172.21.15.2:0/1301926266 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f41a6e70 con 0x7f63f4107670 2024-09-21T13:39:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63f98e6640 1 --2- 172.21.15.2:0/1301926266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f4107ff0 0x7f63f410fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63f90e5640 1 --2- 172.21.15.2:0/1301926266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63f4101c60 0x7f63f410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63f88e4640 1 --2- 172.21.15.2:0/1301926266 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f63f4107670 0x7f63f410f840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f63e400b4a0 tx=0x7f63e400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63ea7fc640 1 -- 172.21.15.2:0/1301926266 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4015020 con 0x7f63f4107670 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63ea7fc640 1 -- 172.21.15.2:0/1301926266 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f63e4011cb0 con 0x7f63f4107670 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63fb349640 1 -- 172.21.15.2:0/1301926266 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f41a7160 con 0x7f63f4107670 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63ea7fc640 1 -- 172.21.15.2:0/1301926266 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4010cd0 con 0x7f63f4107670 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.879+0000 7f63fb349640 1 -- 172.21.15.2:0/1301926266 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f41a76a0 con 0x7f63f4107670 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.880+0000 7f63fb349640 1 -- 172.21.15.2:0/1301926266 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f4102040 con 0x7f63f4107670 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.881+0000 7f63ea7fc640 1 -- 172.21.15.2:0/1301926266 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f63e4018020 con 0x7f63f4107670 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.881+0000 7f63ea7fc640 1 --2- 172.21.15.2:0/1301926266 >> v2:172.21.15.2:6800/2394073254 conn(0x7f63e007b110 0x7f63e007d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.881+0000 7f63f90e5640 1 --2- 172.21.15.2:0/1301926266 >> v2:172.21.15.2:6800/2394073254 conn(0x7f63e007b110 0x7f63e007d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.881+0000 7f63ea7fc640 1 -- 172.21.15.2:0/1301926266 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7f63e409dab0 con 0x7f63f4107670 2024-09-21T13:39:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.882+0000 7f63f90e5640 1 --2- 172.21.15.2:0/1301926266 >> v2:172.21.15.2:6800/2394073254 conn(0x7f63e007b110 0x7f63e007d5d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f63f0031440 tx=0x7f63f0005a20 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:43.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:43.886+0000 7f63ea7fc640 1 -- 172.21.15.2:0/1301926266 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f63e401f020 con 0x7f63f4107670 2024-09-21T13:39:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:43 smithi162 ceph-mon[33046]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T13:39:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:39:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.072+0000 7f63fb349640 1 -- 172.21.15.2:0/1301926266 --> v2:172.21.15.2:6800/2394073254 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63f4063590 con 0x7f63e007b110 2024-09-21T13:39:44.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.078+0000 7f63ea7fc640 1 -- 172.21.15.2:0/1301926266 <== mgr.14607 v2:172.21.15.2:6800/2394073254 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346461 (secure 0 0 0) 0x7f63f4063590 con 0x7f63e007b110 2024-09-21T13:39:44.081 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:39:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.081+0000 7f63fb349640 1 -- 172.21.15.2:0/1301926266 >> v2:172.21.15.2:6800/2394073254 conn(0x7f63e007b110 msgr2=0x7f63e007d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.081+0000 7f63fb349640 1 --2- 172.21.15.2:0/1301926266 >> v2:172.21.15.2:6800/2394073254 conn(0x7f63e007b110 0x7f63e007d5d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f63f0031440 tx=0x7f63f0005a20 comp rx=0 tx=0).stop 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.081+0000 7f63fb349640 1 -- 172.21.15.2:0/1301926266 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f63f4107670 msgr2=0x7f63f410f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.081+0000 7f63fb349640 1 --2- 172.21.15.2:0/1301926266 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f63f4107670 0x7f63f410f840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f63e400b4a0 tx=0x7f63e400b8a0 comp rx=0 tx=0).stop 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.082+0000 7f63fb349640 1 -- 172.21.15.2:0/1301926266 shutdown_connections 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.082+0000 7f63fb349640 1 --2- 172.21.15.2:0/1301926266 >> v2:172.21.15.2:6800/2394073254 conn(0x7f63e007b110 0x7f63e007d5d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.082+0000 7f63fb349640 1 --2- 172.21.15.2:0/1301926266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f4107ff0 0x7f63f410fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.082+0000 7f63fb349640 1 --2- 172.21.15.2:0/1301926266 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f63f4107670 0x7f63f410f840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.082+0000 7f63fb349640 1 --2- 172.21.15.2:0/1301926266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63f4101c60 0x7f63f410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.082+0000 7f63fb349640 1 -- 172.21.15.2:0/1301926266 >> 172.21.15.2:0/1301926266 conn(0x7f63f40fd6d0 msgr2=0x7f63f40ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.082+0000 7f63fb349640 1 -- 172.21.15.2:0/1301926266 shutdown_connections 2024-09-21T13:39:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:44.082+0000 7f63fb349640 1 -- 172.21.15.2:0/1301926266 wait complete. 2024-09-21T13:39:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:44 smithi162 ceph-mon[33046]: pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T13:39:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:44 smithi002 ceph-mon[30076]: pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T13:39:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:44 smithi002 ceph-mon[40622]: pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T13:39:45.339 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-21T13:39:43.427938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":883,"num_read_kb":740,"num_write":549,"num_write_kb":1673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":552,"ondisk_log_size":552,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":239600,"kb_used_data":6748,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":749721616,"statfs":{"total":767960285184,"available":767714934784,"internally_reserved":0,"allocated":6909952,"data_stored":3694729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":186,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002985"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710679+0000","last_change":"2024-09-21T13:38:57.652668+0000","last_active":"2024-09-21T13:39:27.710679+0000","last_peered":"2024-09-21T13:39:27.710679+0000","last_clean":"2024-09-21T13:39:27.710679+0000","last_became_active":"2024-09-21T13:38:57.651883+0000","last_became_peered":"2024-09-21T13:38:57.651883+0000","last_unstale":"2024-09-21T13:39:27.710679+0000","last_undegraded":"2024-09-21T13:39:27.710679+0000","last_fullsized":"2024-09-21T13:39:27.710679+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:07.061037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711825+0000","last_change":"2024-09-21T13:38:59.660861+0000","last_active":"2024-09-21T13:39:27.711825+0000","last_peered":"2024-09-21T13:39:27.711825+0000","last_clean":"2024-09-21T13:39:27.711825+0000","last_became_active":"2024-09-21T13:38:59.660471+0000","last_became_peered":"2024-09-21T13:38:59.660471+0000","last_unstale":"2024-09-21T13:39:27.711825+0000","last_undegraded":"2024-09-21T13:39:27.711825+0000","last_fullsized":"2024-09-21T13:39:27.711825+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:04.142420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709924+0000","last_change":"2024-09-21T13:39:01.676745+0000","last_active":"2024-09-21T13:39:27.709924+0000","last_peered":"2024-09-21T13:39:27.709924+0000","last_clean":"2024-09-21T13:39:27.709924+0000","last_became_active":"2024-09-21T13:39:01.676443+0000","last_became_peered":"2024-09-21T13:39:01.676443+0000","last_unstale":"2024-09-21T13:39:27.709924+0000","last_undegraded":"2024-09-21T13:39:27.709924+0000","last_fullsized":"2024-09-21T13:39:27.709924+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:08:29.869404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710899+0000","last_change":"2024-09-21T13:39:03.692384+0000","last_active":"2024-09-21T13:39:27.710899+0000","last_peered":"2024-09-21T13:39:27.710899+0000","last_clean":"2024-09-21T13:39:27.710899+0000","last_became_active":"2024-09-21T13:39:03.690771+0000","last_became_peered":"2024-09-21T13:39:03.690771+0000","last_unstale":"2024-09-21T13:39:27.710899+0000","last_undegraded":"2024-09-21T13:39:27.710899+0000","last_fullsized":"2024-09-21T13:39:27.710899+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:08.467765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414367+0000","last_change":"2024-09-21T13:39:03.694775+0000","last_active":"2024-09-21T13:39:27.414367+0000","last_peered":"2024-09-21T13:39:27.414367+0000","last_clean":"2024-09-21T13:39:27.414367+0000","last_became_active":"2024-09-21T13:39:03.687363+0000","last_became_peered":"2024-09-21T13:39:03.687363+0000","last_unstale":"2024-09-21T13:39:27.414367+0000","last_undegraded":"2024-09-21T13:39:27.414367+0000","last_fullsized":"2024-09-21T13:39:27.414367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:05.078737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416371+0000","last_change":"2024-09-21T13:38:57.654567+0000","last_active":"2024-09-21T13:39:27.416371+0000","last_peered":"2024-09-21T13:39:27.416371+0000","last_clean":"2024-09-21T13:39:27.416371+0000","last_became_active":"2024-09-21T13:38:57.654298+0000","last_became_peered":"2024-09-21T13:38:57.654298+0000","last_unstale":"2024-09-21T13:39:27.416371+0000","last_undegraded":"2024-09-21T13:39:27.416371+0000","last_fullsized":"2024-09-21T13:39:27.416371+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:42.011115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"61'15","reported_seq":51,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414919+0000","last_change":"2024-09-21T13:38:59.652263+0000","last_active":"2024-09-21T13:39:27.414919+0000","last_peered":"2024-09-21T13:39:27.414919+0000","last_clean":"2024-09-21T13:39:27.414919+0000","last_became_active":"2024-09-21T13:38:59.651930+0000","last_became_peered":"2024-09-21T13:38:59.651930+0000","last_unstale":"2024-09-21T13:39:27.414919+0000","last_undegraded":"2024-09-21T13:39:27.414919+0000","last_fullsized":"2024-09-21T13:39:27.414919+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:46.654124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711713+0000","last_change":"2024-09-21T13:39:01.676569+0000","last_active":"2024-09-21T13:39:27.711713+0000","last_peered":"2024-09-21T13:39:27.711713+0000","last_clean":"2024-09-21T13:39:27.711713+0000","last_became_active":"2024-09-21T13:39:01.676331+0000","last_became_peered":"2024-09-21T13:39:01.676331+0000","last_unstale":"2024-09-21T13:39:27.711713+0000","last_undegraded":"2024-09-21T13:39:27.711713+0000","last_fullsized":"2024-09-21T13:39:27.711713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:37:24.808617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711425+0000","last_change":"2024-09-21T13:38:57.647233+0000","last_active":"2024-09-21T13:39:27.711425+0000","last_peered":"2024-09-21T13:39:27.711425+0000","last_clean":"2024-09-21T13:39:27.711425+0000","last_became_active":"2024-09-21T13:38:57.646918+0000","last_became_peered":"2024-09-21T13:38:57.646918+0000","last_unstale":"2024-09-21T13:39:27.711425+0000","last_undegraded":"2024-09-21T13:39:27.711425+0000","last_fullsized":"2024-09-21T13:39:27.711425+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:11.989903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711155+0000","last_change":"2024-09-21T13:38:59.651688+0000","last_active":"2024-09-21T13:39:27.711155+0000","last_peered":"2024-09-21T13:39:27.711155+0000","last_clean":"2024-09-21T13:39:27.711155+0000","last_became_active":"2024-09-21T13:38:59.651100+0000","last_became_peered":"2024-09-21T13:38:59.651100+0000","last_unstale":"2024-09-21T13:39:27.711155+0000","last_undegraded":"2024-09-21T13:39:27.711155+0000","last_fullsized":"2024-09-21T13:39:27.711155+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:08:57.230493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710062+0000","last_change":"2024-09-21T13:39:01.679132+0000","last_active":"2024-09-21T13:39:27.710062+0000","last_peered":"2024-09-21T13:39:27.710062+0000","last_clean":"2024-09-21T13:39:27.710062+0000","last_became_active":"2024-09-21T13:39:01.678817+0000","last_became_peered":"2024-09-21T13:39:01.678817+0000","last_unstale":"2024-09-21T13:39:27.710062+0000","last_undegraded":"2024-09-21T13:39:27.710062+0000","last_fullsized":"2024-09-21T13:39:27.710062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:17:49.590743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711210+0000","last_change":"2024-09-21T13:39:03.691789+0000","last_active":"2024-09-21T13:39:27.711210+0000","last_peered":"2024-09-21T13:39:27.711210+0000","last_clean":"2024-09-21T13:39:27.711210+0000","last_became_active":"2024-09-21T13:39:03.691431+0000","last_became_peered":"2024-09-21T13:39:03.691431+0000","last_unstale":"2024-09-21T13:39:27.711210+0000","last_undegraded":"2024-09-21T13:39:27.711210+0000","last_fullsized":"2024-09-21T13:39:27.711210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:20.741822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710137+0000","last_change":"2024-09-21T13:38:57.653620+0000","last_active":"2024-09-21T13:39:27.710137+0000","last_peered":"2024-09-21T13:39:27.710137+0000","last_clean":"2024-09-21T13:39:27.710137+0000","last_became_active":"2024-09-21T13:38:57.653286+0000","last_became_peered":"2024-09-21T13:38:57.653286+0000","last_unstale":"2024-09-21T13:39:27.710137+0000","last_undegraded":"2024-09-21T13:39:27.710137+0000","last_fullsized":"2024-09-21T13:39:27.710137+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:05:56.567983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"61'5","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710980+0000","last_change":"2024-09-21T13:38:59.661169+0000","last_active":"2024-09-21T13:39:27.710980+0000","last_peered":"2024-09-21T13:39:27.710980+0000","last_clean":"2024-09-21T13:39:27.710980+0000","last_became_active":"2024-09-21T13:38:59.660514+0000","last_became_peered":"2024-09-21T13:38:59.660514+0000","last_unstale":"2024-09-21T13:39:27.710980+0000","last_undegraded":"2024-09-21T13:39:27.710980+0000","last_fullsized":"2024-09-21T13:39:27.710980+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:26.457569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416730+0000","last_change":"2024-09-21T13:39:01.681895+0000","last_active":"2024-09-21T13:39:27.416730+0000","last_peered":"2024-09-21T13:39:27.416730+0000","last_clean":"2024-09-21T13:39:27.416730+0000","last_became_active":"2024-09-21T13:39:01.681590+0000","last_became_peered":"2024-09-21T13:39:01.681590+0000","last_unstale":"2024-09-21T13:39:27.416730+0000","last_undegraded":"2024-09-21T13:39:27.416730+0000","last_fullsized":"2024-09-21T13:39:27.416730+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:42:18.974778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709087+0000","last_change":"2024-09-21T13:39:03.692723+0000","last_active":"2024-09-21T13:39:27.709087+0000","last_peered":"2024-09-21T13:39:27.709087+0000","last_clean":"2024-09-21T13:39:27.709087+0000","last_became_active":"2024-09-21T13:39:03.692319+0000","last_became_peered":"2024-09-21T13:39:03.692319+0000","last_unstale":"2024-09-21T13:39:27.709087+0000","last_undegraded":"2024-09-21T13:39:27.709087+0000","last_fullsized":"2024-09-21T13:39:27.709087+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:34.617850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711793+0000","last_change":"2024-09-21T13:39:03.686938+0000","last_active":"2024-09-21T13:39:27.711793+0000","last_peered":"2024-09-21T13:39:27.711793+0000","last_clean":"2024-09-21T13:39:27.711793+0000","last_became_active":"2024-09-21T13:39:03.686649+0000","last_became_peered":"2024-09-21T13:39:03.686649+0000","last_unstale":"2024-09-21T13:39:27.711793+0000","last_undegraded":"2024-09-21T13:39:27.711793+0000","last_fullsized":"2024-09-21T13:39:27.711793+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:33.033587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712928+0000","last_change":"2024-09-21T13:38:57.648238+0000","last_active":"2024-09-21T13:39:27.712928+0000","last_peered":"2024-09-21T13:39:27.712928+0000","last_clean":"2024-09-21T13:39:27.712928+0000","last_became_active":"2024-09-21T13:38:57.647482+0000","last_became_peered":"2024-09-21T13:38:57.647482+0000","last_unstale":"2024-09-21T13:39:27.712928+0000","last_undegraded":"2024-09-21T13:39:27.712928+0000","last_fullsized":"2024-09-21T13:39:27.712928+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:01:34.707995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"61'15","reported_seq":51,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416012+0000","last_change":"2024-09-21T13:38:59.656652+0000","last_active":"2024-09-21T13:39:27.416012+0000","last_peered":"2024-09-21T13:39:27.416012+0000","last_clean":"2024-09-21T13:39:27.416012+0000","last_became_active":"2024-09-21T13:38:59.656238+0000","last_became_peered":"2024-09-21T13:38:59.656238+0000","last_unstale":"2024-09-21T13:39:27.416012+0000","last_undegraded":"2024-09-21T13:39:27.416012+0000","last_fullsized":"2024-09-21T13:39:27.416012+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:58:32.310250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711036+0000","last_change":"2024-09-21T13:39:01.685632+0000","last_active":"2024-09-21T13:39:27.711036+0000","last_peered":"2024-09-21T13:39:27.711036+0000","last_clean":"2024-09-21T13:39:27.711036+0000","last_became_active":"2024-09-21T13:39:01.685080+0000","last_became_peered":"2024-09-21T13:39:01.685080+0000","last_unstale":"2024-09-21T13:39:27.711036+0000","last_undegraded":"2024-09-21T13:39:27.711036+0000","last_fullsized":"2024-09-21T13:39:27.711036+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:17.920636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416471+0000","last_change":"2024-09-21T13:39:03.688577+0000","last_active":"2024-09-21T13:39:27.416471+0000","last_peered":"2024-09-21T13:39:27.416471+0000","last_clean":"2024-09-21T13:39:27.416471+0000","last_became_active":"2024-09-21T13:39:03.688283+0000","last_became_peered":"2024-09-21T13:39:03.688283+0000","last_unstale":"2024-09-21T13:39:27.416471+0000","last_undegraded":"2024-09-21T13:39:27.416471+0000","last_fullsized":"2024-09-21T13:39:27.416471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:21:58.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"54'2","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711309+0000","last_change":"2024-09-21T13:38:57.645402+0000","last_active":"2024-09-21T13:39:27.711309+0000","last_peered":"2024-09-21T13:39:27.711309+0000","last_clean":"2024-09-21T13:39:27.711309+0000","last_became_active":"2024-09-21T13:38:57.645079+0000","last_became_peered":"2024-09-21T13:38:57.645079+0000","last_unstale":"2024-09-21T13:39:27.711309+0000","last_undegraded":"2024-09-21T13:39:27.711309+0000","last_fullsized":"2024-09-21T13:39:27.711309+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:48.562578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"61'12","reported_seq":49,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.415645+0000","last_change":"2024-09-21T13:38:59.659212+0000","last_active":"2024-09-21T13:39:27.415645+0000","last_peered":"2024-09-21T13:39:27.415645+0000","last_clean":"2024-09-21T13:39:27.415645+0000","last_became_active":"2024-09-21T13:38:59.658620+0000","last_became_peered":"2024-09-21T13:38:59.658620+0000","last_unstale":"2024-09-21T13:39:27.415645+0000","last_undegraded":"2024-09-21T13:39:27.415645+0000","last_fullsized":"2024-09-21T13:39:27.415645+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:24.108982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711186+0000","last_change":"2024-09-21T13:39:01.677191+0000","last_active":"2024-09-21T13:39:27.711186+0000","last_peered":"2024-09-21T13:39:27.711186+0000","last_clean":"2024-09-21T13:39:27.711186+0000","last_became_active":"2024-09-21T13:39:01.676778+0000","last_became_peered":"2024-09-21T13:39:01.676778+0000","last_unstale":"2024-09-21T13:39:27.711186+0000","last_undegraded":"2024-09-21T13:39:27.711186+0000","last_fullsized":"2024-09-21T13:39:27.711186+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:24.984729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"61'1","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416894+0000","last_change":"2024-09-21T13:39:03.690615+0000","last_active":"2024-09-21T13:39:27.416894+0000","last_peered":"2024-09-21T13:39:27.416894+0000","last_clean":"2024-09-21T13:39:27.416894+0000","last_became_active":"2024-09-21T13:39:03.690326+0000","last_became_peered":"2024-09-21T13:39:03.690326+0000","last_unstale":"2024-09-21T13:39:27.416894+0000","last_undegraded":"2024-09-21T13:39:27.416894+0000","last_fullsized":"2024-09-21T13:39:27.416894+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:46:59.408341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"54'1","reported_seq":31,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709825+0000","last_change":"2024-09-21T13:38:57.648548+0000","last_active":"2024-09-21T13:39:27.709825+0000","last_peered":"2024-09-21T13:39:27.709825+0000","last_clean":"2024-09-21T13:39:27.709825+0000","last_became_active":"2024-09-21T13:38:57.648247+0000","last_became_peered":"2024-09-21T13:38:57.648247+0000","last_unstale":"2024-09-21T13:39:27.709825+0000","last_undegraded":"2024-09-21T13:39:27.709825+0000","last_fullsized":"2024-09-21T13:39:27.709825+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:21:57.402439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"61'10","reported_seq":41,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712282+0000","last_change":"2024-09-21T13:38:59.792735+0000","last_active":"2024-09-21T13:39:27.712282+0000","last_peered":"2024-09-21T13:39:27.712282+0000","last_clean":"2024-09-21T13:39:27.712282+0000","last_became_active":"2024-09-21T13:38:59.792396+0000","last_became_peered":"2024-09-21T13:38:59.792396+0000","last_unstale":"2024-09-21T13:39:27.712282+0000","last_undegraded":"2024-09-21T13:39:27.712282+0000","last_fullsized":"2024-09-21T13:39:27.712282+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:03.202359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"61'8","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709149+0000","last_change":"2024-09-21T13:39:01.676568+0000","last_active":"2024-09-21T13:39:32.709149+0000","last_peered":"2024-09-21T13:39:32.709149+0000","last_clean":"2024-09-21T13:39:32.709149+0000","last_became_active":"2024-09-21T13:39:01.674558+0000","last_became_peered":"2024-09-21T13:39:01.674558+0000","last_unstale":"2024-09-21T13:39:32.709149+0000","last_undegraded":"2024-09-21T13:39:32.709149+0000","last_fullsized":"2024-09-21T13:39:32.709149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:19:45.773500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"61'15","reported_seq":51,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711416+0000","last_change":"2024-09-21T13:38:59.662120+0000","last_active":"2024-09-21T13:39:27.711416+0000","last_peered":"2024-09-21T13:39:27.711416+0000","last_clean":"2024-09-21T13:39:27.711416+0000","last_became_active":"2024-09-21T13:38:59.661827+0000","last_became_peered":"2024-09-21T13:38:59.661827+0000","last_unstale":"2024-09-21T13:39:27.711416+0000","last_undegraded":"2024-09-21T13:39:27.711416+0000","last_fullsized":"2024-09-21T13:39:27.711416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:51.551677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414709+0000","last_change":"2024-09-21T13:38:57.647793+0000","last_active":"2024-09-21T13:39:27.414709+0000","last_peered":"2024-09-21T13:39:27.414709+0000","last_clean":"2024-09-21T13:39:27.414709+0000","last_became_active":"2024-09-21T13:38:57.647473+0000","last_became_peered":"2024-09-21T13:38:57.647473+0000","last_unstale":"2024-09-21T13:39:27.414709+0000","last_undegraded":"2024-09-21T13:39:27.414709+0000","last_fullsized":"2024-09-21T13:39:27.414709+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:25:29.767080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709141+0000","last_change":"2024-09-21T13:39:01.679661+0000","last_active":"2024-09-21T13:39:32.709141+0000","last_peered":"2024-09-21T13:39:32.709141+0000","last_clean":"2024-09-21T13:39:32.709141+0000","last_became_active":"2024-09-21T13:39:01.679360+0000","last_became_peered":"2024-09-21T13:39:01.679360+0000","last_unstale":"2024-09-21T13:39:32.709141+0000","last_undegraded":"2024-09-21T13:39:32.709141+0000","last_fullsized":"2024-09-21T13:39:32.709141+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:44:12.275781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710820+0000","last_change":"2024-09-21T13:39:03.690094+0000","last_active":"2024-09-21T13:39:27.710820+0000","last_peered":"2024-09-21T13:39:27.710820+0000","last_clean":"2024-09-21T13:39:27.710820+0000","last_became_active":"2024-09-21T13:39:03.689824+0000","last_became_peered":"2024-09-21T13:39:03.689824+0000","last_unstale":"2024-09-21T13:39:27.710820+0000","last_undegraded":"2024-09-21T13:39:27.710820+0000","last_fullsized":"2024-09-21T13:39:27.710820+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:13:58.061595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"61'18","reported_seq":58,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414420+0000","last_change":"2024-09-21T13:38:59.789784+0000","last_active":"2024-09-21T13:39:27.414420+0000","last_peered":"2024-09-21T13:39:27.414420+0000","last_clean":"2024-09-21T13:39:27.414420+0000","last_became_active":"2024-09-21T13:38:59.789144+0000","last_became_peered":"2024-09-21T13:38:59.789144+0000","last_unstale":"2024-09-21T13:39:27.414420+0000","last_undegraded":"2024-09-21T13:39:27.414420+0000","last_fullsized":"2024-09-21T13:39:27.414420+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:12:08.530369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416877+0000","last_change":"2024-09-21T13:38:57.650742+0000","last_active":"2024-09-21T13:39:27.416877+0000","last_peered":"2024-09-21T13:39:27.416877+0000","last_clean":"2024-09-21T13:39:27.416877+0000","last_became_active":"2024-09-21T13:38:57.650407+0000","last_became_peered":"2024-09-21T13:38:57.650407+0000","last_unstale":"2024-09-21T13:39:27.416877+0000","last_undegraded":"2024-09-21T13:39:27.416877+0000","last_fullsized":"2024-09-21T13:39:27.416877+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:27:53.726110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711733+0000","last_change":"2024-09-21T13:39:01.676163+0000","last_active":"2024-09-21T13:39:27.711733+0000","last_peered":"2024-09-21T13:39:27.711733+0000","last_clean":"2024-09-21T13:39:27.711733+0000","last_became_active":"2024-09-21T13:39:01.675737+0000","last_became_peered":"2024-09-21T13:39:01.675737+0000","last_unstale":"2024-09-21T13:39:27.711733+0000","last_undegraded":"2024-09-21T13:39:27.711733+0000","last_fullsized":"2024-09-21T13:39:27.711733+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:01:41.504495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.708994+0000","last_change":"2024-09-21T13:39:03.686911+0000","last_active":"2024-09-21T13:39:27.708994+0000","last_peered":"2024-09-21T13:39:27.708994+0000","last_clean":"2024-09-21T13:39:27.708994+0000","last_became_active":"2024-09-21T13:39:03.686618+0000","last_became_peered":"2024-09-21T13:39:03.686618+0000","last_unstale":"2024-09-21T13:39:27.708994+0000","last_undegraded":"2024-09-21T13:39:27.708994+0000","last_fullsized":"2024-09-21T13:39:27.708994+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:09.692365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"61'14","reported_seq":47,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712197+0000","last_change":"2024-09-21T13:38:59.652621+0000","last_active":"2024-09-21T13:39:27.712197+0000","last_peered":"2024-09-21T13:39:27.712197+0000","last_clean":"2024-09-21T13:39:27.712197+0000","last_became_active":"2024-09-21T13:38:59.652246+0000","last_became_peered":"2024-09-21T13:38:59.652246+0000","last_unstale":"2024-09-21T13:39:27.712197+0000","last_undegraded":"2024-09-21T13:39:27.712197+0000","last_fullsized":"2024-09-21T13:39:27.712197+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:51:54.589353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"54'1","reported_seq":31,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712705+0000","last_change":"2024-09-21T13:38:57.645771+0000","last_active":"2024-09-21T13:39:27.712705+0000","last_peered":"2024-09-21T13:39:27.712705+0000","last_clean":"2024-09-21T13:39:27.712705+0000","last_became_active":"2024-09-21T13:38:57.645463+0000","last_became_peered":"2024-09-21T13:38:57.645463+0000","last_unstale":"2024-09-21T13:39:27.712705+0000","last_undegraded":"2024-09-21T13:39:27.712705+0000","last_fullsized":"2024-09-21T13:39:27.712705+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:53:01.301240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"61'8","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.708921+0000","last_change":"2024-09-21T13:39:01.677552+0000","last_active":"2024-09-21T13:39:32.708921+0000","last_peered":"2024-09-21T13:39:32.708921+0000","last_clean":"2024-09-21T13:39:32.708921+0000","last_became_active":"2024-09-21T13:39:01.677230+0000","last_became_peered":"2024-09-21T13:39:01.677230+0000","last_unstale":"2024-09-21T13:39:32.708921+0000","last_undegraded":"2024-09-21T13:39:32.708921+0000","last_fullsized":"2024-09-21T13:39:32.708921+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:19:08.146664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416991+0000","last_change":"2024-09-21T13:39:03.688503+0000","last_active":"2024-09-21T13:39:27.416991+0000","last_peered":"2024-09-21T13:39:27.416991+0000","last_clean":"2024-09-21T13:39:27.416991+0000","last_became_active":"2024-09-21T13:39:03.688200+0000","last_became_peered":"2024-09-21T13:39:03.688200+0000","last_unstale":"2024-09-21T13:39:27.416991+0000","last_undegraded":"2024-09-21T13:39:27.416991+0000","last_fullsized":"2024-09-21T13:39:27.416991+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:10.398736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"61'10","reported_seq":41,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709329+0000","last_change":"2024-09-21T13:38:59.662308+0000","last_active":"2024-09-21T13:39:27.709329+0000","last_peered":"2024-09-21T13:39:27.709329+0000","last_clean":"2024-09-21T13:39:27.709329+0000","last_became_active":"2024-09-21T13:38:59.661563+0000","last_became_peered":"2024-09-21T13:38:59.661563+0000","last_unstale":"2024-09-21T13:39:27.709329+0000","last_undegraded":"2024-09-21T13:39:27.709329+0000","last_fullsized":"2024-09-21T13:39:27.709329+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:46:27.702673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711515+0000","last_change":"2024-09-21T13:38:57.648779+0000","last_active":"2024-09-21T13:39:27.711515+0000","last_peered":"2024-09-21T13:39:27.711515+0000","last_clean":"2024-09-21T13:39:27.711515+0000","last_became_active":"2024-09-21T13:38:57.648482+0000","last_became_peered":"2024-09-21T13:38:57.648482+0000","last_unstale":"2024-09-21T13:39:27.711515+0000","last_undegraded":"2024-09-21T13:39:27.711515+0000","last_fullsized":"2024-09-21T13:39:27.711515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:58.152769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.708809+0000","last_change":"2024-09-21T13:39:01.681574+0000","last_active":"2024-09-21T13:39:32.708809+0000","last_peered":"2024-09-21T13:39:32.708809+0000","last_clean":"2024-09-21T13:39:32.708809+0000","last_became_active":"2024-09-21T13:39:01.681254+0000","last_became_peered":"2024-09-21T13:39:01.681254+0000","last_unstale":"2024-09-21T13:39:32.708809+0000","last_undegraded":"2024-09-21T13:39:32.708809+0000","last_fullsized":"2024-09-21T13:39:32.708809+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:25.741553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711070+0000","last_change":"2024-09-21T13:39:03.687178+0000","last_active":"2024-09-21T13:39:27.711070+0000","last_peered":"2024-09-21T13:39:27.711070+0000","last_clean":"2024-09-21T13:39:27.711070+0000","last_became_active":"2024-09-21T13:39:03.686877+0000","last_became_peered":"2024-09-21T13:39:03.686877+0000","last_unstale":"2024-09-21T13:39:27.711070+0000","last_undegraded":"2024-09-21T13:39:27.711070+0000","last_fullsized":"2024-09-21T13:39:27.711070+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:07.289379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"61'19","reported_seq":62,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712601+0000","last_change":"2024-09-21T13:38:59.791291+0000","last_active":"2024-09-21T13:39:27.712601+0000","last_peered":"2024-09-21T13:39:27.712601+0000","last_clean":"2024-09-21T13:39:27.712601+0000","last_became_active":"2024-09-21T13:38:59.790860+0000","last_became_peered":"2024-09-21T13:38:59.790860+0000","last_unstale":"2024-09-21T13:39:27.712601+0000","last_undegraded":"2024-09-21T13:39:27.712601+0000","last_fullsized":"2024-09-21T13:39:27.712601+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:14.469246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710765+0000","last_change":"2024-09-21T13:38:57.654352+0000","last_active":"2024-09-21T13:39:27.710765+0000","last_peered":"2024-09-21T13:39:27.710765+0000","last_clean":"2024-09-21T13:39:27.710765+0000","last_became_active":"2024-09-21T13:38:57.653872+0000","last_became_peered":"2024-09-21T13:38:57.653872+0000","last_unstale":"2024-09-21T13:39:27.710765+0000","last_undegraded":"2024-09-21T13:39:27.710765+0000","last_fullsized":"2024-09-21T13:39:27.710765+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:15.672888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709533+0000","last_change":"2024-09-21T13:39:01.678125+0000","last_active":"2024-09-21T13:39:27.709533+0000","last_peered":"2024-09-21T13:39:27.709533+0000","last_clean":"2024-09-21T13:39:27.709533+0000","last_became_active":"2024-09-21T13:39:01.677858+0000","last_became_peered":"2024-09-21T13:39:01.677858+0000","last_unstale":"2024-09-21T13:39:27.709533+0000","last_undegraded":"2024-09-21T13:39:27.709533+0000","last_fullsized":"2024-09-21T13:39:27.709533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:55:24.227276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.708881+0000","last_change":"2024-09-21T13:39:03.691121+0000","last_active":"2024-09-21T13:39:27.708881+0000","last_peered":"2024-09-21T13:39:27.708881+0000","last_clean":"2024-09-21T13:39:27.708881+0000","last_became_active":"2024-09-21T13:39:03.690831+0000","last_became_peered":"2024-09-21T13:39:03.690831+0000","last_unstale":"2024-09-21T13:39:27.708881+0000","last_undegraded":"2024-09-21T13:39:27.708881+0000","last_fullsized":"2024-09-21T13:39:27.708881+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:06:49.661307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"61'28","reported_seq":83,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.708825+0000","last_change":"2024-09-21T13:38:59.663682+0000","last_active":"2024-09-21T13:39:32.708825+0000","last_peered":"2024-09-21T13:39:32.708825+0000","last_clean":"2024-09-21T13:39:32.708825+0000","last_became_active":"2024-09-21T13:38:59.663364+0000","last_became_peered":"2024-09-21T13:38:59.663364+0000","last_unstale":"2024-09-21T13:39:32.708825+0000","last_undegraded":"2024-09-21T13:39:32.708825+0000","last_fullsized":"2024-09-21T13:39:32.708825+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:18:30.131139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711232+0000","last_change":"2024-09-21T13:38:57.645420+0000","last_active":"2024-09-21T13:39:27.711232+0000","last_peered":"2024-09-21T13:39:27.711232+0000","last_clean":"2024-09-21T13:39:27.711232+0000","last_became_active":"2024-09-21T13:38:57.645112+0000","last_became_peered":"2024-09-21T13:38:57.645112+0000","last_unstale":"2024-09-21T13:39:27.711232+0000","last_undegraded":"2024-09-21T13:39:27.711232+0000","last_fullsized":"2024-09-21T13:39:27.711232+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:35.799087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"56'2","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710163+0000","last_change":"2024-09-21T13:38:59.650223+0000","last_active":"2024-09-21T13:39:27.710163+0000","last_peered":"2024-09-21T13:39:27.710163+0000","last_clean":"2024-09-21T13:39:27.710163+0000","last_became_active":"2024-09-21T13:38:56.639700+0000","last_became_peered":"2024-09-21T13:38:56.639700+0000","last_unstale":"2024-09-21T13:39:27.710163+0000","last_undegraded":"2024-09-21T13:39:27.710163+0000","last_fullsized":"2024-09-21T13:39:27.710163+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_clean_scrub_stamp":"2024-09-21T13:38:55.616207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:47.645996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017482470000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710335+0000","last_change":"2024-09-21T13:39:01.683348+0000","last_active":"2024-09-21T13:39:27.710335+0000","last_peered":"2024-09-21T13:39:27.710335+0000","last_clean":"2024-09-21T13:39:27.710335+0000","last_became_active":"2024-09-21T13:39:01.682604+0000","last_became_peered":"2024-09-21T13:39:01.682604+0000","last_unstale":"2024-09-21T13:39:27.710335+0000","last_undegraded":"2024-09-21T13:39:27.710335+0000","last_fullsized":"2024-09-21T13:39:27.710335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:19:55.026716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416100+0000","last_change":"2024-09-21T13:39:03.689985+0000","last_active":"2024-09-21T13:39:27.416100+0000","last_peered":"2024-09-21T13:39:27.416100+0000","last_clean":"2024-09-21T13:39:27.416100+0000","last_became_active":"2024-09-21T13:39:03.689304+0000","last_became_peered":"2024-09-21T13:39:03.689304+0000","last_unstale":"2024-09-21T13:39:27.416100+0000","last_undegraded":"2024-09-21T13:39:27.416100+0000","last_fullsized":"2024-09-21T13:39:27.416100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:30:04.475735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'13","reported_seq":53,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711478+0000","last_change":"2024-09-21T13:38:59.660943+0000","last_active":"2024-09-21T13:39:27.711478+0000","last_peered":"2024-09-21T13:39:27.711478+0000","last_clean":"2024-09-21T13:39:27.711478+0000","last_became_active":"2024-09-21T13:38:59.660587+0000","last_became_peered":"2024-09-21T13:38:59.660587+0000","last_unstale":"2024-09-21T13:39:27.711478+0000","last_undegraded":"2024-09-21T13:39:27.711478+0000","last_fullsized":"2024-09-21T13:39:27.711478+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:20.002123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710038+0000","last_change":"2024-09-21T13:38:57.645289+0000","last_active":"2024-09-21T13:39:27.710038+0000","last_peered":"2024-09-21T13:39:27.710038+0000","last_clean":"2024-09-21T13:39:27.710038+0000","last_became_active":"2024-09-21T13:38:57.644958+0000","last_became_peered":"2024-09-21T13:38:57.644958+0000","last_unstale":"2024-09-21T13:39:27.710038+0000","last_undegraded":"2024-09-21T13:39:27.710038+0000","last_fullsized":"2024-09-21T13:39:27.710038+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:32.996013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"54'1","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414082+0000","last_change":"2024-09-21T13:38:59.643281+0000","last_active":"2024-09-21T13:39:27.414082+0000","last_peered":"2024-09-21T13:39:27.414082+0000","last_clean":"2024-09-21T13:39:27.414082+0000","last_became_active":"2024-09-21T13:38:56.640592+0000","last_became_peered":"2024-09-21T13:38:56.640592+0000","last_unstale":"2024-09-21T13:39:27.414082+0000","last_undegraded":"2024-09-21T13:39:27.414082+0000","last_fullsized":"2024-09-21T13:39:27.414082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_clean_scrub_stamp":"2024-09-21T13:38:55.616207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:46.243563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057461199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.415530+0000","last_change":"2024-09-21T13:39:01.673159+0000","last_active":"2024-09-21T13:39:27.415530+0000","last_peered":"2024-09-21T13:39:27.415530+0000","last_clean":"2024-09-21T13:39:27.415530+0000","last_became_active":"2024-09-21T13:39:01.672829+0000","last_became_peered":"2024-09-21T13:39:01.672829+0000","last_unstale":"2024-09-21T13:39:27.415530+0000","last_undegraded":"2024-09-21T13:39:27.415530+0000","last_fullsized":"2024-09-21T13:39:27.415530+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:25.765536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417409+0000","last_change":"2024-09-21T13:39:03.693296+0000","last_active":"2024-09-21T13:39:27.417409+0000","last_peered":"2024-09-21T13:39:27.417409+0000","last_clean":"2024-09-21T13:39:27.417409+0000","last_became_active":"2024-09-21T13:39:03.693005+0000","last_became_peered":"2024-09-21T13:39:03.693005+0000","last_unstale":"2024-09-21T13:39:27.417409+0000","last_undegraded":"2024-09-21T13:39:27.417409+0000","last_fullsized":"2024-09-21T13:39:27.417409+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:45.158722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"61'12","reported_seq":44,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712419+0000","last_change":"2024-09-21T13:38:59.661986+0000","last_active":"2024-09-21T13:39:27.712419+0000","last_peered":"2024-09-21T13:39:27.712419+0000","last_clean":"2024-09-21T13:39:27.712419+0000","last_became_active":"2024-09-21T13:38:59.661634+0000","last_became_peered":"2024-09-21T13:38:59.661634+0000","last_unstale":"2024-09-21T13:39:27.712419+0000","last_undegraded":"2024-09-21T13:39:27.712419+0000","last_fullsized":"2024-09-21T13:39:27.712419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:40:52.869372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709559+0000","last_change":"2024-09-21T13:38:57.646808+0000","last_active":"2024-09-21T13:39:27.709559+0000","last_peered":"2024-09-21T13:39:27.709559+0000","last_clean":"2024-09-21T13:39:27.709559+0000","last_became_active":"2024-09-21T13:38:57.646538+0000","last_became_peered":"2024-09-21T13:38:57.646538+0000","last_unstale":"2024-09-21T13:39:27.709559+0000","last_undegraded":"2024-09-21T13:39:27.709559+0000","last_fullsized":"2024-09-21T13:39:27.709559+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:17:41.823491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"62'5","reported_seq":76,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:36.526046+0000","last_change":"2024-09-21T13:38:59.789486+0000","last_active":"2024-09-21T13:39:36.526046+0000","last_peered":"2024-09-21T13:39:36.526046+0000","last_clean":"2024-09-21T13:39:36.526046+0000","last_became_active":"2024-09-21T13:38:56.640603+0000","last_became_peered":"2024-09-21T13:38:56.640603+0000","last_unstale":"2024-09-21T13:39:36.526046+0000","last_undegraded":"2024-09-21T13:39:36.526046+0000","last_fullsized":"2024-09-21T13:39:36.526046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:55.616207+0000","last_clean_scrub_stamp":"2024-09-21T13:38:55.616207+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:28.529824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047441699999999998,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710666+0000","last_change":"2024-09-21T13:39:01.680411+0000","last_active":"2024-09-21T13:39:27.710666+0000","last_peered":"2024-09-21T13:39:27.710666+0000","last_clean":"2024-09-21T13:39:27.710666+0000","last_became_active":"2024-09-21T13:39:01.680149+0000","last_became_peered":"2024-09-21T13:39:01.680149+0000","last_unstale":"2024-09-21T13:39:27.710666+0000","last_undegraded":"2024-09-21T13:39:27.710666+0000","last_fullsized":"2024-09-21T13:39:27.710666+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:34:25.503933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.708881+0000","last_change":"2024-09-21T13:39:03.694846+0000","last_active":"2024-09-21T13:39:27.708881+0000","last_peered":"2024-09-21T13:39:27.708881+0000","last_clean":"2024-09-21T13:39:27.708881+0000","last_became_active":"2024-09-21T13:39:03.694433+0000","last_became_peered":"2024-09-21T13:39:03.694433+0000","last_unstale":"2024-09-21T13:39:27.708881+0000","last_undegraded":"2024-09-21T13:39:27.708881+0000","last_fullsized":"2024-09-21T13:39:27.708881+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:15.078059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"61'16","reported_seq":57,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709276+0000","last_change":"2024-09-21T13:38:59.789499+0000","last_active":"2024-09-21T13:39:32.709276+0000","last_peered":"2024-09-21T13:39:32.709276+0000","last_clean":"2024-09-21T13:39:32.709276+0000","last_became_active":"2024-09-21T13:38:59.789140+0000","last_became_peered":"2024-09-21T13:38:59.789140+0000","last_unstale":"2024-09-21T13:39:32.709276+0000","last_undegraded":"2024-09-21T13:39:32.709276+0000","last_fullsized":"2024-09-21T13:39:32.709276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:45.973666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.415185+0000","last_change":"2024-09-21T13:38:57.646724+0000","last_active":"2024-09-21T13:39:27.415185+0000","last_peered":"2024-09-21T13:39:27.415185+0000","last_clean":"2024-09-21T13:39:27.415185+0000","last_became_active":"2024-09-21T13:38:57.646423+0000","last_became_peered":"2024-09-21T13:38:57.646423+0000","last_unstale":"2024-09-21T13:39:27.415185+0000","last_undegraded":"2024-09-21T13:39:27.415185+0000","last_fullsized":"2024-09-21T13:39:27.415185+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:02:13.517329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"63'79","reported_seq":67,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:29.896354+0000","last_change":"2024-09-21T13:38:48.251077+0000","last_active":"2024-09-21T13:39:29.896354+0000","last_peered":"2024-09-21T13:39:29.896354+0000","last_clean":"2024-09-21T13:39:29.896354+0000","last_became_active":"2024-09-21T13:38:48.244809+0000","last_became_peered":"2024-09-21T13:38:48.244809+0000","last_unstale":"2024-09-21T13:39:29.896354+0000","last_undegraded":"2024-09-21T13:39:29.896354+0000","last_fullsized":"2024-09-21T13:39:29.896354+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:36:22.764708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:36:22.764708+0000","last_clean_scrub_stamp":"2024-09-21T13:36:22.764708+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:22:02.756737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417068+0000","last_change":"2024-09-21T13:39:01.677460+0000","last_active":"2024-09-21T13:39:27.417068+0000","last_peered":"2024-09-21T13:39:27.417068+0000","last_clean":"2024-09-21T13:39:27.417068+0000","last_became_active":"2024-09-21T13:39:01.677161+0000","last_became_peered":"2024-09-21T13:39:01.677161+0000","last_unstale":"2024-09-21T13:39:27.417068+0000","last_undegraded":"2024-09-21T13:39:27.417068+0000","last_fullsized":"2024-09-21T13:39:27.417068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:57.704114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709529+0000","last_change":"2024-09-21T13:39:03.691400+0000","last_active":"2024-09-21T13:39:27.709529+0000","last_peered":"2024-09-21T13:39:27.709529+0000","last_clean":"2024-09-21T13:39:27.709529+0000","last_became_active":"2024-09-21T13:39:03.691138+0000","last_became_peered":"2024-09-21T13:39:03.691138+0000","last_unstale":"2024-09-21T13:39:27.709529+0000","last_undegraded":"2024-09-21T13:39:27.709529+0000","last_fullsized":"2024-09-21T13:39:27.709529+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:38.972300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"61'11","reported_seq":45,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711890+0000","last_change":"2024-09-21T13:38:59.660953+0000","last_active":"2024-09-21T13:39:27.711890+0000","last_peered":"2024-09-21T13:39:27.711890+0000","last_clean":"2024-09-21T13:39:27.711890+0000","last_became_active":"2024-09-21T13:38:59.660632+0000","last_became_peered":"2024-09-21T13:38:59.660632+0000","last_unstale":"2024-09-21T13:39:27.711890+0000","last_undegraded":"2024-09-21T13:39:27.711890+0000","last_fullsized":"2024-09-21T13:39:27.711890+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:51.183416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712268+0000","last_change":"2024-09-21T13:38:57.646323+0000","last_active":"2024-09-21T13:39:27.712268+0000","last_peered":"2024-09-21T13:39:27.712268+0000","last_clean":"2024-09-21T13:39:27.712268+0000","last_became_active":"2024-09-21T13:38:57.645231+0000","last_became_peered":"2024-09-21T13:38:57.645231+0000","last_unstale":"2024-09-21T13:39:27.712268+0000","last_undegraded":"2024-09-21T13:39:27.712268+0000","last_fullsized":"2024-09-21T13:39:27.712268+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:09:08.259046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710471+0000","last_change":"2024-09-21T13:39:01.677897+0000","last_active":"2024-09-21T13:39:27.710471+0000","last_peered":"2024-09-21T13:39:27.710471+0000","last_clean":"2024-09-21T13:39:27.710471+0000","last_became_active":"2024-09-21T13:39:01.677610+0000","last_became_peered":"2024-09-21T13:39:01.677610+0000","last_unstale":"2024-09-21T13:39:27.710471+0000","last_undegraded":"2024-09-21T13:39:27.710471+0000","last_fullsized":"2024-09-21T13:39:27.710471+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:43:10.163034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414383+0000","last_change":"2024-09-21T13:39:03.689712+0000","last_active":"2024-09-21T13:39:27.414383+0000","last_peered":"2024-09-21T13:39:27.414383+0000","last_clean":"2024-09-21T13:39:27.414383+0000","last_became_active":"2024-09-21T13:39:03.689235+0000","last_became_peered":"2024-09-21T13:39:03.689235+0000","last_unstale":"2024-09-21T13:39:27.414383+0000","last_undegraded":"2024-09-21T13:39:27.414383+0000","last_fullsized":"2024-09-21T13:39:27.414383+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:53:50.539723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"61'17","reported_seq":54,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711768+0000","last_change":"2024-09-21T13:38:59.660935+0000","last_active":"2024-09-21T13:39:27.711768+0000","last_peered":"2024-09-21T13:39:27.711768+0000","last_clean":"2024-09-21T13:39:27.711768+0000","last_became_active":"2024-09-21T13:38:59.660495+0000","last_became_peered":"2024-09-21T13:38:59.660495+0000","last_unstale":"2024-09-21T13:39:27.711768+0000","last_undegraded":"2024-09-21T13:39:27.711768+0000","last_fullsized":"2024-09-21T13:39:27.711768+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:17.839892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711390+0000","last_change":"2024-09-21T13:38:57.645390+0000","last_active":"2024-09-21T13:39:27.711390+0000","last_peered":"2024-09-21T13:39:27.711390+0000","last_clean":"2024-09-21T13:39:27.711390+0000","last_became_active":"2024-09-21T13:38:57.645099+0000","last_became_peered":"2024-09-21T13:38:57.645099+0000","last_unstale":"2024-09-21T13:39:27.711390+0000","last_undegraded":"2024-09-21T13:39:27.711390+0000","last_fullsized":"2024-09-21T13:39:27.711390+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:18:51.057863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710446+0000","last_change":"2024-09-21T13:39:01.684307+0000","last_active":"2024-09-21T13:39:27.710446+0000","last_peered":"2024-09-21T13:39:27.710446+0000","last_clean":"2024-09-21T13:39:27.710446+0000","last_became_active":"2024-09-21T13:39:01.683639+0000","last_became_peered":"2024-09-21T13:39:01.683639+0000","last_unstale":"2024-09-21T13:39:27.710446+0000","last_undegraded":"2024-09-21T13:39:27.710446+0000","last_fullsized":"2024-09-21T13:39:27.710446+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:30.764260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"61'1","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.415311+0000","last_change":"2024-09-21T13:39:03.683755+0000","last_active":"2024-09-21T13:39:27.415311+0000","last_peered":"2024-09-21T13:39:27.415311+0000","last_clean":"2024-09-21T13:39:27.415311+0000","last_became_active":"2024-09-21T13:39:03.683205+0000","last_became_peered":"2024-09-21T13:39:03.683205+0000","last_unstale":"2024-09-21T13:39:27.415311+0000","last_undegraded":"2024-09-21T13:39:27.415311+0000","last_fullsized":"2024-09-21T13:39:27.415311+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:02.939627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"61'10","reported_seq":41,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711266+0000","last_change":"2024-09-21T13:38:59.652416+0000","last_active":"2024-09-21T13:39:27.711266+0000","last_peered":"2024-09-21T13:39:27.711266+0000","last_clean":"2024-09-21T13:39:27.711266+0000","last_became_active":"2024-09-21T13:38:59.652073+0000","last_became_peered":"2024-09-21T13:38:59.652073+0000","last_unstale":"2024-09-21T13:39:27.711266+0000","last_undegraded":"2024-09-21T13:39:27.711266+0000","last_fullsized":"2024-09-21T13:39:27.711266+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:59:21.998572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414806+0000","last_change":"2024-09-21T13:38:57.648893+0000","last_active":"2024-09-21T13:39:27.414806+0000","last_peered":"2024-09-21T13:39:27.414806+0000","last_clean":"2024-09-21T13:39:27.414806+0000","last_became_active":"2024-09-21T13:38:57.648616+0000","last_became_peered":"2024-09-21T13:38:57.648616+0000","last_unstale":"2024-09-21T13:39:27.414806+0000","last_undegraded":"2024-09-21T13:39:27.414806+0000","last_fullsized":"2024-09-21T13:39:27.414806+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:33:30.876024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.708811+0000","last_change":"2024-09-21T13:39:01.673245+0000","last_active":"2024-09-21T13:39:32.708811+0000","last_peered":"2024-09-21T13:39:32.708811+0000","last_clean":"2024-09-21T13:39:32.708811+0000","last_became_active":"2024-09-21T13:39:01.672945+0000","last_became_peered":"2024-09-21T13:39:01.672945+0000","last_unstale":"2024-09-21T13:39:32.708811+0000","last_undegraded":"2024-09-21T13:39:32.708811+0000","last_fullsized":"2024-09-21T13:39:32.708811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:09.393635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709330+0000","last_change":"2024-09-21T13:39:03.691156+0000","last_active":"2024-09-21T13:39:27.709330+0000","last_peered":"2024-09-21T13:39:27.709330+0000","last_clean":"2024-09-21T13:39:27.709330+0000","last_became_active":"2024-09-21T13:39:03.690530+0000","last_became_peered":"2024-09-21T13:39:03.690530+0000","last_unstale":"2024-09-21T13:39:27.709330+0000","last_undegraded":"2024-09-21T13:39:27.709330+0000","last_fullsized":"2024-09-21T13:39:27.709330+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:39.116971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712480+0000","last_change":"2024-09-21T13:38:59.660854+0000","last_active":"2024-09-21T13:39:27.712480+0000","last_peered":"2024-09-21T13:39:27.712480+0000","last_clean":"2024-09-21T13:39:27.712480+0000","last_became_active":"2024-09-21T13:38:59.660538+0000","last_became_peered":"2024-09-21T13:38:59.660538+0000","last_unstale":"2024-09-21T13:39:27.712480+0000","last_undegraded":"2024-09-21T13:39:27.712480+0000","last_fullsized":"2024-09-21T13:39:27.712480+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:14:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710295+0000","last_change":"2024-09-21T13:38:57.649803+0000","last_active":"2024-09-21T13:39:27.710295+0000","last_peered":"2024-09-21T13:39:27.710295+0000","last_clean":"2024-09-21T13:39:27.710295+0000","last_became_active":"2024-09-21T13:38:57.649517+0000","last_became_peered":"2024-09-21T13:38:57.649517+0000","last_unstale":"2024-09-21T13:39:27.710295+0000","last_undegraded":"2024-09-21T13:39:27.710295+0000","last_fullsized":"2024-09-21T13:39:27.710295+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:48.659250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414324+0000","last_change":"2024-09-21T13:39:01.677035+0000","last_active":"2024-09-21T13:39:27.414324+0000","last_peered":"2024-09-21T13:39:27.414324+0000","last_clean":"2024-09-21T13:39:27.414324+0000","last_became_active":"2024-09-21T13:39:01.676736+0000","last_became_peered":"2024-09-21T13:39:01.676736+0000","last_unstale":"2024-09-21T13:39:27.414324+0000","last_undegraded":"2024-09-21T13:39:27.414324+0000","last_fullsized":"2024-09-21T13:39:27.414324+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:57.795491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709250+0000","last_change":"2024-09-21T13:39:03.682689+0000","last_active":"2024-09-21T13:39:27.709250+0000","last_peered":"2024-09-21T13:39:27.709250+0000","last_clean":"2024-09-21T13:39:27.709250+0000","last_became_active":"2024-09-21T13:39:03.682236+0000","last_became_peered":"2024-09-21T13:39:03.682236+0000","last_unstale":"2024-09-21T13:39:27.709250+0000","last_undegraded":"2024-09-21T13:39:27.709250+0000","last_fullsized":"2024-09-21T13:39:27.709250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:55:09.357067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'19","reported_seq":57,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709633+0000","last_change":"2024-09-21T13:38:59.790127+0000","last_active":"2024-09-21T13:39:27.709633+0000","last_peered":"2024-09-21T13:39:27.709633+0000","last_clean":"2024-09-21T13:39:27.709633+0000","last_became_active":"2024-09-21T13:38:59.789058+0000","last_became_peered":"2024-09-21T13:38:59.789058+0000","last_unstale":"2024-09-21T13:39:27.709633+0000","last_undegraded":"2024-09-21T13:39:27.709633+0000","last_fullsized":"2024-09-21T13:39:27.709633+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:49.837292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417507+0000","last_change":"2024-09-21T13:38:57.649599+0000","last_active":"2024-09-21T13:39:27.417507+0000","last_peered":"2024-09-21T13:39:27.417507+0000","last_clean":"2024-09-21T13:39:27.417507+0000","last_became_active":"2024-09-21T13:38:57.649117+0000","last_became_peered":"2024-09-21T13:38:57.649117+0000","last_unstale":"2024-09-21T13:39:27.417507+0000","last_undegraded":"2024-09-21T13:39:27.417507+0000","last_fullsized":"2024-09-21T13:39:27.417507+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:51.120545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414610+0000","last_change":"2024-09-21T13:39:01.674861+0000","last_active":"2024-09-21T13:39:27.414610+0000","last_peered":"2024-09-21T13:39:27.414610+0000","last_clean":"2024-09-21T13:39:27.414610+0000","last_became_active":"2024-09-21T13:39:01.674474+0000","last_became_peered":"2024-09-21T13:39:01.674474+0000","last_unstale":"2024-09-21T13:39:27.414610+0000","last_undegraded":"2024-09-21T13:39:27.414610+0000","last_fullsized":"2024-09-21T13:39:27.414610+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:22.309358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416995+0000","last_change":"2024-09-21T13:39:03.691973+0000","last_active":"2024-09-21T13:39:27.416995+0000","last_peered":"2024-09-21T13:39:27.416995+0000","last_clean":"2024-09-21T13:39:27.416995+0000","last_became_active":"2024-09-21T13:39:03.691706+0000","last_became_peered":"2024-09-21T13:39:03.691706+0000","last_unstale":"2024-09-21T13:39:27.416995+0000","last_undegraded":"2024-09-21T13:39:27.416995+0000","last_fullsized":"2024-09-21T13:39:27.416995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:47.560852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"61'12","reported_seq":49,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711849+0000","last_change":"2024-09-21T13:38:59.655671+0000","last_active":"2024-09-21T13:39:27.711849+0000","last_peered":"2024-09-21T13:39:27.711849+0000","last_clean":"2024-09-21T13:39:27.711849+0000","last_became_active":"2024-09-21T13:38:59.655330+0000","last_became_peered":"2024-09-21T13:38:59.655330+0000","last_unstale":"2024-09-21T13:39:27.711849+0000","last_undegraded":"2024-09-21T13:39:27.711849+0000","last_fullsized":"2024-09-21T13:39:27.711849+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:41.686785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417580+0000","last_change":"2024-09-21T13:38:57.649099+0000","last_active":"2024-09-21T13:39:27.417580+0000","last_peered":"2024-09-21T13:39:27.417580+0000","last_clean":"2024-09-21T13:39:27.417580+0000","last_became_active":"2024-09-21T13:38:57.648359+0000","last_became_peered":"2024-09-21T13:38:57.648359+0000","last_unstale":"2024-09-21T13:39:27.417580+0000","last_undegraded":"2024-09-21T13:39:27.417580+0000","last_fullsized":"2024-09-21T13:39:27.417580+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:16:41.087159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.413734+0000","last_change":"2024-09-21T13:39:01.675796+0000","last_active":"2024-09-21T13:39:27.413734+0000","last_peered":"2024-09-21T13:39:27.413734+0000","last_clean":"2024-09-21T13:39:27.413734+0000","last_became_active":"2024-09-21T13:39:01.675479+0000","last_became_peered":"2024-09-21T13:39:01.675479+0000","last_unstale":"2024-09-21T13:39:27.413734+0000","last_undegraded":"2024-09-21T13:39:27.413734+0000","last_fullsized":"2024-09-21T13:39:27.413734+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:19.478817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414475+0000","last_change":"2024-09-21T13:39:03.691639+0000","last_active":"2024-09-21T13:39:27.414475+0000","last_peered":"2024-09-21T13:39:27.414475+0000","last_clean":"2024-09-21T13:39:27.414475+0000","last_became_active":"2024-09-21T13:39:03.691292+0000","last_became_peered":"2024-09-21T13:39:03.691292+0000","last_unstale":"2024-09-21T13:39:27.414475+0000","last_undegraded":"2024-09-21T13:39:27.414475+0000","last_fullsized":"2024-09-21T13:39:27.414475+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:26.458975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"61'15","reported_seq":51,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709325+0000","last_change":"2024-09-21T13:38:59.791572+0000","last_active":"2024-09-21T13:39:27.709325+0000","last_peered":"2024-09-21T13:39:27.709325+0000","last_clean":"2024-09-21T13:39:27.709325+0000","last_became_active":"2024-09-21T13:38:59.791151+0000","last_became_peered":"2024-09-21T13:38:59.791151+0000","last_unstale":"2024-09-21T13:39:27.709325+0000","last_undegraded":"2024-09-21T13:39:27.709325+0000","last_fullsized":"2024-09-21T13:39:27.709325+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:35.741448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"54'2","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417305+0000","last_change":"2024-09-21T13:38:57.647884+0000","last_active":"2024-09-21T13:39:27.417305+0000","last_peered":"2024-09-21T13:39:27.417305+0000","last_clean":"2024-09-21T13:39:27.417305+0000","last_became_active":"2024-09-21T13:38:57.647574+0000","last_became_peered":"2024-09-21T13:38:57.647574+0000","last_unstale":"2024-09-21T13:39:27.417305+0000","last_undegraded":"2024-09-21T13:39:27.417305+0000","last_fullsized":"2024-09-21T13:39:27.417305+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:47.771647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709150+0000","last_change":"2024-09-21T13:39:01.680978+0000","last_active":"2024-09-21T13:39:32.709150+0000","last_peered":"2024-09-21T13:39:32.709150+0000","last_clean":"2024-09-21T13:39:32.709150+0000","last_became_active":"2024-09-21T13:39:01.680705+0000","last_became_peered":"2024-09-21T13:39:01.680705+0000","last_unstale":"2024-09-21T13:39:32.709150+0000","last_undegraded":"2024-09-21T13:39:32.709150+0000","last_fullsized":"2024-09-21T13:39:32.709150+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:03.135300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710274+0000","last_change":"2024-09-21T13:39:03.689091+0000","last_active":"2024-09-21T13:39:27.710274+0000","last_peered":"2024-09-21T13:39:27.710274+0000","last_clean":"2024-09-21T13:39:27.710274+0000","last_became_active":"2024-09-21T13:39:03.688817+0000","last_became_peered":"2024-09-21T13:39:03.688817+0000","last_unstale":"2024-09-21T13:39:27.710274+0000","last_undegraded":"2024-09-21T13:39:27.710274+0000","last_fullsized":"2024-09-21T13:39:27.710274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:52.677852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710101+0000","last_change":"2024-09-21T13:38:57.652979+0000","last_active":"2024-09-21T13:39:27.710101+0000","last_peered":"2024-09-21T13:39:27.710101+0000","last_clean":"2024-09-21T13:39:27.710101+0000","last_became_active":"2024-09-21T13:38:57.652478+0000","last_became_peered":"2024-09-21T13:38:57.652478+0000","last_unstale":"2024-09-21T13:39:27.710101+0000","last_undegraded":"2024-09-21T13:39:27.710101+0000","last_fullsized":"2024-09-21T13:39:27.710101+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:40.768120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"61'6","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416696+0000","last_change":"2024-09-21T13:38:59.790997+0000","last_active":"2024-09-21T13:39:27.416696+0000","last_peered":"2024-09-21T13:39:27.416696+0000","last_clean":"2024-09-21T13:39:27.416696+0000","last_became_active":"2024-09-21T13:38:59.790654+0000","last_became_peered":"2024-09-21T13:38:59.790654+0000","last_unstale":"2024-09-21T13:39:27.416696+0000","last_undegraded":"2024-09-21T13:39:27.416696+0000","last_fullsized":"2024-09-21T13:39:27.416696+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:52.848558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710492+0000","last_change":"2024-09-21T13:39:01.677603+0000","last_active":"2024-09-21T13:39:27.710492+0000","last_peered":"2024-09-21T13:39:27.710492+0000","last_clean":"2024-09-21T13:39:27.710492+0000","last_became_active":"2024-09-21T13:39:01.677330+0000","last_became_peered":"2024-09-21T13:39:01.677330+0000","last_unstale":"2024-09-21T13:39:27.710492+0000","last_undegraded":"2024-09-21T13:39:27.710492+0000","last_fullsized":"2024-09-21T13:39:27.710492+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:18:45.256565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417178+0000","last_change":"2024-09-21T13:39:03.683885+0000","last_active":"2024-09-21T13:39:27.417178+0000","last_peered":"2024-09-21T13:39:27.417178+0000","last_clean":"2024-09-21T13:39:27.417178+0000","last_became_active":"2024-09-21T13:39:03.683606+0000","last_became_peered":"2024-09-21T13:39:03.683606+0000","last_unstale":"2024-09-21T13:39:27.417178+0000","last_undegraded":"2024-09-21T13:39:27.417178+0000","last_fullsized":"2024-09-21T13:39:27.417178+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:52.760001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712558+0000","last_change":"2024-09-21T13:38:59.791917+0000","last_active":"2024-09-21T13:39:27.712558+0000","last_peered":"2024-09-21T13:39:27.712558+0000","last_clean":"2024-09-21T13:39:27.712558+0000","last_became_active":"2024-09-21T13:38:59.791620+0000","last_became_peered":"2024-09-21T13:38:59.791620+0000","last_unstale":"2024-09-21T13:39:27.712558+0000","last_undegraded":"2024-09-21T13:39:27.712558+0000","last_fullsized":"2024-09-21T13:39:27.712558+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:04.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417052+0000","last_change":"2024-09-21T13:38:57.647148+0000","last_active":"2024-09-21T13:39:27.417052+0000","last_peered":"2024-09-21T13:39:27.417052+0000","last_clean":"2024-09-21T13:39:27.417052+0000","last_became_active":"2024-09-21T13:38:57.646854+0000","last_became_peered":"2024-09-21T13:38:57.646854+0000","last_unstale":"2024-09-21T13:39:27.417052+0000","last_undegraded":"2024-09-21T13:39:27.417052+0000","last_fullsized":"2024-09-21T13:39:27.417052+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:56.436211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416555+0000","last_change":"2024-09-21T13:39:01.678258+0000","last_active":"2024-09-21T13:39:27.416555+0000","last_peered":"2024-09-21T13:39:27.416555+0000","last_clean":"2024-09-21T13:39:27.416555+0000","last_became_active":"2024-09-21T13:39:01.677908+0000","last_became_peered":"2024-09-21T13:39:01.677908+0000","last_unstale":"2024-09-21T13:39:27.416555+0000","last_undegraded":"2024-09-21T13:39:27.416555+0000","last_fullsized":"2024-09-21T13:39:27.416555+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:00.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.415671+0000","last_change":"2024-09-21T13:39:03.684061+0000","last_active":"2024-09-21T13:39:27.415671+0000","last_peered":"2024-09-21T13:39:27.415671+0000","last_clean":"2024-09-21T13:39:27.415671+0000","last_became_active":"2024-09-21T13:39:03.683742+0000","last_became_peered":"2024-09-21T13:39:03.683742+0000","last_unstale":"2024-09-21T13:39:27.415671+0000","last_undegraded":"2024-09-21T13:39:27.415671+0000","last_fullsized":"2024-09-21T13:39:27.415671+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:12:46.448180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711310+0000","last_change":"2024-09-21T13:38:59.790634+0000","last_active":"2024-09-21T13:39:27.711310+0000","last_peered":"2024-09-21T13:39:27.711310+0000","last_clean":"2024-09-21T13:39:27.711310+0000","last_became_active":"2024-09-21T13:38:59.790332+0000","last_became_peered":"2024-09-21T13:38:59.790332+0000","last_unstale":"2024-09-21T13:39:27.711310+0000","last_undegraded":"2024-09-21T13:39:27.711310+0000","last_fullsized":"2024-09-21T13:39:27.711310+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:26:59.003873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709962+0000","last_change":"2024-09-21T13:38:57.652780+0000","last_active":"2024-09-21T13:39:27.709962+0000","last_peered":"2024-09-21T13:39:27.709962+0000","last_clean":"2024-09-21T13:39:27.709962+0000","last_became_active":"2024-09-21T13:38:57.652332+0000","last_became_peered":"2024-09-21T13:38:57.652332+0000","last_unstale":"2024-09-21T13:39:27.709962+0000","last_undegraded":"2024-09-21T13:39:27.709962+0000","last_fullsized":"2024-09-21T13:39:27.709962+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:59:09.995840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709133+0000","last_change":"2024-09-21T13:39:01.672948+0000","last_active":"2024-09-21T13:39:32.709133+0000","last_peered":"2024-09-21T13:39:32.709133+0000","last_clean":"2024-09-21T13:39:32.709133+0000","last_became_active":"2024-09-21T13:39:01.672617+0000","last_became_peered":"2024-09-21T13:39:01.672617+0000","last_unstale":"2024-09-21T13:39:32.709133+0000","last_undegraded":"2024-09-21T13:39:32.709133+0000","last_fullsized":"2024-09-21T13:39:32.709133+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:31:28.048267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711524+0000","last_change":"2024-09-21T13:39:03.686340+0000","last_active":"2024-09-21T13:39:27.711524+0000","last_peered":"2024-09-21T13:39:27.711524+0000","last_clean":"2024-09-21T13:39:27.711524+0000","last_became_active":"2024-09-21T13:39:03.686070+0000","last_became_peered":"2024-09-21T13:39:03.686070+0000","last_unstale":"2024-09-21T13:39:27.711524+0000","last_undegraded":"2024-09-21T13:39:27.711524+0000","last_fullsized":"2024-09-21T13:39:27.711524+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:23.371425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"61'10","reported_seq":41,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417350+0000","last_change":"2024-09-21T13:38:59.789464+0000","last_active":"2024-09-21T13:39:27.417350+0000","last_peered":"2024-09-21T13:39:27.417350+0000","last_clean":"2024-09-21T13:39:27.417350+0000","last_became_active":"2024-09-21T13:38:59.788995+0000","last_became_peered":"2024-09-21T13:38:59.788995+0000","last_unstale":"2024-09-21T13:39:27.417350+0000","last_undegraded":"2024-09-21T13:39:27.417350+0000","last_fullsized":"2024-09-21T13:39:27.417350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:33.252492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417330+0000","last_change":"2024-09-21T13:38:57.649887+0000","last_active":"2024-09-21T13:39:27.417330+0000","last_peered":"2024-09-21T13:39:27.417330+0000","last_clean":"2024-09-21T13:39:27.417330+0000","last_became_active":"2024-09-21T13:38:57.649579+0000","last_became_peered":"2024-09-21T13:38:57.649579+0000","last_unstale":"2024-09-21T13:39:27.417330+0000","last_undegraded":"2024-09-21T13:39:27.417330+0000","last_fullsized":"2024-09-21T13:39:27.417330+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:45.949628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"61'8","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:32.709138+0000","last_change":"2024-09-21T13:39:01.676756+0000","last_active":"2024-09-21T13:39:32.709138+0000","last_peered":"2024-09-21T13:39:32.709138+0000","last_clean":"2024-09-21T13:39:32.709138+0000","last_became_active":"2024-09-21T13:39:01.676495+0000","last_became_peered":"2024-09-21T13:39:01.676495+0000","last_unstale":"2024-09-21T13:39:32.709138+0000","last_undegraded":"2024-09-21T13:39:32.709138+0000","last_fullsized":"2024-09-21T13:39:32.709138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:19:59.783997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711979+0000","last_change":"2024-09-21T13:39:03.688094+0000","last_active":"2024-09-21T13:39:27.711979+0000","last_peered":"2024-09-21T13:39:27.711979+0000","last_clean":"2024-09-21T13:39:27.711979+0000","last_became_active":"2024-09-21T13:39:03.687808+0000","last_became_peered":"2024-09-21T13:39:03.687808+0000","last_unstale":"2024-09-21T13:39:27.711979+0000","last_undegraded":"2024-09-21T13:39:27.711979+0000","last_fullsized":"2024-09-21T13:39:27.711979+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:33.488203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"61'11","reported_seq":45,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711008+0000","last_change":"2024-09-21T13:38:59.661418+0000","last_active":"2024-09-21T13:39:27.711008+0000","last_peered":"2024-09-21T13:39:27.711008+0000","last_clean":"2024-09-21T13:39:27.711008+0000","last_became_active":"2024-09-21T13:38:59.661014+0000","last_became_peered":"2024-09-21T13:38:59.661014+0000","last_unstale":"2024-09-21T13:39:27.711008+0000","last_undegraded":"2024-09-21T13:39:27.711008+0000","last_fullsized":"2024-09-21T13:39:27.711008+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:08.614122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711376+0000","last_change":"2024-09-21T13:38:57.651750+0000","last_active":"2024-09-21T13:39:27.711376+0000","last_peered":"2024-09-21T13:39:27.711376+0000","last_clean":"2024-09-21T13:39:27.711376+0000","last_became_active":"2024-09-21T13:38:57.651453+0000","last_became_peered":"2024-09-21T13:38:57.651453+0000","last_unstale":"2024-09-21T13:39:27.711376+0000","last_undegraded":"2024-09-21T13:39:27.711376+0000","last_fullsized":"2024-09-21T13:39:27.711376+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:02:20.629729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709245+0000","last_change":"2024-09-21T13:39:01.677645+0000","last_active":"2024-09-21T13:39:27.709245+0000","last_peered":"2024-09-21T13:39:27.709245+0000","last_clean":"2024-09-21T13:39:27.709245+0000","last_became_active":"2024-09-21T13:39:01.677350+0000","last_became_peered":"2024-09-21T13:39:01.677350+0000","last_unstale":"2024-09-21T13:39:27.709245+0000","last_undegraded":"2024-09-21T13:39:27.709245+0000","last_fullsized":"2024-09-21T13:39:27.709245+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:42:52.813465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414447+0000","last_change":"2024-09-21T13:39:03.687545+0000","last_active":"2024-09-21T13:39:27.414447+0000","last_peered":"2024-09-21T13:39:27.414447+0000","last_clean":"2024-09-21T13:39:27.414447+0000","last_became_active":"2024-09-21T13:39:03.687193+0000","last_became_peered":"2024-09-21T13:39:03.687193+0000","last_unstale":"2024-09-21T13:39:27.414447+0000","last_undegraded":"2024-09-21T13:39:27.414447+0000","last_fullsized":"2024-09-21T13:39:27.414447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:00:57.992645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"61'9","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709477+0000","last_change":"2024-09-21T13:38:59.662581+0000","last_active":"2024-09-21T13:39:27.709477+0000","last_peered":"2024-09-21T13:39:27.709477+0000","last_clean":"2024-09-21T13:39:27.709477+0000","last_became_active":"2024-09-21T13:38:59.661997+0000","last_became_peered":"2024-09-21T13:38:59.661997+0000","last_unstale":"2024-09-21T13:39:27.709477+0000","last_undegraded":"2024-09-21T13:39:27.709477+0000","last_fullsized":"2024-09-21T13:39:27.709477+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:18:39.759833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.417413+0000","last_change":"2024-09-21T13:38:57.648866+0000","last_active":"2024-09-21T13:39:27.417413+0000","last_peered":"2024-09-21T13:39:27.417413+0000","last_clean":"2024-09-21T13:39:27.417413+0000","last_became_active":"2024-09-21T13:38:57.648328+0000","last_became_peered":"2024-09-21T13:38:57.648328+0000","last_unstale":"2024-09-21T13:39:27.417413+0000","last_undegraded":"2024-09-21T13:39:27.417413+0000","last_fullsized":"2024-09-21T13:39:27.417413+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:40.338748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414569+0000","last_change":"2024-09-21T13:39:01.678735+0000","last_active":"2024-09-21T13:39:27.414569+0000","last_peered":"2024-09-21T13:39:27.414569+0000","last_clean":"2024-09-21T13:39:27.414569+0000","last_became_active":"2024-09-21T13:39:01.678144+0000","last_became_peered":"2024-09-21T13:39:01.678144+0000","last_unstale":"2024-09-21T13:39:27.414569+0000","last_undegraded":"2024-09-21T13:39:27.414569+0000","last_fullsized":"2024-09-21T13:39:27.414569+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:35.364014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.711574+0000","last_change":"2024-09-21T13:39:03.692425+0000","last_active":"2024-09-21T13:39:27.711574+0000","last_peered":"2024-09-21T13:39:27.711574+0000","last_clean":"2024-09-21T13:39:27.711574+0000","last_became_active":"2024-09-21T13:39:03.692086+0000","last_became_peered":"2024-09-21T13:39:03.692086+0000","last_unstale":"2024-09-21T13:39:27.711574+0000","last_undegraded":"2024-09-21T13:39:27.711574+0000","last_fullsized":"2024-09-21T13:39:27.711574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:29:39.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'11","reported_seq":45,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414600+0000","last_change":"2024-09-21T13:38:59.789412+0000","last_active":"2024-09-21T13:39:27.414600+0000","last_peered":"2024-09-21T13:39:27.414600+0000","last_clean":"2024-09-21T13:39:27.414600+0000","last_became_active":"2024-09-21T13:38:59.789010+0000","last_became_peered":"2024-09-21T13:38:59.789010+0000","last_unstale":"2024-09-21T13:39:27.414600+0000","last_undegraded":"2024-09-21T13:39:27.414600+0000","last_fullsized":"2024-09-21T13:39:27.414600+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:21:02.158333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710491+0000","last_change":"2024-09-21T13:38:57.644684+0000","last_active":"2024-09-21T13:39:27.710491+0000","last_peered":"2024-09-21T13:39:27.710491+0000","last_clean":"2024-09-21T13:39:27.710491+0000","last_became_active":"2024-09-21T13:38:57.644411+0000","last_became_peered":"2024-09-21T13:38:57.644411+0000","last_unstale":"2024-09-21T13:39:27.710491+0000","last_undegraded":"2024-09-21T13:39:27.710491+0000","last_fullsized":"2024-09-21T13:39:27.710491+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:19.778069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416561+0000","last_change":"2024-09-21T13:39:01.680976+0000","last_active":"2024-09-21T13:39:27.416561+0000","last_peered":"2024-09-21T13:39:27.416561+0000","last_clean":"2024-09-21T13:39:27.416561+0000","last_became_active":"2024-09-21T13:39:01.680674+0000","last_became_peered":"2024-09-21T13:39:01.680674+0000","last_unstale":"2024-09-21T13:39:27.416561+0000","last_undegraded":"2024-09-21T13:39:27.416561+0000","last_fullsized":"2024-09-21T13:39:27.416561+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:52.374102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414717+0000","last_change":"2024-09-21T13:39:03.687837+0000","last_active":"2024-09-21T13:39:27.414717+0000","last_peered":"2024-09-21T13:39:27.414717+0000","last_clean":"2024-09-21T13:39:27.414717+0000","last_became_active":"2024-09-21T13:39:03.687521+0000","last_became_peered":"2024-09-21T13:39:03.687521+0000","last_unstale":"2024-09-21T13:39:27.414717+0000","last_undegraded":"2024-09-21T13:39:27.414717+0000","last_fullsized":"2024-09-21T13:39:27.414717+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:32.381734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"61'4","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414300+0000","last_change":"2024-09-21T13:38:59.663022+0000","last_active":"2024-09-21T13:39:27.414300+0000","last_peered":"2024-09-21T13:39:27.414300+0000","last_clean":"2024-09-21T13:39:27.414300+0000","last_became_active":"2024-09-21T13:38:59.662701+0000","last_became_peered":"2024-09-21T13:38:59.662701+0000","last_unstale":"2024-09-21T13:39:27.414300+0000","last_undegraded":"2024-09-21T13:39:27.414300+0000","last_fullsized":"2024-09-21T13:39:27.414300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:17:29.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710770+0000","last_change":"2024-09-21T13:38:57.652998+0000","last_active":"2024-09-21T13:39:27.710770+0000","last_peered":"2024-09-21T13:39:27.710770+0000","last_clean":"2024-09-21T13:39:27.710770+0000","last_became_active":"2024-09-21T13:38:57.652230+0000","last_became_peered":"2024-09-21T13:38:57.652230+0000","last_unstale":"2024-09-21T13:39:27.710770+0000","last_undegraded":"2024-09-21T13:39:27.710770+0000","last_fullsized":"2024-09-21T13:39:27.710770+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:52.398414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.709673+0000","last_change":"2024-09-21T13:39:01.672785+0000","last_active":"2024-09-21T13:39:27.709673+0000","last_peered":"2024-09-21T13:39:27.709673+0000","last_clean":"2024-09-21T13:39:27.709673+0000","last_became_active":"2024-09-21T13:39:01.672502+0000","last_became_peered":"2024-09-21T13:39:01.672502+0000","last_unstale":"2024-09-21T13:39:27.709673+0000","last_undegraded":"2024-09-21T13:39:27.709673+0000","last_fullsized":"2024-09-21T13:39:27.709673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:20.880535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.416697+0000","last_change":"2024-09-21T13:39:03.687754+0000","last_active":"2024-09-21T13:39:27.416697+0000","last_peered":"2024-09-21T13:39:27.416697+0000","last_clean":"2024-09-21T13:39:27.416697+0000","last_became_active":"2024-09-21T13:39:03.687475+0000","last_became_peered":"2024-09-21T13:39:03.687475+0000","last_unstale":"2024-09-21T13:39:27.416697+0000","last_undegraded":"2024-09-21T13:39:27.416697+0000","last_fullsized":"2024-09-21T13:39:27.416697+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:49.138276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710487+0000","last_change":"2024-09-21T13:39:03.690418+0000","last_active":"2024-09-21T13:39:27.710487+0000","last_peered":"2024-09-21T13:39:27.710487+0000","last_clean":"2024-09-21T13:39:27.710487+0000","last_became_active":"2024-09-21T13:39:03.690105+0000","last_became_peered":"2024-09-21T13:39:03.690105+0000","last_unstale":"2024-09-21T13:39:27.710487+0000","last_undegraded":"2024-09-21T13:39:27.710487+0000","last_fullsized":"2024-09-21T13:39:27.710487+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:02.663369+0000","last_clean_scrub_stamp":"2024-09-21T13:39:02.663369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:36.723746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.414625+0000","last_change":"2024-09-21T13:38:57.643671+0000","last_active":"2024-09-21T13:39:27.414625+0000","last_peered":"2024-09-21T13:39:27.414625+0000","last_clean":"2024-09-21T13:39:27.414625+0000","last_became_active":"2024-09-21T13:38:57.643366+0000","last_became_peered":"2024-09-21T13:38:57.643366+0000","last_unstale":"2024-09-21T13:39:27.414625+0000","last_undegraded":"2024-09-21T13:39:27.414625+0000","last_fullsized":"2024-09-21T13:39:27.414625+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:56.625798+0000","last_clean_scrub_stamp":"2024-09-21T13:38:56.625798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:23:03.650078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"61'11","reported_seq":45,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.710923+0000","last_change":"2024-09-21T13:38:59.664785+0000","last_active":"2024-09-21T13:39:27.710923+0000","last_peered":"2024-09-21T13:39:27.710923+0000","last_clean":"2024-09-21T13:39:27.710923+0000","last_became_active":"2024-09-21T13:38:59.664401+0000","last_became_peered":"2024-09-21T13:38:59.664401+0000","last_unstale":"2024-09-21T13:39:27.710923+0000","last_undegraded":"2024-09-21T13:39:27.710923+0000","last_fullsized":"2024-09-21T13:39:27.710923+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:38:58.637131+0000","last_clean_scrub_stamp":"2024-09-21T13:38:58.637131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:11.152256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T13:39:27.712626+0000","last_change":"2024-09-21T13:39:01.683792+0000","last_active":"2024-09-21T13:39:27.712626+0000","last_peered":"2024-09-21T13:39:27.712626+0000","last_clean":"2024-09-21T13:39:27.712626+0000","last_became_active":"2024-09-21T13:39:01.683452+0000","last_became_peered":"2024-09-21T13:39:01.683452+0000","last_unstale":"2024-09-21T13:39:27.712626+0000","last_undegraded":"2024-09-21T13:39:27.712626+0000","last_fullsized":"2024-09-21T13:39:27.712626+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:39:00.651723+0000","last_clean_scrub_stamp":"2024-09-21T13:39:00.651723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:03.835654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397517,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32384,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712768,"statfs":{"total":95995035648,"available":95961874432,"internally_reserved":0,"allocated":1228800,"data_stored":830657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593746,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28204,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716948,"statfs":{"total":95995035648,"available":95966154752,"internally_reserved":0,"allocated":1208320,"data_stored":829572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789977,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31792,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713360,"statfs":{"total":95995035648,"available":95962480640,"internally_reserved":0,"allocated":618496,"data_stored":239563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986206,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717484,"statfs":{"total":95995035648,"available":95966703616,"internally_reserved":0,"allocated":655360,"data_stored":241251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149732,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31828,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713324,"statfs":{"total":95995035648,"available":95962443776,"internally_reserved":0,"allocated":655360,"data_stored":240108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411369,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27636,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717516,"statfs":{"total":95995035648,"available":95966736384,"internally_reserved":0,"allocated":622592,"data_stored":240794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717452,"statfs":{"total":95995035648,"available":95966670848,"internally_reserved":0,"allocated":688128,"data_stored":242418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32388,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712764,"statfs":{"total":95995035648,"available":95961870336,"internally_reserved":0,"allocated":1232896,"data_stored":830366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T13:39:45.344 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T13:39:45.344 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T13:39:45.344 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T13:39:45.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a shell --fsid e6144070-781d-11ef-baf6-efdc52797490 -- ceph health --format=json 2024-09-21T13:39:45.609 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T13:39:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:45 smithi162 ceph-mon[33046]: from='client.24614 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T13:39:46.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:45 smithi002 ceph-mon[40622]: from='client.24614 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T13:39:46.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:45 smithi002 ceph-mon[30076]: from='client.24614 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T13:39:46.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.743+0000 7f5dd24ae640 1 -- 172.21.15.2:0/3034119411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dcc101c60 msgr2=0x7f5dcc102040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:46.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.743+0000 7f5dd24ae640 1 --2- 172.21.15.2:0/3034119411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dcc101c60 0x7f5dcc102040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009900 tx=0x7f5dbc02a410 comp rx=0 tx=0).stop 2024-09-21T13:39:46.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.744+0000 7f5dd24ae640 1 -- 172.21.15.2:0/3034119411 shutdown_connections 2024-09-21T13:39:46.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.744+0000 7f5dd24ae640 1 --2- 172.21.15.2:0/3034119411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc107ff0 0x7f5dcc10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:46.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.744+0000 7f5dd24ae640 1 --2- 172.21.15.2:0/3034119411 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5dcc107670 0x7f5dcc107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:46.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.744+0000 7f5dd24ae640 1 --2- 172.21.15.2:0/3034119411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dcc101c60 0x7f5dcc102040 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:46.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.744+0000 7f5dd24ae640 1 -- 172.21.15.2:0/3034119411 >> 172.21.15.2:0/3034119411 conn(0x7f5dcc0fd6d0 msgr2=0x7f5dcc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:46.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.744+0000 7f5dd24ae640 1 -- 172.21.15.2:0/3034119411 shutdown_connections 2024-09-21T13:39:46.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.744+0000 7f5dd24ae640 1 -- 172.21.15.2:0/3034119411 wait complete. 2024-09-21T13:39:46.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.745+0000 7f5dd24ae640 1 Processor -- start 2024-09-21T13:39:46.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.745+0000 7f5dd24ae640 1 -- start start 2024-09-21T13:39:46.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.745+0000 7f5dd24ae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc107670 0x7f5dcc198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:46.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.745+0000 7f5dd24ae640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5dcc107ff0 0x7f5dcc1990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:46.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.745+0000 7f5dcbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc107670 0x7f5dcc198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:46.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dcbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc107670 0x7f5dcc198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.2:56042/0 (socket says 172.21.15.2:56042) 2024-09-21T13:39:46.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dd24ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dcc19e440 0x7f5dcc19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:46.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dcb7fe640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5dcc107ff0 0x7f5dcc1990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:46.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dcb7fe640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5dcc107ff0 0x7f5dcc1990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:58156/0 (socket says 172.21.15.2:58156) 2024-09-21T13:39:46.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dcbfff640 1 -- 172.21.15.2:0/127980538 learned_addr learned my addr 172.21.15.2:0/127980538 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:39:46.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1123d0 con 0x7f5dcc19e440 2024-09-21T13:39:46.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc112250 con 0x7f5dcc107670 2024-09-21T13:39:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc112550 con 0x7f5dcc107ff0 2024-09-21T13:39:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dd0a4b640 1 --2- 172.21.15.2:0/127980538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dcc19e440 0x7f5dcc19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dcb7fe640 1 -- 172.21.15.2:0/127980538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc107670 msgr2=0x7f5dcc198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dcb7fe640 1 --2- 172.21.15.2:0/127980538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc107670 0x7f5dcc198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dcb7fe640 1 -- 172.21.15.2:0/127980538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dcc19e440 msgr2=0x7f5dcc19e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dcb7fe640 1 --2- 172.21.15.2:0/127980538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dcc19e440 0x7f5dcc19e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.746+0000 7f5dcb7fe640 1 -- 172.21.15.2:0/127980538 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc19efd0 con 0x7f5dcc107ff0 2024-09-21T13:39:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.747+0000 7f5dcb7fe640 1 --2- 172.21.15.2:0/127980538 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5dcc107ff0 0x7f5dcc1990a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000e9f0 tx=0x7f5dc000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.747+0000 7f5dc97fa640 1 -- 172.21.15.2:0/127980538 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000ccc0 con 0x7f5dcc107ff0 2024-09-21T13:39:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.747+0000 7f5dc97fa640 1 -- 172.21.15.2:0/127980538 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5dc0005020 con 0x7f5dcc107ff0 2024-09-21T13:39:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.747+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc10f4d0 con 0x7f5dcc107ff0 2024-09-21T13:39:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.747+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc10f9b0 con 0x7f5dcc107ff0 2024-09-21T13:39:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.748+0000 7f5dc97fa640 1 -- 172.21.15.2:0/127980538 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00044a0 con 0x7f5dcc107ff0 2024-09-21T13:39:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.749+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db80050b0 con 0x7f5dcc107ff0 2024-09-21T13:39:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.749+0000 7f5dc97fa640 1 -- 172.21.15.2:0/127980538 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f5dc0004ac0 con 0x7f5dcc107ff0 2024-09-21T13:39:46.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.750+0000 7f5dc97fa640 1 --2- 172.21.15.2:0/127980538 >> v2:172.21.15.2:6800/2394073254 conn(0x7f5db407b110 0x7f5db407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:39:46.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.750+0000 7f5dcbfff640 1 --2- 172.21.15.2:0/127980538 >> v2:172.21.15.2:6800/2394073254 conn(0x7f5db407b110 0x7f5db407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:39:46.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.750+0000 7f5dc97fa640 1 -- 172.21.15.2:0/127980538 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 6172+0+0 (secure 0 0 0) 0x7f5dc009e020 con 0x7f5dcc107ff0 2024-09-21T13:39:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.751+0000 7f5dcbfff640 1 --2- 172.21.15.2:0/127980538 >> v2:172.21.15.2:6800/2394073254 conn(0x7f5db407b110 0x7f5db407d5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc004770 tx=0x7f5dbc0058d0 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:39:46.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.755+0000 7f5dc97fa640 1 -- 172.21.15.2:0/127980538 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5dc0069690 con 0x7f5dcc107ff0 2024-09-21T13:39:46.924 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:46 smithi002 ceph-mon[30076]: pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T13:39:46.924 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:46 smithi002 ceph-mon[40622]: pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T13:39:46.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:46 smithi162 ceph-mon[33046]: pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T13:39:46.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.988+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5db80053a0 con 0x7f5dcc107ff0 2024-09-21T13:39:46.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.988+0000 7f5dc97fa640 1 -- 172.21.15.2:0/127980538 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5dc006e540 con 0x7f5dcc107ff0 2024-09-21T13:39:46.990 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-21T13:39:46.990 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T13:39:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 >> v2:172.21.15.2:6800/2394073254 conn(0x7f5db407b110 msgr2=0x7f5db407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 --2- 172.21.15.2:0/127980538 >> v2:172.21.15.2:6800/2394073254 conn(0x7f5db407b110 0x7f5db407d5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc004770 tx=0x7f5dbc0058d0 comp rx=0 tx=0).stop 2024-09-21T13:39:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5dcc107ff0 msgr2=0x7f5dcc1990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:39:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 --2- 172.21.15.2:0/127980538 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5dcc107ff0 0x7f5dcc1990a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000e9f0 tx=0x7f5dc000eeb0 comp rx=0 tx=0).stop 2024-09-21T13:39:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 shutdown_connections 2024-09-21T13:39:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 --2- 172.21.15.2:0/127980538 >> v2:172.21.15.2:6800/2394073254 conn(0x7f5db407b110 0x7f5db407d5d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 --2- 172.21.15.2:0/127980538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dcc19e440 0x7f5dcc19e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 --2- 172.21.15.2:0/127980538 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f5dcc107ff0 0x7f5dcc1990a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 --2- 172.21.15.2:0/127980538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc107670 0x7f5dcc198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:39:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 >> 172.21.15.2:0/127980538 conn(0x7f5dcc0fd6d0 msgr2=0x7f5dcc103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:39:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 shutdown_connections 2024-09-21T13:39:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-21T13:39:46.991+0000 7f5dd24ae640 1 -- 172.21.15.2:0/127980538 wait complete. 2024-09-21T13:39:47.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/127980538' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T13:39:47.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/127980538' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T13:39:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/127980538' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T13:39:48.277 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T13:39:48.277 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T13:39:48.278 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T13:39:48.295 INFO:tasks.workunit:Pulling workunits from ref 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T13:39:48.295 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T13:39:48.295 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T13:39:48.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:39:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-21T13:39:48.314 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-21T13:39:48.372 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-21T13:39:48.372 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-21T13:39:48.430 INFO:tasks.workunit:timeout=3h 2024-09-21T13:39:48.430 INFO:tasks.workunit:cleanup=True 2024-09-21T13:39:48.431 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T13:39:48.489 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T13:39:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:48 smithi162 ceph-mon[33046]: pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:39:48.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:39:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:48 smithi002 ceph-mon[30076]: pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:39:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:48 smithi002 ceph-mon[40622]: pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:39:49.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:49 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:49.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:49 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:49.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:39:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:39:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:49 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:39:50.965 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:50 smithi002 ceph-mon[30076]: pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:39:50.966 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:50 smithi002 ceph-mon[40622]: pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:39:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:50 smithi162 ceph-mon[33046]: pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:39:51.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:51 smithi002 systemd[1]: Starting Ceph alertmanager.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:39:52.042 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:51 smithi002 podman[74521]: 2024-09-21 13:39:51.653620791 +0000 UTC m=+0.016299335 image pull 11f11916f8cdfb17c1da74b20deb2075d778357b4d60474d82453303f8d461f5 quay.io/prometheus/alertmanager:v0.27.0 2024-09-21T13:39:52.042 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:51 smithi002 podman[74521]: 2024-09-21 13:39:51.751514394 +0000 UTC m=+0.114192919 volume create c09f1f26a8c1879eb834451cbf8b8e79ae0391cb3a2b51be14e55e94b3beef40 2024-09-21T13:39:52.042 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:51 smithi002 podman[74521]: 2024-09-21 13:39:51.843822284 +0000 UTC m=+0.206500850 container create 2606103a9845efd3d30b0177eb61e974b4cf840c7f4110cfe4050909e9d94022 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:39:52.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 podman[74521]: 2024-09-21 13:39:52.146056814 +0000 UTC m=+0.508735342 container init 2606103a9845efd3d30b0177eb61e974b4cf840c7f4110cfe4050909e9d94022 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:39:52.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 podman[74521]: 2024-09-21 13:39:52.15086826 +0000 UTC m=+0.513546785 container start 2606103a9845efd3d30b0177eb61e974b4cf840c7f4110cfe4050909e9d94022 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:39:52.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[74535]: ts=2024-09-21T13:39:52.160Z caller=main.go:181 level=info msg="Starting Alertmanager" version="(version=0.27.0, branch=HEAD, revision=0aa3c2aad14cff039931923ab16b26b7481783b5)" 2024-09-21T13:39:52.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[74535]: ts=2024-09-21T13:39:52.160Z caller=main.go:182 level=info build_context="(go=go1.21.7, platform=linux/amd64, user=root@22cd11f671e9, date=20240228-11:51:20, tags=netgo)" 2024-09-21T13:39:52.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[74535]: ts=2024-09-21T13:39:52.162Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.2 port=9094 2024-09-21T13:39:52.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[74535]: ts=2024-09-21T13:39:52.163Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-21T13:39:52.601 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[74535]: ts=2024-09-21T13:39:52.184Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T13:39:52.601 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[74535]: ts=2024-09-21T13:39:52.184Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T13:39:52.601 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[74535]: ts=2024-09-21T13:39:52.186Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9093 2024-09-21T13:39:52.601 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[74535]: ts=2024-09-21T13:39:52.186Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-21T13:39:52.601 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 bash[74521]: 2606103a9845efd3d30b0177eb61e974b4cf840c7f4110cfe4050909e9d94022 2024-09-21T13:39:52.601 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:52 smithi002 systemd[1]: Started Ceph alertmanager.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:39:53.011 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-mon[40622]: pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:39:53.011 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.012 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.012 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.012 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.012 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-mon[30076]: pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:39:53.012 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.012 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.012 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.012 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:52 smithi162 ceph-mon[33046]: pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:39:53.240 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.240 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.240 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.240 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:53.322 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:39:53] ENGINE Bus STOPPING 2024-09-21T13:39:53.322 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:39:53] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T13:39:53.322 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:39:53] ENGINE Bus STOPPED 2024-09-21T13:39:53.322 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:39:53] ENGINE Bus STARTING 2024-09-21T13:39:53.322 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:39:53] ENGINE Serving on http://:::9283 2024-09-21T13:39:53.600 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:39:53] ENGINE Bus STARTED 2024-09-21T13:39:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[30076]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T13:39:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-21T13:39:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:39:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[40622]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T13:39:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-21T13:39:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:39:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:53 smithi162 ceph-mon[33046]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T13:39:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-21T13:39:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:39:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:39:54.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:39:54 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[74535]: ts=2024-09-21T13:39:54.164Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000665196s 2024-09-21T13:39:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:54 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T13:39:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:54 smithi002 ceph-mon[30076]: Deploying daemon grafana.a on smithi162 2024-09-21T13:39:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:54 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:39:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:54 smithi002 ceph-mon[30076]: pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:39:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:54 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T13:39:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:54 smithi002 ceph-mon[40622]: Deploying daemon grafana.a on smithi162 2024-09-21T13:39:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:54 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:39:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:54 smithi002 ceph-mon[40622]: pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:39:55.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:54 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T13:39:55.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:54 smithi162 ceph-mon[33046]: Deploying daemon grafana.a on smithi162 2024-09-21T13:39:55.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:54 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:39:55.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:54 smithi162 ceph-mon[33046]: pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:39:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:56 smithi162 ceph-mon[33046]: pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:39:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:56 smithi002 ceph-mon[30076]: pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:39:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:56 smithi002 ceph-mon[40622]: pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:39:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:58 smithi162 ceph-mon[33046]: pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:39:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:39:58.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:39:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:39:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:58 smithi002 ceph-mon[30076]: pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:39:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:39:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:58 smithi002 ceph-mon[40622]: pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:39:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:39:59 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:39:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:39:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:40:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:39:59 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:00.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:39:59 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:00 smithi162 ceph-mon[33046]: pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:00 smithi162 ceph-mon[33046]: overall HEALTH_OK 2024-09-21T13:40:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:00 smithi002 ceph-mon[30076]: pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:00 smithi002 ceph-mon[30076]: overall HEALTH_OK 2024-09-21T13:40:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:00 smithi002 ceph-mon[40622]: pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:00 smithi002 ceph-mon[40622]: overall HEALTH_OK 2024-09-21T13:40:02.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:02 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[74535]: ts=2024-09-21T13:40:02.166Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002466522s 2024-09-21T13:40:02.928 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:02 smithi162 ceph-mon[33046]: pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:02 smithi002 ceph-mon[30076]: pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:02 smithi002 ceph-mon[40622]: pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:03.233 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 systemd[1]: Starting Ceph grafana.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:40:03.584 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 podman[63483]: 2024-09-21 13:40:03.224226 +0000 UTC m=+0.016594592 image pull 5aad1d7cf004c80a4acb170e1c80fb85781b022f00f08c6bcd22608882b4c748 quay.io/ceph/grafana:10.4.8 2024-09-21T13:40:03.584 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 podman[63483]: 2024-09-21 13:40:03.347350995 +0000 UTC m=+0.139719573 container create d6ab1261f5be4517d06d5e97a48787c9875fbd72cabf1fc15e8451ea3d5ce5a1 (image=quay.io/ceph/grafana:10.4.8, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T13:40:03.584 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 podman[63483]: 2024-09-21 13:40:03.583941704 +0000 UTC m=+0.376310300 container init d6ab1261f5be4517d06d5e97a48787c9875fbd72cabf1fc15e8451ea3d5ce5a1 (image=quay.io/ceph/grafana:10.4.8, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T13:40:03.835 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 podman[63483]: 2024-09-21 13:40:03.589182464 +0000 UTC m=+0.381551046 container start d6ab1261f5be4517d06d5e97a48787c9875fbd72cabf1fc15e8451ea3d5ce5a1 (image=quay.io/ceph/grafana:10.4.8, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T13:40:03.835 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 bash[63483]: d6ab1261f5be4517d06d5e97a48787c9875fbd72cabf1fc15e8451ea3d5ce5a1 2024-09-21T13:40:03.835 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 systemd[1]: Started Ceph grafana.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:40:03.835 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704120786Z level=info msg="Starting Grafana" version=10.4.8 commit=8c384b71bde142a25ddc01ed5a183ca572b2b7f7 branch=v10.4.x compiled=2024-09-21T13:40:03Z 2024-09-21T13:40:03.835 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704691073Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-09-21T13:40:03.835 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704709522Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-09-21T13:40:03.835 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704715884Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-09-21T13:40:03.835 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704722731Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-09-21T13:40:03.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704733072Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-09-21T13:40:03.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704738544Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-09-21T13:40:03.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.70474407Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-09-21T13:40:03.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704749563Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-21T13:40:03.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704754907Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-21T13:40:03.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704759818Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-21T13:40:03.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704764854Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-21T13:40:03.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704775074Z level=info msg=Target target=[all] 2024-09-21T13:40:03.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704786034Z level=info msg="Path Home" path=/usr/share/grafana 2024-09-21T13:40:03.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704791051Z level=info msg="Path Data" path=/var/lib/grafana 2024-09-21T13:40:03.836 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704795853Z level=info msg="Path Logs" path=/var/log/grafana 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704800659Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.704805488Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=settings t=2024-09-21T13:40:03.70481017Z level=info msg="App mode production" 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=sqlstore t=2024-09-21T13:40:03.705376576Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=sqlstore t=2024-09-21T13:40:03.705397329Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.706613886Z level=info msg="Starting DB migrations" 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.708035255Z level=info msg="Executing migration" id="create migration_log table" 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.709182655Z level=info msg="Migration successfully executed" id="create migration_log table" duration=1.146585ms 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.709717616Z level=info msg="Executing migration" id="create user table" 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.710258264Z level=info msg="Migration successfully executed" id="create user table" duration=540.536µs 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.710662187Z level=info msg="Executing migration" id="add unique index user.login" 2024-09-21T13:40:03.837 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.711165493Z level=info msg="Migration successfully executed" id="add unique index user.login" duration=503.18µs 2024-09-21T13:40:03.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.711557713Z level=info msg="Executing migration" id="add unique index user.email" 2024-09-21T13:40:03.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.712040556Z level=info msg="Migration successfully executed" id="add unique index user.email" duration=483.22µs 2024-09-21T13:40:03.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.712413905Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-09-21T13:40:03.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.712865621Z level=info msg="Migration successfully executed" id="drop index UQE_user_login - v1" duration=451.481µs 2024-09-21T13:40:03.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.713433221Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-09-21T13:40:03.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.713863847Z level=info msg="Migration successfully executed" id="drop index UQE_user_email - v1" duration=430.298µs 2024-09-21T13:40:03.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.714218872Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-09-21T13:40:03.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.715857162Z level=info msg="Migration successfully executed" id="Rename table user to user_v1 - v1" duration=1.637469ms 2024-09-21T13:40:03.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.716256325Z level=info msg="Executing migration" id="create user table v2" 2024-09-21T13:40:03.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.716784267Z level=info msg="Migration successfully executed" id="create user table v2" duration=528.324µs 2024-09-21T13:40:03.839 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.71714311Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.717608442Z level=info msg="Migration successfully executed" id="create index UQE_user_login - v2" duration=465.566µs 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.717935695Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.718399115Z level=info msg="Migration successfully executed" id="create index UQE_user_email - v2" duration=461.531µs 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.718844105Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.71925447Z level=info msg="Migration successfully executed" id="copy data_source v1 to v2" duration=410.29µs 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.719688389Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.720229158Z level=info msg="Migration successfully executed" id="Drop old table user_v1" duration=540.416µs 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.720666452Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.721689418Z level=info msg="Migration successfully executed" id="Add column help_flags1 to user table" duration=1.024154ms 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.722108715Z level=info msg="Executing migration" id="Update user table charset" 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.72213049Z level=info msg="Migration successfully executed" id="Update user table charset" duration=22.619µs 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.722628433Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-09-21T13:40:03.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.723637142Z level=info msg="Migration successfully executed" id="Add last_seen_at column to user" duration=1.008233ms 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.724152595Z level=info msg="Executing migration" id="Add missing user data" 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.724339851Z level=info msg="Migration successfully executed" id="Add missing user data" duration=187.332µs 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.724868522Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.725924153Z level=info msg="Migration successfully executed" id="Add is_disabled column to user" duration=1.055312ms 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.726409891Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.727047258Z level=info msg="Migration successfully executed" id="Add index user.login/user.email" duration=637.031µs 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.727489706Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.728556467Z level=info msg="Migration successfully executed" id="Add is_service_account column to user" duration=1.067685ms 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.729016014Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.736932303Z level=info msg="Migration successfully executed" id="Update is_service_account column to nullable" duration=7.912853ms 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.737628423Z level=info msg="Executing migration" id="Add uid column to user" 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.738775592Z level=info msg="Migration successfully executed" id="Add uid column to user" duration=1.146945ms 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.73925043Z level=info msg="Executing migration" id="Update uid column values for users" 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.739467378Z level=info msg="Migration successfully executed" id="Update uid column values for users" duration=217.007µs 2024-09-21T13:40:03.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.740007514Z level=info msg="Executing migration" id="Add unique index user_uid" 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.740631248Z level=info msg="Migration successfully executed" id="Add unique index user_uid" duration=623.429µs 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.741127479Z level=info msg="Executing migration" id="update login field with orgid to allow for multiple service accounts with same name across orgs" 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.741337533Z level=info msg="Migration successfully executed" id="update login field with orgid to allow for multiple service accounts with same name across orgs" duration=210.276µs 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.741758427Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.742312762Z level=info msg="Migration successfully executed" id="create temp user table v1-7" duration=555.835µs 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.742734103Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.743200327Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_email - v1-7" duration=465.945µs 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.743550038Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.744025668Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_org_id - v1-7" duration=475.338µs 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.744381193Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.744845072Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_code - v1-7" duration=460.85µs 2024-09-21T13:40:03.842 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.74523025Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.745698788Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_status - v1-7" duration=468.789µs 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.746035796Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.746051285Z level=info msg="Migration successfully executed" id="Update temp_user table charset" duration=16.034µs 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.746465178Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.746940325Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_email - v1" duration=475.436µs 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.74729544Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.747757279Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_org_id - v1" duration=461.689µs 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.748091256Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.748539156Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_code - v1" duration=447.747µs 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.748871639Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.749335434Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_status - v1" duration=464.039µs 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.749689382Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-09-21T13:40:03.843 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.751700659Z level=info msg="Migration successfully executed" id="Rename table temp_user to temp_user_tmp_qwerty - v1" duration=2.012258ms 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.752130592Z level=info msg="Executing migration" id="create temp_user v2" 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.752732935Z level=info msg="Migration successfully executed" id="create temp_user v2" duration=601.74µs 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.753130116Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.753748285Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_email - v2" duration=617.807µs 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.75417578Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.754767779Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_org_id - v2" duration=591.343µs 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.755180103Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.755787466Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_code - v2" duration=607.507µs 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.756134743Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.756586885Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_status - v2" duration=452.1µs 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.756962986Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.757221254Z level=info msg="Migration successfully executed" id="copy temp_user v1 to v2" duration=258.288µs 2024-09-21T13:40:03.844 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.757540077Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.75797779Z level=info msg="Migration successfully executed" id="drop temp_user_tmp_qwerty" duration=436.605µs 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.758300903Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.758601645Z level=info msg="Migration successfully executed" id="Set created for temp users that will otherwise prematurely expire" duration=299.959µs 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.75906288Z level=info msg="Executing migration" id="create star table" 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.759645424Z level=info msg="Migration successfully executed" id="create star table" duration=582.419µs 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.760071058Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.760702145Z level=info msg="Migration successfully executed" id="add unique index star.user_id_dashboard_id" duration=631.439µs 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.761224729Z level=info msg="Executing migration" id="create org table v1" 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.761756238Z level=info msg="Migration successfully executed" id="create org table v1" duration=531.638µs 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.762102107Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.762572275Z level=info msg="Migration successfully executed" id="create index UQE_org_name - v1" duration=468.962µs 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.762894136Z level=info msg="Executing migration" id="create org_user table v1" 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.763385737Z level=info msg="Migration successfully executed" id="create org_user table v1" duration=491.289µs 2024-09-21T13:40:03.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.763739952Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.764287661Z level=info msg="Migration successfully executed" id="create index IDX_org_user_org_id - v1" duration=547.478µs 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.764642722Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.765152472Z level=info msg="Migration successfully executed" id="create index UQE_org_user_org_id_user_id - v1" duration=509.465µs 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.767548675Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.768082602Z level=info msg="Migration successfully executed" id="create index IDX_org_user_user_id - v1" duration=533.878µs 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.770362115Z level=info msg="Executing migration" id="Update org table charset" 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.770385416Z level=info msg="Migration successfully executed" id="Update org table charset" duration=23.913µs 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.773215654Z level=info msg="Executing migration" id="Update org_user table charset" 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.773234848Z level=info msg="Migration successfully executed" id="Update org_user table charset" duration=19.686µs 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.776123078Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.776235592Z level=info msg="Migration successfully executed" id="Migrate all Read Only Viewers to Viewers" duration=113.236µs 2024-09-21T13:40:03.846 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.77909306Z level=info msg="Executing migration" id="create dashboard table" 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.779871839Z level=info msg="Migration successfully executed" id="create dashboard table" duration=778.597µs 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.781729964Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.782281056Z level=info msg="Migration successfully executed" id="add index dashboard.account_id" duration=551.919µs 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.784711138Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.785360191Z level=info msg="Migration successfully executed" id="add unique index dashboard_account_id_slug" duration=649.51µs 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.78712534Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.787559113Z level=info msg="Migration successfully executed" id="create dashboard_tag table" duration=432.544µs 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.790014525Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.790500257Z level=info msg="Migration successfully executed" id="add unique index dashboard_tag.dasboard_id_term" duration=485.628µs 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.792640814Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.793276122Z level=info msg="Migration successfully executed" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" duration=635.272µs 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.795432883Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-09-21T13:40:03.847 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.798837919Z level=info msg="Migration successfully executed" id="Rename table dashboard to dashboard_v1 - v1" duration=3.404592ms 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.799223091Z level=info msg="Executing migration" id="create dashboard v2" 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.799715543Z level=info msg="Migration successfully executed" id="create dashboard v2" duration=492.194µs 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.800079998Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.800536827Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_org_id - v2" duration=456.606µs 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.803008387Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.80351263Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_org_id_slug - v2" duration=504.084µs 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.805611685Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.805977488Z level=info msg="Migration successfully executed" id="copy dashboard v1 to v2" duration=367.766µs 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.808211641Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.808785003Z level=info msg="Migration successfully executed" id="drop table dashboard_v1" duration=573.109µs 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.809145514Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.809184498Z level=info msg="Migration successfully executed" id="alter dashboard.data to mediumtext v1" duration=39.15µs 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.811863594Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-09-21T13:40:03.848 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.813033725Z level=info msg="Migration successfully executed" id="Add column updated_by in dashboard - v2" duration=1.171741ms 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.814401616Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.81548409Z level=info msg="Migration successfully executed" id="Add column created_by in dashboard - v2" duration=1.08224ms 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.817211121Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.818301504Z level=info msg="Migration successfully executed" id="Add column gnetId in dashboard" duration=1.090164ms 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.818665416Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.819153298Z level=info msg="Migration successfully executed" id="Add index for gnetId in dashboard" duration=487.554µs 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.821427367Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.822524642Z level=info msg="Migration successfully executed" id="Add column plugin_id in dashboard" duration=1.097064ms 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.82420365Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.824693343Z level=info msg="Migration successfully executed" id="Add index for plugin_id in dashboard" duration=489.367µs 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.826868788Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-09-21T13:40:03.849 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.827357534Z level=info msg="Migration successfully executed" id="Add index for dashboard_id in dashboard_tag" duration=487.476µs 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.827727876Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.827743074Z level=info msg="Migration successfully executed" id="Update dashboard table charset" duration=16.364µs 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.82856177Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.828594482Z level=info msg="Migration successfully executed" id="Update dashboard_tag table charset" duration=32.947µs 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.829557894Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.830726084Z level=info msg="Migration successfully executed" id="Add column folder_id in dashboard" duration=1.167878ms 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.831094448Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.832261158Z level=info msg="Migration successfully executed" id="Add column isFolder in dashboard" duration=1.166433ms 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.832624835Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.833775586Z level=info msg="Migration successfully executed" id="Add column has_acl in dashboard" duration=1.150654ms 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.834141484Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.835721591Z level=info msg="Migration successfully executed" id="Add column uid in dashboard" duration=1.57977ms 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.836070781Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-09-21T13:40:03.850 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.836211754Z level=info msg="Migration successfully executed" id="Update uid column values in dashboard" duration=140.903µs 2024-09-21T13:40:03.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.836886022Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-09-21T13:40:03.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.837365446Z level=info msg="Migration successfully executed" id="Add unique index dashboard_org_id_uid" duration=479.46µs 2024-09-21T13:40:03.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.837719496Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-09-21T13:40:03.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.83818201Z level=info msg="Migration successfully executed" id="Remove unique index org_id_slug" duration=462.351µs 2024-09-21T13:40:03.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.838523104Z level=info msg="Executing migration" id="Update dashboard title length" 2024-09-21T13:40:03.851 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.838537353Z level=info msg="Migration successfully executed" id="Update dashboard title length" duration=14.767µs 2024-09-21T13:40:04.085 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.839370786Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-09-21T13:40:04.085 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.839850625Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_title_folder_id" duration=479.431µs 2024-09-21T13:40:04.085 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.840221832Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-09-21T13:40:04.085 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.840657223Z level=info msg="Migration successfully executed" id="create dashboard_provisioning" duration=435.271µs 2024-09-21T13:40:04.085 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.841010142Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.844046499Z level=info msg="Migration successfully executed" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" duration=3.036112ms 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.844402904Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.844845049Z level=info msg="Migration successfully executed" id="create dashboard_provisioning v2" duration=439.213µs 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.845204339Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.845676747Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_provisioning_dashboard_id - v2" duration=472.155µs 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.846052607Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.846605091Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" duration=553.127µs 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.84698299Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.847198806Z level=info msg="Migration successfully executed" id="copy dashboard_provisioning v1 to v2" duration=216.754µs 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.847985554Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.848445456Z level=info msg="Migration successfully executed" id="drop dashboard_provisioning_tmp_qwerty" duration=462.043µs 2024-09-21T13:40:04.086 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.848780945Z level=info msg="Executing migration" id="Add check_sum column" 2024-09-21T13:40:04.087 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.849985895Z level=info msg="Migration successfully executed" id="Add check_sum column" duration=1.204638ms 2024-09-21T13:40:04.087 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.850331648Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-09-21T13:40:04.087 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.850812227Z level=info msg="Migration successfully executed" id="Add index for dashboard_title" duration=481.032µs 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.851158134Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.851273288Z level=info msg="Migration successfully executed" id="delete tags for deleted dashboards" duration=115.777µs 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.852008367Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.852121626Z level=info msg="Migration successfully executed" id="delete stars for deleted dashboards" duration=114.019µs 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.853018652Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.853606521Z level=info msg="Migration successfully executed" id="Add index for dashboard_is_folder" duration=590.621µs 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.853959724Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.855226Z level=info msg="Migration successfully executed" id="Add isPublic for dashboard" duration=1.266662ms 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.855589442Z level=info msg="Executing migration" id="create data_source table" 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.856207867Z level=info msg="Migration successfully executed" id="create data_source table" duration=618.749µs 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.856583508Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.85710483Z level=info msg="Migration successfully executed" id="add index data_source.account_id" duration=519.243µs 2024-09-21T13:40:04.088 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.857508897Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.858002462Z level=info msg="Migration successfully executed" id="add unique index data_source.account_id_name" duration=493.271µs 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.858356702Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.858818136Z level=info msg="Migration successfully executed" id="drop index IDX_data_source_account_id - v1" duration=461.248µs 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.859165076Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.859622845Z level=info msg="Migration successfully executed" id="drop index UQE_data_source_account_id_name - v1" duration=457.414µs 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.860016239Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.863377707Z level=info msg="Migration successfully executed" id="Rename table data_source to data_source_v1 - v1" duration=3.361114ms 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.863740389Z level=info msg="Executing migration" id="create data_source table v2" 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.864327553Z level=info msg="Migration successfully executed" id="create data_source table v2" duration=587.034µs 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.864691157Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.865209417Z level=info msg="Migration successfully executed" id="create index IDX_data_source_org_id - v2" duration=518.728µs 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.865582423Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-09-21T13:40:04.089 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.866103392Z level=info msg="Migration successfully executed" id="create index UQE_data_source_org_id_name - v2" duration=519.684µs 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.866482883Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.866883835Z level=info msg="Migration successfully executed" id="Drop old table data_source_v1 #2" duration=400.429µs 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.867301229Z level=info msg="Executing migration" id="Add column with_credentials" 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.868700171Z level=info msg="Migration successfully executed" id="Add column with_credentials" duration=1.398563ms 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.870005268Z level=info msg="Executing migration" id="Add secure json data column" 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.871379786Z level=info msg="Migration successfully executed" id="Add secure json data column" duration=1.374417ms 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.871735416Z level=info msg="Executing migration" id="Update data_source table charset" 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.871750022Z level=info msg="Migration successfully executed" id="Update data_source table charset" duration=15.199µs 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.874822278Z level=info msg="Executing migration" id="Update initial version to 1" 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.875055614Z level=info msg="Migration successfully executed" id="Update initial version to 1" duration=235.693µs 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.877628985Z level=info msg="Executing migration" id="Add read_only data column" 2024-09-21T13:40:04.090 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.879112486Z level=info msg="Migration successfully executed" id="Add read_only data column" duration=1.485374ms 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.880220664Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.880347243Z level=info msg="Migration successfully executed" id="Migrate logging ds to loki ds" duration=126.584µs 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.880790859Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.880904106Z level=info msg="Migration successfully executed" id="Update json_data with nulls" duration=113.378µs 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.88360674Z level=info msg="Executing migration" id="Add uid column" 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.885064574Z level=info msg="Migration successfully executed" id="Add uid column" duration=1.459475ms 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.886375255Z level=info msg="Executing migration" id="Update uid value" 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.886515781Z level=info msg="Migration successfully executed" id="Update uid value" duration=140.595µs 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.889133512Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.889669252Z level=info msg="Migration successfully executed" id="Add unique index datasource_org_id_uid" duration=535.487µs 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.890040322Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.890539372Z level=info msg="Migration successfully executed" id="add unique index datasource_org_id_is_default" duration=499.077µs 2024-09-21T13:40:04.091 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.892775778Z level=info msg="Executing migration" id="create api_key table" 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.893324569Z level=info msg="Migration successfully executed" id="create api_key table" duration=548.63µs 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.895537649Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.896054771Z level=info msg="Migration successfully executed" id="add index api_key.account_id" duration=516.558µs 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.898297991Z level=info msg="Executing migration" id="add index api_key.key" 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.898806057Z level=info msg="Migration successfully executed" id="add index api_key.key" duration=507.933µs 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.899196632Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.899707172Z level=info msg="Migration successfully executed" id="add index api_key.account_id_name" duration=510.239µs 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.902208736Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.902724702Z level=info msg="Migration successfully executed" id="drop index IDX_api_key_account_id - v1" duration=517.664µs 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.904857543Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.905344134Z level=info msg="Migration successfully executed" id="drop index UQE_api_key_key - v1" duration=486.426µs 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.907723628Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.908198907Z level=info msg="Migration successfully executed" id="drop index UQE_api_key_account_id_name - v1" duration=475.073µs 2024-09-21T13:40:04.092 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.910354819Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-09-21T13:40:04.093 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.914197677Z level=info msg="Migration successfully executed" id="Rename table api_key to api_key_v1 - v1" duration=3.844501ms 2024-09-21T13:40:04.093 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.914571926Z level=info msg="Executing migration" id="create api_key table v2" 2024-09-21T13:40:04.093 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.915097986Z level=info msg="Migration successfully executed" id="create api_key table v2" duration=526.042µs 2024-09-21T13:40:04.093 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.917544301Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-09-21T13:40:04.094 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.918068874Z level=info msg="Migration successfully executed" id="create index IDX_api_key_org_id - v2" duration=526.477µs 2024-09-21T13:40:04.094 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.920260306Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-09-21T13:40:04.094 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.92083637Z level=info msg="Migration successfully executed" id="create index UQE_api_key_key - v2" duration=577.776µs 2024-09-21T13:40:04.094 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.922833182Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-09-21T13:40:04.094 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.923334594Z level=info msg="Migration successfully executed" id="create index UQE_api_key_org_id_name - v2" duration=501.169µs 2024-09-21T13:40:04.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.925281082Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-09-21T13:40:04.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.925530175Z level=info msg="Migration successfully executed" id="copy api_key v1 to v2" duration=248.786µs 2024-09-21T13:40:04.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.928012709Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-09-21T13:40:04.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.928388423Z level=info msg="Migration successfully executed" id="Drop old table api_key_v1" duration=375.554µs 2024-09-21T13:40:04.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.930606927Z level=info msg="Executing migration" id="Update api_key table charset" 2024-09-21T13:40:04.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.930638773Z level=info msg="Migration successfully executed" id="Update api_key table charset" duration=32.404µs 2024-09-21T13:40:04.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.933245558Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-09-21T13:40:04.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.93474107Z level=info msg="Migration successfully executed" id="Add expires to api_key table" duration=1.497075ms 2024-09-21T13:40:04.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.935783638Z level=info msg="Executing migration" id="Add service account foreign key" 2024-09-21T13:40:04.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.93727632Z level=info msg="Migration successfully executed" id="Add service account foreign key" duration=1.491583ms 2024-09-21T13:40:04.095 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.938448633Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.938566414Z level=info msg="Migration successfully executed" id="set service account foreign key to nil if 0" duration=117.651µs 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.941107247Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.942654292Z level=info msg="Migration successfully executed" id="Add last_used_at to api_key table" duration=1.546749ms 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.943916139Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.94541841Z level=info msg="Migration successfully executed" id="Add is_revoked column to api_key table" duration=1.501065ms 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.947000569Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.947517818Z level=info msg="Migration successfully executed" id="create dashboard_snapshot table v4" duration=519.402µs 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.949376004Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.949770901Z level=info msg="Migration successfully executed" id="drop table dashboard_snapshot_v4 #1" duration=394.692µs 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.952166149Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.952773533Z level=info msg="Migration successfully executed" id="create dashboard_snapshot table v5 #2" duration=609.248µs 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.954480807Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.954999885Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_snapshot_key - v5" duration=518.947µs 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.957296282Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-09-21T13:40:04.096 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.957837633Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_snapshot_delete_key - v5" duration=541.093µs 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.958187841Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.95867392Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_snapshot_user_id - v5" duration=485.966µs 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.959015092Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.959052791Z level=info msg="Migration successfully executed" id="alter dashboard_snapshot to mediumtext v2" duration=37.966µs 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.959850559Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.959864768Z level=info msg="Migration successfully executed" id="Update dashboard_snapshot table charset" duration=14.846µs 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.960733718Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.96236267Z level=info msg="Migration successfully executed" id="Add column external_delete_url to dashboard_snapshots table" duration=1.628762ms 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.962746332Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.964393703Z level=info msg="Migration successfully executed" id="Add encrypted dashboard json column" duration=1.647097ms 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.964792811Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.964830311Z level=info msg="Migration successfully executed" id="Change dashboard_encrypted column to MEDIUMBLOB" duration=37.783µs 2024-09-21T13:40:04.097 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.965814115Z level=info msg="Executing migration" id="create quota table v1" 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.966380706Z level=info msg="Migration successfully executed" id="create quota table v1" duration=568.544µs 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.966730807Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.967237129Z level=info msg="Migration successfully executed" id="create index UQE_quota_org_id_user_id_target - v1" duration=506.082µs 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.967579535Z level=info msg="Executing migration" id="Update quota table charset" 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.967594841Z level=info msg="Migration successfully executed" id="Update quota table charset" duration=15.924µs 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.968351775Z level=info msg="Executing migration" id="create plugin_setting table" 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.968862443Z level=info msg="Migration successfully executed" id="create plugin_setting table" duration=510.401µs 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.969223581Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.969727693Z level=info msg="Migration successfully executed" id="create index UQE_plugin_setting_org_id_plugin_id - v1" duration=503.914µs 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.970075432Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.971754372Z level=info msg="Migration successfully executed" id="Add column plugin_version to plugin_settings" duration=1.678743ms 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.972114538Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-09-21T13:40:04.098 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.972129195Z level=info msg="Migration successfully executed" id="Update plugin_setting table charset" duration=15.278µs 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.972896999Z level=info msg="Executing migration" id="create session table" 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.973469259Z level=info msg="Migration successfully executed" id="create session table" duration=570.998µs 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.973845212Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.973900209Z level=info msg="Migration successfully executed" id="Drop old table playlist table" duration=54.113µs 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.974848332Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.975035358Z level=info msg="Migration successfully executed" id="Drop old table playlist_item table" duration=187.496µs 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.975535061Z level=info msg="Executing migration" id="create playlist table v2" 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.976002404Z level=info msg="Migration successfully executed" id="create playlist table v2" duration=467.072µs 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.976369382Z level=info msg="Executing migration" id="create playlist item table v2" 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.976841212Z level=info msg="Migration successfully executed" id="create playlist item table v2" duration=471.528µs 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.977207889Z level=info msg="Executing migration" id="Update playlist table charset" 2024-09-21T13:40:04.099 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.977222331Z level=info msg="Migration successfully executed" id="Update playlist table charset" duration=15.054µs 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.978220791Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.978264347Z level=info msg="Migration successfully executed" id="Update playlist_item table charset" duration=41.549µs 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.978908195Z level=info msg="Executing migration" id="Add playlist column created_at" 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.980689214Z level=info msg="Migration successfully executed" id="Add playlist column created_at" duration=1.780658ms 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.981043359Z level=info msg="Executing migration" id="Add playlist column updated_at" 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.982810775Z level=info msg="Migration successfully executed" id="Add playlist column updated_at" duration=1.766996ms 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.983158466Z level=info msg="Executing migration" id="drop preferences table v2" 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.983215379Z level=info msg="Migration successfully executed" id="drop preferences table v2" duration=57.113µs 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.984046511Z level=info msg="Executing migration" id="drop preferences table v3" 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.984102847Z level=info msg="Migration successfully executed" id="drop preferences table v3" duration=57.388µs 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.984861224Z level=info msg="Executing migration" id="create preferences table v3" 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.98538585Z level=info msg="Migration successfully executed" id="create preferences table v3" duration=524.169µs 2024-09-21T13:40:04.100 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.985733991Z level=info msg="Executing migration" id="Update preferences table charset" 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.985748828Z level=info msg="Migration successfully executed" id="Update preferences table charset" duration=14.621µs 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.986719394Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.988690137Z level=info msg="Migration successfully executed" id="Add column team_id in preferences" duration=1.97258ms 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.989045189Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.989137737Z level=info msg="Migration successfully executed" id="Update team_id column values in preferences" duration=92.616µs 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.990047272Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.991992844Z level=info msg="Migration successfully executed" id="Add column week_start in preferences" duration=1.947177ms 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.992329403Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.994149049Z level=info msg="Migration successfully executed" id="Add column preferences.json_data" duration=1.819328ms 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.994485931Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.994523196Z level=info msg="Migration successfully executed" id="alter preferences.json_data to mediumtext v1" duration=37.388µs 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.994974164Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.99560875Z level=info msg="Migration successfully executed" id="Add preferences index org_id" duration=636.318µs 2024-09-21T13:40:04.101 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.995981995Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.996517384Z level=info msg="Migration successfully executed" id="Add preferences index user_id" duration=535.269µs 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.996872539Z level=info msg="Executing migration" id="create alert table v1" 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.997609405Z level=info msg="Migration successfully executed" id="create alert table v1" duration=736.528µs 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.997991339Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.998589309Z level=info msg="Migration successfully executed" id="add index alert org_id & id " duration=597.808µs 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.998957119Z level=info msg="Executing migration" id="add index alert state" 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:03.999467764Z level=info msg="Migration successfully executed" id="add index alert state" duration=510.475µs 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.001552473Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.002145259Z level=info msg="Migration successfully executed" id="add index alert dashboard_id" duration=592.5µs 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.002523003Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.002972484Z level=info msg="Migration successfully executed" id="Create alert_rule_tag table v1" duration=448.926µs 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.003309672Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.003858421Z level=info msg="Migration successfully executed" id="Add unique index alert_rule_tag.alert_id_tag_id" duration=548.391µs 2024-09-21T13:40:04.102 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.004202054Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.004697159Z level=info msg="Migration successfully executed" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" duration=494.821µs 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.005025449Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.010621943Z level=info msg="Migration successfully executed" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" duration=5.596178ms 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.010984414Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.011441388Z level=info msg="Migration successfully executed" id="Create alert_rule_tag table v2" duration=456.796µs 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.01178264Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.01231525Z level=info msg="Migration successfully executed" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" duration=532.311µs 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.012660836Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.012846839Z level=info msg="Migration successfully executed" id="copy alert_rule_tag v1 to v2" duration=186.056µs 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.013180012Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.013522059Z level=info msg="Migration successfully executed" id="drop table alert_rule_tag_v1" duration=341.74µs 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.013847542Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.01432257Z level=info msg="Migration successfully executed" id="create alert_notification table v1" duration=474.702µs 2024-09-21T13:40:04.103 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.014675743Z level=info msg="Executing migration" id="Add column is_default" 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.016727041Z level=info msg="Migration successfully executed" id="Add column is_default" duration=2.051018ms 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.017071828Z level=info msg="Executing migration" id="Add column frequency" 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.019272867Z level=info msg="Migration successfully executed" id="Add column frequency" duration=2.200744ms 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.019632937Z level=info msg="Executing migration" id="Add column send_reminder" 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.021863059Z level=info msg="Migration successfully executed" id="Add column send_reminder" duration=2.229887ms 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.022219365Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.024276364Z level=info msg="Migration successfully executed" id="Add column disable_resolve_message" duration=2.056778ms 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.024625789Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.025141366Z level=info msg="Migration successfully executed" id="add index alert_notification org_id & name" duration=516.012µs 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.02550838Z level=info msg="Executing migration" id="Update alert table charset" 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.025522801Z level=info msg="Migration successfully executed" id="Update alert table charset" duration=14.94µs 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.025917494Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.02593174Z level=info msg="Migration successfully executed" id="Update alert_notification table charset" duration=14.751µs 2024-09-21T13:40:04.104 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.026333172Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.026786528Z level=info msg="Migration successfully executed" id="create notification_journal table v1" duration=454.05µs 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.02713609Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.027671069Z level=info msg="Migration successfully executed" id="add index notification_journal org_id & alert_id & notifier_id" duration=534.551µs 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.028046524Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.028611365Z level=info msg="Migration successfully executed" id="drop alert_notification_journal" duration=565.06µs 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.030882461Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.03142808Z level=info msg="Migration successfully executed" id="create alert_notification_state table v1" duration=545.468µs 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.033865263Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.03451635Z level=info msg="Migration successfully executed" id="add index alert_notification_state org_id & alert_id & notifier_id" duration=651.825µs 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.036386096Z level=info msg="Executing migration" id="Add for to alert table" 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.038543906Z level=info msg="Migration successfully executed" id="Add for to alert table" duration=2.157452ms 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.03893024Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.041170764Z level=info msg="Migration successfully executed" id="Add column uid in alert_notification" duration=2.240207ms 2024-09-21T13:40:04.105 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.04183932Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-09-21T13:40:04.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.042108897Z level=info msg="Migration successfully executed" id="Update uid column values in alert_notification" duration=271.55µs 2024-09-21T13:40:04.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.044613984Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-09-21T13:40:04.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.04524655Z level=info msg="Migration successfully executed" id="Add unique index alert_notification_org_id_uid" duration=631.835µs 2024-09-21T13:40:04.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.047125115Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-09-21T13:40:04.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.047663841Z level=info msg="Migration successfully executed" id="Remove unique index org_id_name" duration=537.554µs 2024-09-21T13:40:04.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.049962099Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-09-21T13:40:04.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.052090021Z level=info msg="Migration successfully executed" id="Add column secure_settings in alert_notification" duration=2.127694ms 2024-09-21T13:40:04.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.052584706Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-09-21T13:40:04.106 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.052641976Z level=info msg="Migration successfully executed" id="alter alert.settings to mediumtext" duration=57.534µs 2024-09-21T13:40:04.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.055344486Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-09-21T13:40:04.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.055881702Z level=info msg="Migration successfully executed" id="Add non-unique index alert_notification_state_alert_id" duration=537.274µs 2024-09-21T13:40:04.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.058159133Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-09-21T13:40:04.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.058750704Z level=info msg="Migration successfully executed" id="Add non-unique index alert_rule_tag_alert_id" duration=592.093µs 2024-09-21T13:40:04.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.060848023Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-09-21T13:40:04.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.060928205Z level=info msg="Migration successfully executed" id="Drop old annotation table v4" duration=80.073µs 2024-09-21T13:40:04.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.063472929Z level=info msg="Executing migration" id="create annotation table v5" 2024-09-21T13:40:04.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.064162225Z level=info msg="Migration successfully executed" id="create annotation table v5" duration=690.745µs 2024-09-21T13:40:04.107 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.066290592Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.06685386Z level=info msg="Migration successfully executed" id="add index annotation 0 v3" duration=561.893µs 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.068925026Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.069492554Z level=info msg="Migration successfully executed" id="add index annotation 1 v3" duration=567.225µs 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.071730352Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.072279112Z level=info msg="Migration successfully executed" id="add index annotation 2 v3" duration=548.528µs 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.074310663Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.074898748Z level=info msg="Migration successfully executed" id="add index annotation 3 v3" duration=588.308µs 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.077048168Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.077657091Z level=info msg="Migration successfully executed" id="add index annotation 4 v3" duration=608.168µs 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.079789395Z level=info msg="Executing migration" id="Update annotation table charset" 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.079821875Z level=info msg="Migration successfully executed" id="Update annotation table charset" duration=32.935µs 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.082306654Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.08473274Z level=info msg="Migration successfully executed" id="Add column region_id to annotation table" duration=2.42639ms 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.085133768Z level=info msg="Executing migration" id="Drop category_id index" 2024-09-21T13:40:04.108 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.085667295Z level=info msg="Migration successfully executed" id="Drop category_id index" duration=534.953µs 2024-09-21T13:40:04.109 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.086030849Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-09-21T13:40:04.109 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.088434089Z level=info msg="Migration successfully executed" id="Add column tags to annotation table" duration=2.402898ms 2024-09-21T13:40:04.109 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.088809517Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-09-21T13:40:04.109 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.089255451Z level=info msg="Migration successfully executed" id="Create annotation_tag table v2" duration=445.32µs 2024-09-21T13:40:04.109 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.09152238Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-09-21T13:40:04.109 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.092101443Z level=info msg="Migration successfully executed" id="Add unique index annotation_tag.annotation_id_tag_id" duration=577.887µs 2024-09-21T13:40:04.109 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.094141916Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-09-21T13:40:04.109 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.094684795Z level=info msg="Migration successfully executed" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" duration=542.782µs 2024-09-21T13:40:04.336 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.096769496Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-09-21T13:40:04.337 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.10323693Z level=info msg="Migration successfully executed" id="Rename table annotation_tag to annotation_tag_v2 - v2" duration=6.467213ms 2024-09-21T13:40:04.337 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.10358997Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-09-21T13:40:04.337 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.104057798Z level=info msg="Migration successfully executed" id="Create annotation_tag table v3" duration=467.583µs 2024-09-21T13:40:04.337 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.106390656Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-09-21T13:40:04.337 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.106983043Z level=info msg="Migration successfully executed" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" duration=592.187µs 2024-09-21T13:40:04.337 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.10909965Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-09-21T13:40:04.337 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.109293709Z level=info msg="Migration successfully executed" id="copy annotation_tag v2 to v3" duration=194.028µs 2024-09-21T13:40:04.337 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.111768836Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-09-21T13:40:04.338 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.112282234Z level=info msg="Migration successfully executed" id="drop table annotation_tag_v2" duration=515.275µs 2024-09-21T13:40:04.338 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.114207931Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-09-21T13:40:04.338 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.114359715Z level=info msg="Migration successfully executed" id="Update alert annotations and set TEXT to empty" duration=151.847µs 2024-09-21T13:40:04.338 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.116787677Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-09-21T13:40:04.338 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.119095506Z level=info msg="Migration successfully executed" id="Add created time to annotation table" duration=2.307384ms 2024-09-21T13:40:04.338 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.119442929Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-09-21T13:40:04.338 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.12178249Z level=info msg="Migration successfully executed" id="Add updated time to annotation table" duration=2.338413ms 2024-09-21T13:40:04.338 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.122225548Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-09-21T13:40:04.339 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.122763701Z level=info msg="Migration successfully executed" id="Add index for created in annotation table" duration=537.991µs 2024-09-21T13:40:04.339 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.124929465Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-09-21T13:40:04.339 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.125500698Z level=info msg="Migration successfully executed" id="Add index for updated in annotation table" duration=571.37µs 2024-09-21T13:40:04.339 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.125863248Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-09-21T13:40:04.339 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.126016975Z level=info msg="Migration successfully executed" id="Convert existing annotations from seconds to milliseconds" duration=154.047µs 2024-09-21T13:40:04.339 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.12680867Z level=info msg="Executing migration" id="Add epoch_end column" 2024-09-21T13:40:04.339 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.129303905Z level=info msg="Migration successfully executed" id="Add epoch_end column" duration=2.496692ms 2024-09-21T13:40:04.339 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.12964253Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-09-21T13:40:04.339 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.130192891Z level=info msg="Migration successfully executed" id="Add index for epoch_end" duration=550.084µs 2024-09-21T13:40:04.339 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.130571562Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.130679526Z level=info msg="Migration successfully executed" id="Make epoch_end the same as epoch" duration=106.945µs 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.131368801Z level=info msg="Executing migration" id="Move region to single row" 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.131603593Z level=info msg="Migration successfully executed" id="Move region to single row" duration=235.508µs 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.132168623Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.132718042Z level=info msg="Migration successfully executed" id="Remove index org_id_epoch from annotation table" duration=548.811µs 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.133067085Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.133615299Z level=info msg="Migration successfully executed" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" duration=548.057µs 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.13397699Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.134532357Z level=info msg="Migration successfully executed" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" duration=555.19µs 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.134939871Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.135496345Z level=info msg="Migration successfully executed" id="Add index for org_id_epoch_end_epoch on annotation table" duration=556.386µs 2024-09-21T13:40:04.340 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.135842653Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.136391285Z level=info msg="Migration successfully executed" id="Remove index org_id_epoch_epoch_end from annotation table" duration=548.614µs 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.136743732Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.137294895Z level=info msg="Migration successfully executed" id="Add index for alert_id on annotation table" duration=551.069µs 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.137641035Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.137678056Z level=info msg="Migration successfully executed" id="Increase tags column to length 4096" duration=37.136µs 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.138395891Z level=info msg="Executing migration" id="create test_data table" 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.138934606Z level=info msg="Migration successfully executed" id="create test_data table" duration=537.642µs 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.139331858Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.139870449Z level=info msg="Migration successfully executed" id="create dashboard_version table v1" duration=538.356µs 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.14025757Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.140806373Z level=info msg="Migration successfully executed" id="add index dashboard_version.dashboard_id" duration=548.726µs 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.141195849Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-09-21T13:40:04.341 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.141771105Z level=info msg="Migration successfully executed" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" duration=574.992µs 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.142141917Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.142255548Z level=info msg="Migration successfully executed" id="Set dashboard version to 1 where 0" duration=113.66µs 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.142922939Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.143181882Z level=info msg="Migration successfully executed" id="save existing dashboard data in dashboard_version table v1" duration=259.637µs 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.143702107Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.143758566Z level=info msg="Migration successfully executed" id="alter dashboard_version.data to mediumtext v1" duration=56.49µs 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.144672724Z level=info msg="Executing migration" id="create team table" 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.14517624Z level=info msg="Migration successfully executed" id="create team table" duration=503.602µs 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.14553092Z level=info msg="Executing migration" id="add index team.org_id" 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.146179041Z level=info msg="Migration successfully executed" id="add index team.org_id" duration=648.223µs 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.146548139Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-09-21T13:40:04.342 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.147099849Z level=info msg="Migration successfully executed" id="add unique index team_org_id_name" duration=551.377µs 2024-09-21T13:40:04.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.147447871Z level=info msg="Executing migration" id="Add column uid in team" 2024-09-21T13:40:04.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.149938149Z level=info msg="Migration successfully executed" id="Add column uid in team" duration=2.489933ms 2024-09-21T13:40:04.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.150314577Z level=info msg="Executing migration" id="Update uid column values in team" 2024-09-21T13:40:04.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.150426319Z level=info msg="Migration successfully executed" id="Update uid column values in team" duration=112.241µs 2024-09-21T13:40:04.343 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.151168743Z level=info msg="Executing migration" id="Add unique index team_org_id_uid" 2024-09-21T13:40:04.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.151751399Z level=info msg="Migration successfully executed" id="Add unique index team_org_id_uid" duration=583.084µs 2024-09-21T13:40:04.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.152135476Z level=info msg="Executing migration" id="create team member table" 2024-09-21T13:40:04.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.152629327Z level=info msg="Migration successfully executed" id="create team member table" duration=493.69µs 2024-09-21T13:40:04.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.153005562Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-09-21T13:40:04.344 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.153548711Z level=info msg="Migration successfully executed" id="add index team_member.org_id" duration=542.973µs 2024-09-21T13:40:04.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.153915279Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-09-21T13:40:04.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.154492429Z level=info msg="Migration successfully executed" id="add unique index team_member_org_id_team_id_user_id" duration=577.029µs 2024-09-21T13:40:04.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.154853238Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-09-21T13:40:04.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.155410482Z level=info msg="Migration successfully executed" id="add index team_member.team_id" duration=557.026µs 2024-09-21T13:40:04.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.155813413Z level=info msg="Executing migration" id="Add column email to team table" 2024-09-21T13:40:04.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.158572573Z level=info msg="Migration successfully executed" id="Add column email to team table" duration=2.758821ms 2024-09-21T13:40:04.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.158940161Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-09-21T13:40:04.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.161783767Z level=info msg="Migration successfully executed" id="Add column external to team_member table" duration=2.843388ms 2024-09-21T13:40:04.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.16215828Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-09-21T13:40:04.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.164812732Z level=info msg="Migration successfully executed" id="Add column permission to team_member table" duration=2.654202ms 2024-09-21T13:40:04.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.165193183Z level=info msg="Executing migration" id="create dashboard acl table" 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.165813313Z level=info msg="Migration successfully executed" id="create dashboard acl table" duration=619.922µs 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.166203894Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.166795489Z level=info msg="Migration successfully executed" id="add index dashboard_acl_dashboard_id" duration=591.363µs 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.167179359Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.167826974Z level=info msg="Migration successfully executed" id="add unique index dashboard_acl_dashboard_id_user_id" duration=647.401µs 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.168217521Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.168820082Z level=info msg="Migration successfully executed" id="add unique index dashboard_acl_dashboard_id_team_id" duration=602.331µs 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.169190633Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.169762174Z level=info msg="Migration successfully executed" id="add index dashboard_acl_user_id" duration=571.501µs 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.171988065Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.172556119Z level=info msg="Migration successfully executed" id="add index dashboard_acl_team_id" duration=568.101µs 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.172943027Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-09-21T13:40:04.346 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.173531195Z level=info msg="Migration successfully executed" id="add index dashboard_acl_org_id_role" duration=588.535µs 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.175853351Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.176465118Z level=info msg="Migration successfully executed" id="add index dashboard_permission" duration=611.623µs 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.178535236Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.179066556Z level=info msg="Migration successfully executed" id="save default acl rules in dashboard_acl table" duration=533.471µs 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.181044783Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.181184657Z level=info msg="Migration successfully executed" id="delete acl rules for deleted dashboards and folders" duration=139.915µs 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.181587848Z level=info msg="Executing migration" id="create tag table" 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.18208928Z level=info msg="Migration successfully executed" id="create tag table" duration=501.135µs 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.184464314Z level=info msg="Executing migration" id="add index tag.key_value" 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.185155386Z level=info msg="Migration successfully executed" id="add index tag.key_value" duration=692.788µs 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.187098244Z level=info msg="Executing migration" id="create login attempt table" 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.187663284Z level=info msg="Migration successfully executed" id="create login attempt table" duration=566.933µs 2024-09-21T13:40:04.347 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.189776804Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.190453042Z level=info msg="Migration successfully executed" id="add index login_attempt.username" duration=680.56µs 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.190831974Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.191396791Z level=info msg="Migration successfully executed" id="drop index IDX_login_attempt_username - v1" duration=564.653µs 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.193736524Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.201746036Z level=info msg="Migration successfully executed" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" duration=8.009192ms 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.202139592Z level=info msg="Executing migration" id="create login_attempt v2" 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.202618278Z level=info msg="Migration successfully executed" id="create login_attempt v2" duration=479.93µs 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.204798577Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.20537149Z level=info msg="Migration successfully executed" id="create index IDX_login_attempt_username - v2" duration=572.848µs 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.205761198Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.205970061Z level=info msg="Migration successfully executed" id="copy login_attempt v1 to v2" duration=209.587µs 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.208715793Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-09-21T13:40:04.348 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.209171124Z level=info msg="Migration successfully executed" id="drop login_attempt_tmp_qwerty" duration=455.312µs 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.211433962Z level=info msg="Executing migration" id="create user auth table" 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.21192295Z level=info msg="Migration successfully executed" id="create user auth table" duration=489.271µs 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.214212534Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.214870862Z level=info msg="Migration successfully executed" id="create index IDX_user_auth_auth_module_auth_id - v1" duration=661.627µs 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.215245299Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.215282749Z level=info msg="Migration successfully executed" id="alter user_auth.auth_id to length 190" duration=37.629µs 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.218051755Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.221051181Z level=info msg="Migration successfully executed" id="Add OAuth access token to user_auth" duration=2.999443ms 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.221398963Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.224329914Z level=info msg="Migration successfully executed" id="Add OAuth refresh token to user_auth" duration=2.930669ms 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.224682987Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.227560112Z level=info msg="Migration successfully executed" id="Add OAuth token type to user_auth" duration=2.876953ms 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.227919429Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.230797622Z level=info msg="Migration successfully executed" id="Add OAuth expiry to user_auth" duration=2.877688ms 2024-09-21T13:40:04.349 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.231157439Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.231704489Z level=info msg="Migration successfully executed" id="Add index to user_id column in user_auth" duration=546.807µs 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.232075404Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.235025522Z level=info msg="Migration successfully executed" id="Add OAuth ID token to user_auth" duration=2.949766ms 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.235367721Z level=info msg="Executing migration" id="create server_lock table" 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.235869795Z level=info msg="Migration successfully executed" id="create server_lock table" duration=501.916µs 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.236245321Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.236814915Z level=info msg="Migration successfully executed" id="add index server_lock.operation_uid" duration=568.49µs 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.237180356Z level=info msg="Executing migration" id="create user auth token table" 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.23776223Z level=info msg="Migration successfully executed" id="create user auth token table" duration=581.653µs 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.238096433Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.238664109Z level=info msg="Migration successfully executed" id="add unique index user_auth_token.auth_token" duration=567.532µs 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.239022422Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-09-21T13:40:04.350 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.239592718Z level=info msg="Migration successfully executed" id="add unique index user_auth_token.prev_auth_token" duration=570.218µs 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.239944144Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.240579748Z level=info msg="Migration successfully executed" id="add index user_auth_token.user_id" duration=635.392µs 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.240943681Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.244074775Z level=info msg="Migration successfully executed" id="Add revoked_at to the user auth token" duration=3.131951ms 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.244399861Z level=info msg="Executing migration" id="add index user_auth_token.revoked_at" 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.244991846Z level=info msg="Migration successfully executed" id="add index user_auth_token.revoked_at" duration=591.58µs 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.245344589Z level=info msg="Executing migration" id="create cache_data table" 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.24587656Z level=info msg="Migration successfully executed" id="create cache_data table" duration=532.987µs 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.246256552Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.24685126Z level=info msg="Migration successfully executed" id="add unique index cache_data.cache_key" duration=594.564µs 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.247196965Z level=info msg="Executing migration" id="create short_url table v1" 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.247747066Z level=info msg="Migration successfully executed" id="create short_url table v1" duration=548.829µs 2024-09-21T13:40:04.351 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.248116745Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.248766956Z level=info msg="Migration successfully executed" id="add index short_url.org_id-uid" duration=650.221µs 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.249119459Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.249158481Z level=info msg="Migration successfully executed" id="alter table short_url alter column created_by type to bigint" duration=39.491µs 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.249552949Z level=info msg="Executing migration" id="delete alert_definition table" 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.249614033Z level=info msg="Migration successfully executed" id="delete alert_definition table" duration=61.171µs 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.250514713Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.25129056Z level=info msg="Migration successfully executed" id="recreate alert_definition table" duration=779.201µs 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.251655722Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.25228304Z level=info msg="Migration successfully executed" id="add index in alert_definition on org_id and title columns" duration=625.548µs 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.252662852Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.253290721Z level=info msg="Migration successfully executed" id="add index in alert_definition on org_id and uid columns" duration=627.665µs 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.253630827Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-09-21T13:40:04.352 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.253667735Z level=info msg="Migration successfully executed" id="alter alert_definition table data column to mediumtext in mysql" duration=37.177µs 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.254061174Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.25464214Z level=info msg="Migration successfully executed" id="drop index in alert_definition on org_id and title columns" duration=581.187µs 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.25499355Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.255573585Z level=info msg="Migration successfully executed" id="drop index in alert_definition on org_id and uid columns" duration=579.7µs 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.255928754Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.256556379Z level=info msg="Migration successfully executed" id="add unique index in alert_definition on org_id and title columns" duration=627.267µs 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.256920112Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.257543169Z level=info msg="Migration successfully executed" id="add unique index in alert_definition on org_id and uid columns" duration=622.913µs 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.257884602Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.261180865Z level=info msg="Migration successfully executed" id="Add column paused in alert_definition" duration=3.294892ms 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.261526012Z level=info msg="Executing migration" id="drop alert_definition table" 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.262211694Z level=info msg="Migration successfully executed" id="drop alert_definition table" duration=685.388µs 2024-09-21T13:40:04.353 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.264259641Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.264339135Z level=info msg="Migration successfully executed" id="delete alert_definition_version table" duration=79.566µs 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.267150502Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.267713762Z level=info msg="Migration successfully executed" id="recreate alert_definition_version table" duration=563.128µs 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.268071465Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.268690799Z level=info msg="Migration successfully executed" id="add index in alert_definition_version table on alert_definition_id and version columns" duration=619.084µs 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.271053608Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.271679802Z level=info msg="Migration successfully executed" id="add index in alert_definition_version table on alert_definition_uid and version columns" duration=626.431µs 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.273868184Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.274008874Z level=info msg="Migration successfully executed" id="alter alert_definition_version table data column to mediumtext in mysql" duration=125.464µs 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.276532174Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.277185171Z level=info msg="Migration successfully executed" id="drop alert_definition_version table" duration=653.106µs 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.277553467Z level=info msg="Executing migration" id="create alert_instance table" 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.27820409Z level=info msg="Migration successfully executed" id="create alert_instance table" duration=650.238µs 2024-09-21T13:40:04.354 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.28048843Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-09-21T13:40:04.355 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.281138276Z level=info msg="Migration successfully executed" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" duration=649.985µs 2024-09-21T13:40:04.355 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.283218654Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-09-21T13:40:04.355 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.28384083Z level=info msg="Migration successfully executed" id="add index in alert_instance table on def_org_id, current_state columns" duration=622.098µs 2024-09-21T13:40:04.355 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.28592741Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-09-21T13:40:04.355 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.289318202Z level=info msg="Migration successfully executed" id="add column current_state_end to alert_instance" duration=3.390642ms 2024-09-21T13:40:04.355 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.289661355Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-09-21T13:40:04.355 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.290247197Z level=info msg="Migration successfully executed" id="remove index def_org_id, def_uid, current_state on alert_instance" duration=585.601µs 2024-09-21T13:40:04.355 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.292838469Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.293431811Z level=info msg="Migration successfully executed" id="remove index def_org_id, current_state on alert_instance" duration=593.194µs 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.295619727Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.313324429Z level=info msg="Migration successfully executed" id="rename def_org_id to rule_org_id in alert_instance" duration=17.7066ms 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.31371287Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.330011379Z level=info msg="Migration successfully executed" id="rename def_uid to rule_uid in alert_instance" duration=16.298138ms 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.330365409Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.33096367Z level=info msg="Migration successfully executed" id="add index rule_org_id, rule_uid, current_state on alert_instance" duration=597.866µs 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.333305514Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.333902702Z level=info msg="Migration successfully executed" id="add index rule_org_id, current_state on alert_instance" duration=596.857µs 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.336106069Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.339507904Z level=info msg="Migration successfully executed" id="add current_reason column related to current_state" duration=3.401296ms 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.339858271Z level=info msg="Executing migration" id="add result_fingerprint column to alert_instance" 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.343245869Z level=info msg="Migration successfully executed" id="add result_fingerprint column to alert_instance" duration=3.387278ms 2024-09-21T13:40:04.356 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.34361821Z level=info msg="Executing migration" id="create alert_rule table" 2024-09-21T13:40:04.357 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.344241571Z level=info msg="Migration successfully executed" id="create alert_rule table" duration=623.637µs 2024-09-21T13:40:04.586 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.346364445Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-09-21T13:40:04.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.346992959Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id and title columns" duration=626.753µs 2024-09-21T13:40:04.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.349092945Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-09-21T13:40:04.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.349710952Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id and uid columns" duration=617.763µs 2024-09-21T13:40:04.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.351827683Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-09-21T13:40:04.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.352512342Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" duration=684.246µs 2024-09-21T13:40:04.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.352871619Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-09-21T13:40:04.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.352909596Z level=info msg="Migration successfully executed" id="alter alert_rule table data column to mediumtext in mysql" duration=40.293µs 2024-09-21T13:40:04.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.355499473Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-09-21T13:40:04.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.358915992Z level=info msg="Migration successfully executed" id="add column for to alert_rule" duration=3.416172ms 2024-09-21T13:40:04.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.359289166Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-09-21T13:40:04.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.362627132Z level=info msg="Migration successfully executed" id="add column annotations to alert_rule" duration=3.337945ms 2024-09-21T13:40:04.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.363019912Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-09-21T13:40:04.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.366362832Z level=info msg="Migration successfully executed" id="add column labels to alert_rule" duration=3.342499ms 2024-09-21T13:40:04.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.366720657Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-09-21T13:40:04.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.367315464Z level=info msg="Migration successfully executed" id="remove unique index from alert_rule on org_id, title columns" duration=594.589µs 2024-09-21T13:40:04.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.369558742Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.370245282Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, namespase_uid and title columns" duration=689.641µs 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.372236058Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.375572884Z level=info msg="Migration successfully executed" id="add dashboard_uid column to alert_rule" duration=3.338698ms 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.375945422Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.379278813Z level=info msg="Migration successfully executed" id="add panel_id column to alert_rule" duration=3.333128ms 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.379650055Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.380295115Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" duration=645.419µs 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.382424846Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.385781314Z level=info msg="Migration successfully executed" id="add rule_group_idx column to alert_rule" duration=3.356094ms 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.386155486Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.3895005Z level=info msg="Migration successfully executed" id="add is_paused column to alert_rule table" duration=3.344816ms 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.38987025Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-09-21T13:40:04.589 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.389907865Z level=info msg="Migration successfully executed" id="fix is_paused column for alert_rule table" duration=37.973µs 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.390403339Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.391170007Z level=info msg="Migration successfully executed" id="create alert_rule_version table" duration=766.849µs 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.391563815Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.392284417Z level=info msg="Migration successfully executed" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" duration=720.88µs 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.39264314Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.393356593Z level=info msg="Migration successfully executed" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" duration=713.128µs 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.393726344Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.393764034Z level=info msg="Migration successfully executed" id="alter alert_rule_version table data column to mediumtext in mysql" duration=38.999µs 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.394174889Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.397760067Z level=info msg="Migration successfully executed" id="add column for to alert_rule_version" duration=3.584218ms 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.398126471Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-09-21T13:40:04.590 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.401669051Z level=info msg="Migration successfully executed" id="add column annotations to alert_rule_version" duration=3.542868ms 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.402104869Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.405616032Z level=info msg="Migration successfully executed" id="add column labels to alert_rule_version" duration=3.511566ms 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.406030454Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.409552777Z level=info msg="Migration successfully executed" id="add rule_group_idx column to alert_rule_version" duration=3.522573ms 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.409920079Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.413426154Z level=info msg="Migration successfully executed" id="add is_paused column to alert_rule_versions table" duration=3.506318ms 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.413785449Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.413827361Z level=info msg="Migration successfully executed" id="fix is_paused column for alert_rule_version table" duration=42.793µs 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.414645515Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.415165Z level=info msg="Migration successfully executed" id=create_alert_configuration_table duration=519.063µs 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.415547438Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-09-21T13:40:04.591 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.419139161Z level=info msg="Migration successfully executed" id="Add column default in alert_configuration" duration=3.591407ms 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.419512637Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.419549589Z level=info msg="Migration successfully executed" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" duration=37.239µs 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.420529409Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.42434238Z level=info msg="Migration successfully executed" id="add column org_id in alert_configuration" duration=3.815988ms 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.424701605Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.425356189Z level=info msg="Migration successfully executed" id="add index in alert_configuration table on org_id column" duration=654.876µs 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.425712646Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.429335517Z level=info msg="Migration successfully executed" id="add configuration_hash column to alert_configuration" duration=3.622615ms 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.429697696Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.430204602Z level=info msg="Migration successfully executed" id=create_ngalert_configuration_table duration=506.817µs 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.430579255Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.431197222Z level=info msg="Migration successfully executed" id="add index in ngalert_configuration on org_id column" duration=619.487µs 2024-09-21T13:40:04.592 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.431548576Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-09-21T13:40:04.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.435176645Z level=info msg="Migration successfully executed" id="add column send_alerts_to in ngalert_configuration" duration=3.628469ms 2024-09-21T13:40:04.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.435534402Z level=info msg="Executing migration" id="create provenance_type table" 2024-09-21T13:40:04.593 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.436074928Z level=info msg="Migration successfully executed" id="create provenance_type table" duration=540.734µs 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.436439718Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.437075256Z level=info msg="Migration successfully executed" id="add index to uniquify (record_key, record_type, org_id) columns" duration=635.788µs 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.437428761Z level=info msg="Executing migration" id="create alert_image table" 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.437938284Z level=info msg="Migration successfully executed" id="create alert_image table" duration=509.44µs 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.438315046Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.438915643Z level=info msg="Migration successfully executed" id="add unique index on token to alert_image table" duration=600.47µs 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.43926699Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.43930977Z level=info msg="Migration successfully executed" id="support longer URLs in alert_image table" duration=42.567µs 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.439715734Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.440331466Z level=info msg="Migration successfully executed" id=create_alert_configuration_history_table duration=615.526µs 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.440703222Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-09-21T13:40:04.594 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.441327231Z level=info msg="Migration successfully executed" id="drop non-unique orgID index on alert_configuration" duration=623.973µs 2024-09-21T13:40:04.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.441674792Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-09-21T13:40:04.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.441905639Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-09-21T13:40:04.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.442525224Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-09-21T13:40:04.595 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.442827618Z level=info msg="Migration successfully executed" id="extract alertmanager configuration history to separate table" duration=302.902µs 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.443175944Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.443801144Z level=info msg="Migration successfully executed" id="add unique index on orgID to alert_configuration" duration=625.522µs 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.444159506Z level=info msg="Executing migration" id="add last_applied column to alert_configuration_history" 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.447909328Z level=info msg="Migration successfully executed" id="add last_applied column to alert_configuration_history" duration=3.749545ms 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.448289861Z level=info msg="Executing migration" id="create library_element table v1" 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.449005232Z level=info msg="Migration successfully executed" id="create library_element table v1" duration=715.097µs 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.449374722Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.450092821Z level=info msg="Migration successfully executed" id="add index library_element org_id-folder_id-name-kind" duration=716.303µs 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.450474994Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.451042304Z level=info msg="Migration successfully executed" id="create library_element_connection table v1" duration=566.869µs 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.45138944Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-09-21T13:40:04.596 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.452057777Z level=info msg="Migration successfully executed" id="add index library_element_connection element_id-kind-connection_id" duration=668.1µs 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.452410262Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.453038367Z level=info msg="Migration successfully executed" id="add unique index library_element org_id_uid" duration=628.005µs 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.455276114Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.455293118Z level=info msg="Migration successfully executed" id="increase max description length to 2048" duration=18.137µs 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.45569383Z level=info msg="Executing migration" id="alter library_element model to mediumtext" 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.455734095Z level=info msg="Migration successfully executed" id="alter library_element model to mediumtext" duration=41.137µs 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.458778148Z level=info msg="Executing migration" id="add library_element folder uid" 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.46302384Z level=info msg="Migration successfully executed" id="add library_element folder uid" duration=4.248357ms 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.463368218Z level=info msg="Executing migration" id="populate library_element folder_uid" 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.463608638Z level=info msg="Migration successfully executed" id="populate library_element folder_uid" duration=240.311µs 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.46620502Z level=info msg="Executing migration" id="add index library_element org_id-folder_uid-name-kind" 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.46691659Z level=info msg="Migration successfully executed" id="add index library_element org_id-folder_uid-name-kind" duration=711.232µs 2024-09-21T13:40:04.597 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.468895339Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-09-21T13:40:04.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.469100659Z level=info msg="Migration successfully executed" id="clone move dashboard alerts to unified alerting" duration=205.21µs 2024-09-21T13:40:04.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.471794076Z level=info msg="Executing migration" id="create data_keys table" 2024-09-21T13:40:04.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.472469675Z level=info msg="Migration successfully executed" id="create data_keys table" duration=675.753µs 2024-09-21T13:40:04.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.474597345Z level=info msg="Executing migration" id="create secrets table" 2024-09-21T13:40:04.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.475177709Z level=info msg="Migration successfully executed" id="create secrets table" duration=580.446µs 2024-09-21T13:40:04.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.477403354Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-09-21T13:40:04.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.499541669Z level=info msg="Migration successfully executed" id="rename data_keys name column to id" duration=22.138356ms 2024-09-21T13:40:04.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.49992521Z level=info msg="Executing migration" id="add name column into data_keys" 2024-09-21T13:40:04.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.504040509Z level=info msg="Migration successfully executed" id="add name column into data_keys" duration=4.116754ms 2024-09-21T13:40:04.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.504404279Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-09-21T13:40:04.598 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.504521902Z level=info msg="Migration successfully executed" id="copy data_keys id column values into name" duration=117.949µs 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.507303061Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.528403152Z level=info msg="Migration successfully executed" id="rename data_keys name column to label" duration=21.100099ms 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.528778646Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.549830084Z level=info msg="Migration successfully executed" id="rename data_keys id column back to name" duration=21.051551ms 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.550227449Z level=info msg="Executing migration" id="create kv_store table v1" 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.550779468Z level=info msg="Migration successfully executed" id="create kv_store table v1" duration=551.843µs 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.553012494Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.553713292Z level=info msg="Migration successfully executed" id="add index kv_store.org_id-namespace-key" duration=700.388µs 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.555794558Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.555974319Z level=info msg="Migration successfully executed" id="update dashboard_uid and panel_id from existing annotations" duration=181.34µs 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.558308879Z level=info msg="Executing migration" id="create permission table" 2024-09-21T13:40:04.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.558860935Z level=info msg="Migration successfully executed" id="create permission table" duration=552.402µs 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.559237956Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.559870135Z level=info msg="Migration successfully executed" id="add unique index permission.role_id" duration=632.434µs 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.562002678Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.562654755Z level=info msg="Migration successfully executed" id="add unique index role_id_action_scope" duration=650.926µs 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.564443851Z level=info msg="Executing migration" id="create role table" 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.565062537Z level=info msg="Migration successfully executed" id="create role table" duration=619.1µs 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.56723122Z level=info msg="Executing migration" id="add column display_name" 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.571704684Z level=info msg="Migration successfully executed" id="add column display_name" duration=4.473815ms 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.572075138Z level=info msg="Executing migration" id="add column group_name" 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.576555694Z level=info msg="Migration successfully executed" id="add column group_name" duration=4.480879ms 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.576942204Z level=info msg="Executing migration" id="add index role.org_id" 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.577609756Z level=info msg="Migration successfully executed" id="add index role.org_id" duration=667.34µs 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.5797322Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-09-21T13:40:04.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.580434091Z level=info msg="Migration successfully executed" id="add unique index role_org_id_name" duration=701.655µs 2024-09-21T13:40:04.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.582431532Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-09-21T13:40:04.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.58316364Z level=info msg="Migration successfully executed" id="add index role_org_id_uid" duration=747.992µs 2024-09-21T13:40:04.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.583513549Z level=info msg="Executing migration" id="create team role table" 2024-09-21T13:40:04.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.584132842Z level=info msg="Migration successfully executed" id="create team role table" duration=618.985µs 2024-09-21T13:40:04.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.586188614Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-09-21T13:40:04.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.586867627Z level=info msg="Migration successfully executed" id="add index team_role.org_id" duration=678.717µs 2024-09-21T13:40:04.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.588855302Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-09-21T13:40:04.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.589547488Z level=info msg="Migration successfully executed" id="add unique index team_role_org_id_team_id_role_id" duration=691.773µs 2024-09-21T13:40:04.601 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.591461101Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-09-21T13:40:04.754 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:04 smithi002 systemd[1]: Starting Ceph node-exporter.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:40:04.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-mon[33046]: pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:04.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:04.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:04.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:04.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:04.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.592135018Z level=info msg="Migration successfully executed" id="add index team_role.team_id" duration=674.226µs 2024-09-21T13:40:04.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.592501573Z level=info msg="Executing migration" id="create user role table" 2024-09-21T13:40:04.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.593069919Z level=info msg="Migration successfully executed" id="create user role table" duration=568.095µs 2024-09-21T13:40:04.856 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.595213154Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.59586566Z level=info msg="Migration successfully executed" id="add index user_role.org_id" duration=654.242µs 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.597778238Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.598487591Z level=info msg="Migration successfully executed" id="add unique index user_role_org_id_user_id_role_id" duration=709.014µs 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.600359618Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.601049162Z level=info msg="Migration successfully executed" id="add index user_role.user_id" duration=689.761µs 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.601401502Z level=info msg="Executing migration" id="create builtin role table" 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.601969475Z level=info msg="Migration successfully executed" id="create builtin role table" duration=568.639µs 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.604080917Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.604758286Z level=info msg="Migration successfully executed" id="add index builtin_role.role_id" duration=677.247µs 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.605095216Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.605760816Z level=info msg="Migration successfully executed" id="add index builtin_role.name" duration=665.909µs 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.60610681Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-09-21T13:40:04.857 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.610703575Z level=info msg="Migration successfully executed" id="Add column org_id to builtin_role table" duration=4.597101ms 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.61107943Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.611719331Z level=info msg="Migration successfully executed" id="add index builtin_role.org_id" duration=639.722µs 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.612099845Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.612758621Z level=info msg="Migration successfully executed" id="add unique index builtin_role_org_id_role_id_role" duration=659.057µs 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.613153161Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.613800654Z level=info msg="Migration successfully executed" id="Remove unique index role_org_id_uid" duration=647.788µs 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.614168616Z level=info msg="Executing migration" id="add unique index role.uid" 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.614807369Z level=info msg="Migration successfully executed" id="add unique index role.uid" duration=639.074µs 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.615190017Z level=info msg="Executing migration" id="create seed assignment table" 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.615680793Z level=info msg="Migration successfully executed" id="create seed assignment table" duration=491.107µs 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.616045523Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-09-21T13:40:04.858 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.61673405Z level=info msg="Migration successfully executed" id="add unique index builtin_role_role_name" duration=688.945µs 2024-09-21T13:40:04.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.617115383Z level=info msg="Executing migration" id="add column hidden to role table" 2024-09-21T13:40:04.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.62175073Z level=info msg="Migration successfully executed" id="add column hidden to role table" duration=4.634709ms 2024-09-21T13:40:04.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.622128342Z level=info msg="Executing migration" id="permission kind migration" 2024-09-21T13:40:04.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.626804273Z level=info msg="Migration successfully executed" id="permission kind migration" duration=4.675806ms 2024-09-21T13:40:04.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.627182951Z level=info msg="Executing migration" id="permission attribute migration" 2024-09-21T13:40:04.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.631785044Z level=info msg="Migration successfully executed" id="permission attribute migration" duration=4.601878ms 2024-09-21T13:40:04.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.632167447Z level=info msg="Executing migration" id="permission identifier migration" 2024-09-21T13:40:04.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.636662327Z level=info msg="Migration successfully executed" id="permission identifier migration" duration=4.494707ms 2024-09-21T13:40:04.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.637031132Z level=info msg="Executing migration" id="add permission identifier index" 2024-09-21T13:40:04.859 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.637706911Z level=info msg="Migration successfully executed" id="add permission identifier index" duration=675.667µs 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.638099072Z level=info msg="Executing migration" id="add permission action scope role_id index" 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.638762941Z level=info msg="Migration successfully executed" id="add permission action scope role_id index" duration=664.217µs 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.639140211Z level=info msg="Executing migration" id="remove permission role_id action scope index" 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.639783549Z level=info msg="Migration successfully executed" id="remove permission role_id action scope index" duration=643µs 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.640156776Z level=info msg="Executing migration" id="create query_history table v1" 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.640720126Z level=info msg="Migration successfully executed" id="create query_history table v1" duration=563.251µs 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.641111246Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.641772244Z level=info msg="Migration successfully executed" id="add index query_history.org_id-created_by-datasource_uid" duration=660.804µs 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.642156199Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.642199557Z level=info msg="Migration successfully executed" id="alter table query_history alter column created_by type to bigint" duration=44.128µs 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.642611927Z level=info msg="Executing migration" id="rbac disabled migrator" 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.642638101Z level=info msg="Migration successfully executed" id="rbac disabled migrator" duration=27.218µs 2024-09-21T13:40:04.860 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.64300343Z level=info msg="Executing migration" id="teams permissions migration" 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.643266855Z level=info msg="Migration successfully executed" id="teams permissions migration" duration=263.982µs 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.643670857Z level=info msg="Executing migration" id="dashboard permissions" 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.644010811Z level=info msg="Migration successfully executed" id="dashboard permissions" duration=340.528µs 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.644415833Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.644838934Z level=info msg="Migration successfully executed" id="dashboard permissions uid scopes" duration=422.412µs 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.645254458Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.645390647Z level=info msg="Migration successfully executed" id="drop managed folder create actions" duration=136.731µs 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.645779321Z level=info msg="Executing migration" id="alerting notification permissions" 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.646084296Z level=info msg="Migration successfully executed" id="alerting notification permissions" duration=305.568µs 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.646542137Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.647073628Z level=info msg="Migration successfully executed" id="create query_history_star table v1" duration=531.385µs 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.647430511Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-09-21T13:40:04.861 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.648156955Z level=info msg="Migration successfully executed" id="add index query_history.user_id-query_uid" duration=726.16µs 2024-09-21T13:40:04.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.648556968Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-09-21T13:40:04.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.653027376Z level=info msg="Migration successfully executed" id="add column org_id in query_history_star" duration=4.468749ms 2024-09-21T13:40:04.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.653410668Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-09-21T13:40:04.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.653447855Z level=info msg="Migration successfully executed" id="alter table query_history_star_mig column user_id type to bigint" duration=37.471µs 2024-09-21T13:40:04.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.653850199Z level=info msg="Executing migration" id="create correlation table v1" 2024-09-21T13:40:04.862 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.654492964Z level=info msg="Migration successfully executed" id="create correlation table v1" duration=643.138µs 2024-09-21T13:40:04.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.654847025Z level=info msg="Executing migration" id="add index correlations.uid" 2024-09-21T13:40:04.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.65556735Z level=info msg="Migration successfully executed" id="add index correlations.uid" duration=722.833µs 2024-09-21T13:40:04.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.655936897Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-09-21T13:40:04.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.656611329Z level=info msg="Migration successfully executed" id="add index correlations.source_uid" duration=674.313µs 2024-09-21T13:40:04.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.656966906Z level=info msg="Executing migration" id="add correlation config column" 2024-09-21T13:40:04.863 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.661674709Z level=info msg="Migration successfully executed" id="add correlation config column" duration=4.707781ms 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.662027705Z level=info msg="Executing migration" id="drop index IDX_correlation_uid - v1" 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.6626838Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_uid - v1" duration=657.938µs 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.663053832Z level=info msg="Executing migration" id="drop index IDX_correlation_source_uid - v1" 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.663698366Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_source_uid - v1" duration=644.443µs 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.664055349Z level=info msg="Executing migration" id="Rename table correlation to correlation_tmp_qwerty - v1" 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.681113398Z level=info msg="Migration successfully executed" id="Rename table correlation to correlation_tmp_qwerty - v1" duration=17.057748ms 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.681464017Z level=info msg="Executing migration" id="create correlation v2" 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.68221727Z level=info msg="Migration successfully executed" id="create correlation v2" duration=753.546µs 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.68258222Z level=info msg="Executing migration" id="create index IDX_correlation_uid - v2" 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.68328265Z level=info msg="Migration successfully executed" id="create index IDX_correlation_uid - v2" duration=700.815µs 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.683630517Z level=info msg="Executing migration" id="create index IDX_correlation_source_uid - v2" 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.684306343Z level=info msg="Migration successfully executed" id="create index IDX_correlation_source_uid - v2" duration=675.66µs 2024-09-21T13:40:04.864 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.684650789Z level=info msg="Executing migration" id="create index IDX_correlation_org_id - v2" 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.685332517Z level=info msg="Migration successfully executed" id="create index IDX_correlation_org_id - v2" duration=681.594µs 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.685682446Z level=info msg="Executing migration" id="copy correlation v1 to v2" 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.685843407Z level=info msg="Migration successfully executed" id="copy correlation v1 to v2" duration=160.991µs 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.686455554Z level=info msg="Executing migration" id="drop correlation_tmp_qwerty" 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.687105393Z level=info msg="Migration successfully executed" id="drop correlation_tmp_qwerty" duration=650.197µs 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.687450253Z level=info msg="Executing migration" id="add provisioning column" 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.692227106Z level=info msg="Migration successfully executed" id="add provisioning column" duration=4.777187ms 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.692574446Z level=info msg="Executing migration" id="create entity_events table" 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.693097528Z level=info msg="Migration successfully executed" id="create entity_events table" duration=522.804µs 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.693463818Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.694122166Z level=info msg="Migration successfully executed" id="create dashboard public config v1" duration=658.11µs 2024-09-21T13:40:04.865 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.694479842Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.694747396Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.695292601Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.695554569Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.695938553Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.696493885Z level=info msg="Migration successfully executed" id="Drop old dashboard public config table" duration=555.755µs 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.696852301Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.69750796Z level=info msg="Migration successfully executed" id="recreate dashboard public config v1" duration=655.449µs 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.697863602Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.698536268Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_uid - v1" duration=672.61µs 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.698897046Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.699577815Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" duration=680.621µs 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.699936708Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-09-21T13:40:04.866 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.700594795Z level=info msg="Migration successfully executed" id="drop index UQE_dashboard_public_config_uid - v2" duration=659.065µs 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.700953621Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.701591677Z level=info msg="Migration successfully executed" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" duration=644.876µs 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.701965384Z level=info msg="Executing migration" id="Drop public config table" 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.702500554Z level=info msg="Migration successfully executed" id="Drop public config table" duration=535.597µs 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.702843432Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.703595144Z level=info msg="Migration successfully executed" id="Recreate dashboard public config v2" duration=751.302µs 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.703934232Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.704632619Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_uid - v2" duration=697.917µs 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.704974005Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.705660533Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" duration=684.678µs 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.706005028Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.706674705Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_access_token - v2" duration=669.746µs 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.70702624Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.72187172Z level=info msg="Migration successfully executed" id="Rename table dashboard_public_config to dashboard_public - v2" duration=14.845329ms 2024-09-21T13:40:04.867 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.722237423Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.727485375Z level=info msg="Migration successfully executed" id="add annotations_enabled column" duration=5.247758ms 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.727863771Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.733155932Z level=info msg="Migration successfully executed" id="add time_selection_enabled column" duration=5.291532ms 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.733521886Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.733672853Z level=info msg="Migration successfully executed" id="delete orphaned public dashboards" duration=152.215µs 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.734513559Z level=info msg="Executing migration" id="add share column" 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.739733325Z level=info msg="Migration successfully executed" id="add share column" duration=5.223173ms 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.740095325Z level=info msg="Executing migration" id="backfill empty share column fields with default of public" 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.740231577Z level=info msg="Migration successfully executed" id="backfill empty share column fields with default of public" duration=136.848µs 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.74273345Z level=info msg="Executing migration" id="create file table" 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.743406479Z level=info msg="Migration successfully executed" id="create file table" duration=672.685µs 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.745651742Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.746400147Z level=info msg="Migration successfully executed" id="file table idx: path natural pk" duration=750.39µs 2024-09-21T13:40:04.868 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.74676607Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.747520463Z level=info msg="Migration successfully executed" id="file table idx: parent_folder_path_hash fast folder retrieval" duration=754.651µs 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.749532159Z level=info msg="Executing migration" id="create file_meta table" 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.750262991Z level=info msg="Migration successfully executed" id="create file_meta table" duration=732.674µs 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.752114157Z level=info msg="Executing migration" id="file table idx: path key" 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.752868214Z level=info msg="Migration successfully executed" id="file table idx: path key" duration=754.064µs 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.754810047Z level=info msg="Executing migration" id="set path collation in file table" 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.754854169Z level=info msg="Migration successfully executed" id="set path collation in file table" duration=44.409µs 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.75529373Z level=info msg="Executing migration" id="migrate contents column to mediumblob for MySQL" 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.755336628Z level=info msg="Migration successfully executed" id="migrate contents column to mediumblob for MySQL" duration=43.796µs 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.758050639Z level=info msg="Executing migration" id="managed permissions migration" 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.758384208Z level=info msg="Migration successfully executed" id="managed permissions migration" duration=333.412µs 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.760694706Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-09-21T13:40:04.869 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.760833963Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions migration" duration=139.009µs 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.763534522Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.764420955Z level=info msg="Migration successfully executed" id="RBAC action name migrator" duration=886.802µs 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.766328083Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.771609801Z level=info msg="Migration successfully executed" id="Add UID column to playlist" duration=5.28247ms 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.771988053Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.772094748Z level=info msg="Migration successfully executed" id="Update uid column values in playlist" duration=106.808µs 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.774701252Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.775469396Z level=info msg="Migration successfully executed" id="Add index for uid in playlist" duration=771.121µs 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.777226672Z level=info msg="Executing migration" id="update group index for alert rules" 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.777471646Z level=info msg="Migration successfully executed" id="update group index for alert rules" duration=244.911µs 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.777878049Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.778014949Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions repeated migration" duration=136.92µs 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.780676969Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.780976161Z level=info msg="Migration successfully executed" id="admin only folder/dashboard permission" duration=299.059µs 2024-09-21T13:40:04.870 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.783459737Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-09-21T13:40:04.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.788464911Z level=info msg="Migration successfully executed" id="add action column to seed_assignment" duration=5.006928ms 2024-09-21T13:40:04.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.788825182Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-09-21T13:40:04.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.794315121Z level=info msg="Migration successfully executed" id="add scope column to seed_assignment" duration=5.491766ms 2024-09-21T13:40:04.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.794670505Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-09-21T13:40:04.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.795349404Z level=info msg="Migration successfully executed" id="remove unique index builtin_role_role_name before nullable update" duration=678.774µs 2024-09-21T13:40:04.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.797526619Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-09-21T13:40:04.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.854835133Z level=info msg="Migration successfully executed" id="update seed_assignment role_name column to nullable" duration=57.307274ms 2024-09-21T13:40:04.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.855411635Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-09-21T13:40:04.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.856168357Z level=info msg="Migration successfully executed" id="add unique index builtin_role_name back" duration=756.785µs 2024-09-21T13:40:04.872 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.858032273Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-09-21T13:40:04.872 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.858772378Z level=info msg="Migration successfully executed" id="add unique index builtin_role_action_scope" duration=742.252µs 2024-09-21T13:40:04.872 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.85914868Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-09-21T13:40:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:04 smithi002 ceph-mon[30076]: pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:04 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:04 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:04 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:04 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:04 smithi002 ceph-mon[40622]: pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:04 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:04 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:04 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:04 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:05.102 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:04 smithi002 bash[74779]: Trying to pull quay.io/prometheus/node-exporter:v1.7.0... 2024-09-21T13:40:05.139 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.876831206Z level=info msg="Migration successfully executed" id="add primary key to seed_assigment" duration=17.682192ms 2024-09-21T13:40:05.139 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.877277909Z level=info msg="Executing migration" id="add origin column to seed_assignment" 2024-09-21T13:40:05.139 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.882370322Z level=info msg="Migration successfully executed" id="add origin column to seed_assignment" duration=5.09228ms 2024-09-21T13:40:05.139 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.882746274Z level=info msg="Executing migration" id="add origin to plugin seed_assignment" 2024-09-21T13:40:05.139 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.882935955Z level=info msg="Migration successfully executed" id="add origin to plugin seed_assignment" duration=189.746µs 2024-09-21T13:40:05.139 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.885349486Z level=info msg="Executing migration" id="prevent seeding OnCall access" 2024-09-21T13:40:05.139 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.885488423Z level=info msg="Migration successfully executed" id="prevent seeding OnCall access" duration=138.778µs 2024-09-21T13:40:05.139 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.888226904Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-09-21T13:40:05.139 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.888403212Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions repeated fixed migration" duration=179.311µs 2024-09-21T13:40:05.140 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.890844072Z level=info msg="Executing migration" id="managed folder permissions library panel actions migration" 2024-09-21T13:40:05.140 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.890988695Z level=info msg="Migration successfully executed" id="managed folder permissions library panel actions migration" duration=146.243µs 2024-09-21T13:40:05.140 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.893512642Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-09-21T13:40:05.140 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.893647749Z level=info msg="Migration successfully executed" id="migrate external alertmanagers to datsourcse" duration=138.234µs 2024-09-21T13:40:05.140 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.896059386Z level=info msg="Executing migration" id="create folder table" 2024-09-21T13:40:05.140 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.89676257Z level=info msg="Migration successfully executed" id="create folder table" duration=703.067µs 2024-09-21T13:40:05.140 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.897147979Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-09-21T13:40:05.140 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.897867584Z level=info msg="Migration successfully executed" id="Add index for parent_uid" duration=719.373µs 2024-09-21T13:40:05.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.898228326Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-09-21T13:40:05.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.89894199Z level=info msg="Migration successfully executed" id="Add unique index for folder.uid and folder.org_id" duration=715.219µs 2024-09-21T13:40:05.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.900795871Z level=info msg="Executing migration" id="Update folder title length" 2024-09-21T13:40:05.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.90084601Z level=info msg="Migration successfully executed" id="Update folder title length" duration=53.346µs 2024-09-21T13:40:05.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.903280173Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-09-21T13:40:05.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.904053977Z level=info msg="Migration successfully executed" id="Add unique index for folder.title and folder.parent_uid" duration=774.013µs 2024-09-21T13:40:05.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.904430961Z level=info msg="Executing migration" id="Remove unique index for folder.title and folder.parent_uid" 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.905196368Z level=info msg="Migration successfully executed" id="Remove unique index for folder.title and folder.parent_uid" duration=764.544µs 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.907027993Z level=info msg="Executing migration" id="Add unique index for title, parent_uid, and org_id" 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.907750496Z level=info msg="Migration successfully executed" id="Add unique index for title, parent_uid, and org_id" duration=722.344µs 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.90812938Z level=info msg="Executing migration" id="Sync dashboard and folder table" 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.908438133Z level=info msg="Migration successfully executed" id="Sync dashboard and folder table" duration=308.69µs 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.908906767Z level=info msg="Executing migration" id="Remove ghost folders from the folder table" 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.909097058Z level=info msg="Migration successfully executed" id="Remove ghost folders from the folder table" duration=189.71µs 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.909493704Z level=info msg="Executing migration" id="Remove unique index UQE_folder_uid_org_id" 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.910152989Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_uid_org_id" duration=659.052µs 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.910492228Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_uid" 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.911178519Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_uid" duration=683.43µs 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.911511425Z level=info msg="Executing migration" id="Remove unique index UQE_folder_title_parent_uid_org_id" 2024-09-21T13:40:05.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.912180941Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_title_parent_uid_org_id" duration=667.556µs 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.912516393Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_parent_uid_title" 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.9132074Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_parent_uid_title" duration=690.597µs 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.913540405Z level=info msg="Executing migration" id="Remove index IDX_folder_parent_uid_org_id" 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.914193594Z level=info msg="Migration successfully executed" id="Remove index IDX_folder_parent_uid_org_id" duration=653.01µs 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.914530532Z level=info msg="Executing migration" id="create anon_device table" 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.91509099Z level=info msg="Migration successfully executed" id="create anon_device table" duration=560.298µs 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.915427084Z level=info msg="Executing migration" id="add unique index anon_device.device_id" 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.916159018Z level=info msg="Migration successfully executed" id="add unique index anon_device.device_id" duration=731.457µs 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.916512879Z level=info msg="Executing migration" id="add index anon_device.updated_at" 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.917185001Z level=info msg="Migration successfully executed" id="add index anon_device.updated_at" duration=671.829µs 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.91752988Z level=info msg="Executing migration" id="create signing_key table" 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.918090832Z level=info msg="Migration successfully executed" id="create signing_key table" duration=560.611µs 2024-09-21T13:40:05.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.918433197Z level=info msg="Executing migration" id="add unique index signing_key.key_id" 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.91910951Z level=info msg="Migration successfully executed" id="add unique index signing_key.key_id" duration=675.927µs 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.919447716Z level=info msg="Executing migration" id="set legacy alert migration status in kvstore" 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.920142371Z level=info msg="Migration successfully executed" id="set legacy alert migration status in kvstore" duration=694.543µs 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.92046438Z level=info msg="Executing migration" id="migrate record of created folders during legacy migration to kvstore" 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.920629815Z level=info msg="Migration successfully executed" id="migrate record of created folders during legacy migration to kvstore" duration=165.393µs 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.921010556Z level=info msg="Executing migration" id="Add folder_uid for dashboard" 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.926961761Z level=info msg="Migration successfully executed" id="Add folder_uid for dashboard" duration=5.950697ms 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.927309576Z level=info msg="Executing migration" id="Populate dashboard folder_uid column" 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.927760009Z level=info msg="Migration successfully executed" id="Populate dashboard folder_uid column" duration=450.91µs 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.928170575Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title" 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.928181381Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title" duration=13.089µs 2024-09-21T13:40:05.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.9289563Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_id_title" 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.929618485Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_id_title" duration=662.22µs 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.929963409Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_uid_title" 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.929973976Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_uid_title" duration=11.267µs 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.930732763Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.931538185Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" duration=805.671µs 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.931892922Z level=info msg="Executing migration" id="Restore index for dashboard_org_id_folder_id_title" 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.93259449Z level=info msg="Migration successfully executed" id="Restore index for dashboard_org_id_folder_id_title" duration=701.147µs 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.932953981Z level=info msg="Executing migration" id="create sso_setting table" 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.933604903Z level=info msg="Migration successfully executed" id="create sso_setting table" duration=657.378µs 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.933961545Z level=info msg="Executing migration" id="copy kvstore migration status to each org" 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.934421347Z level=info msg="Migration successfully executed" id="copy kvstore migration status to each org" duration=460.321µs 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.934753161Z level=info msg="Executing migration" id="add back entry for orgid=0 migrated status" 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.934907212Z level=info msg="Migration successfully executed" id="add back entry for orgid=0 migrated status" duration=154.538µs 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.935540289Z level=info msg="Executing migration" id="alter kv_store.value to longtext" 2024-09-21T13:40:05.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.935577791Z level=info msg="Migration successfully executed" id="alter kv_store.value to longtext" duration=37.747µs 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.936324356Z level=info msg="Executing migration" id="add notification_settings column to alert_rule table" 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.941938422Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule table" duration=5.614384ms 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.942289602Z level=info msg="Executing migration" id="add notification_settings column to alert_rule_version table" 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.948085137Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule_version table" duration=5.794965ms 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.948431808Z level=info msg="Executing migration" id="removing scope from alert.instances:read action migration" 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.948639854Z level=info msg="Migration successfully executed" id="removing scope from alert.instances:read action migration" duration=209.889µs 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=migrator t=2024-09-21T13:40:04.951037711Z level=info msg="migrations completed" performed=551 skipped=0 duration=1.243054747s 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=sqlstore t=2024-09-21T13:40:04.951898355Z level=info msg="Created default organization" 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=secrets t=2024-09-21T13:40:04.954178465Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:04 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=plugin.store t=2024-09-21T13:40:04.970048352Z level=info msg="Loading plugins..." 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=local.finder t=2024-09-21T13:40:05.012545426Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=plugin.store t=2024-09-21T13:40:05.01256354Z level=info msg="Plugins loaded" count=55 duration=42.517364ms 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=query_data t=2024-09-21T13:40:05.014576237Z level=info msg="Query Service initialization" 2024-09-21T13:40:05.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=live.push_http t=2024-09-21T13:40:05.016808272Z level=info msg="Live Push Gateway initialization" 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ngalert.migration t=2024-09-21T13:40:05.017783326Z level=info msg=Starting 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ngalert.migration t=2024-09-21T13:40:05.018061591Z level=info msg="Applying transition" currentType=Legacy desiredType=UnifiedAlerting cleanOnDowngrade=false cleanOnUpgrade=false 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ngalert.migration orgID=1 t=2024-09-21T13:40:05.018323267Z level=info msg="Migrating alerts for organisation" 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ngalert.migration orgID=1 t=2024-09-21T13:40:05.018739423Z level=info msg="Alerts found to migrate" alerts=0 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ngalert.migration t=2024-09-21T13:40:05.019831018Z level=info msg="Completed alerting migration" 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ngalert.state.manager t=2024-09-21T13:40:05.032827768Z level=info msg="Running in alternative execution of Error/NoData mode" 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=infra.usagestats.collector t=2024-09-21T13:40:05.034199438Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=provisioning.datasources t=2024-09-21T13:40:05.035767366Z level=info msg="inserting datasource from configuration" name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=provisioning.datasources t=2024-09-21T13:40:05.049579629Z level=info msg="inserting datasource from configuration" name=Loki uid=P8E80F9AEF21F6940 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=provisioning.alerting t=2024-09-21T13:40:05.062887212Z level=info msg="starting to provision alerting" 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=provisioning.alerting t=2024-09-21T13:40:05.062898274Z level=info msg="finished to provision alerting" 2024-09-21T13:40:05.147 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=grafanaStorageLogger t=2024-09-21T13:40:05.063088801Z level=info msg="Storage starting" 2024-09-21T13:40:05.148 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=provisioning.dashboard t=2024-09-21T13:40:05.064044763Z level=info msg="starting to provision dashboards" 2024-09-21T13:40:05.148 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ngalert.state.manager t=2024-09-21T13:40:05.064591786Z level=info msg="Warming state cache for startup" 2024-09-21T13:40:05.148 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=http.server t=2024-09-21T13:40:05.065637914Z level=info msg="HTTP Server TLS settings" MinTLSVersion=TLS1.2 configuredciphers=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA,TLS_RSA_WITH_AES_128_GCM_SHA256,TLS_RSA_WITH_AES_256_GCM_SHA384,TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_256_CBC_SHA 2024-09-21T13:40:05.148 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=http.server t=2024-09-21T13:40:05.065995433Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-09-21T13:40:05.148 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ngalert.multiorg.alertmanager t=2024-09-21T13:40:05.066319752Z level=info msg="Starting MultiOrg Alertmanager" 2024-09-21T13:40:05.148 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ngalert.state.manager t=2024-09-21T13:40:05.083091023Z level=info msg="State cache has been initialized" states=0 duration=18.49715ms 2024-09-21T13:40:05.148 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ngalert.scheduler t=2024-09-21T13:40:05.083113612Z level=info msg="Starting scheduler" tickInterval=10s maxAttempts=1 2024-09-21T13:40:05.148 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ticker t=2024-09-21T13:40:05.083148377Z level=info msg=starting first_tick=2024-09-21T13:40:10Z 2024-09-21T13:40:05.148 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=grafana.update.checker t=2024-09-21T13:40:05.13866221Z level=info msg="Update check succeeded" duration=75.628258ms 2024-09-21T13:40:05.483 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=plugins.update.checker t=2024-09-21T13:40:05.148374542Z level=info msg="Update check succeeded" duration=84.718572ms 2024-09-21T13:40:05.483 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=provisioning.dashboard t=2024-09-21T13:40:05.244826516Z level=info msg="finished to provision dashboards" 2024-09-21T13:40:05.483 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=grafana-apiserver t=2024-09-21T13:40:05.343017899Z level=info msg="Adding GroupVersion playlist.grafana.app v0alpha1 to ResourceManager" 2024-09-21T13:40:05.483 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=grafana-apiserver t=2024-09-21T13:40:05.343584092Z level=info msg="Adding GroupVersion featuretoggle.grafana.app v0alpha1 to ResourceManager" 2024-09-21T13:40:05.600 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:05 smithi002 bash[74779]: Getting image source signatures 2024-09-21T13:40:05.600 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:05 smithi002 bash[74779]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-09-21T13:40:05.600 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:05 smithi002 bash[74779]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2024-09-21T13:40:05.600 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:05 smithi002 bash[74779]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2024-09-21T13:40:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:05 smithi002 ceph-mon[30076]: Deploying daemon node-exporter.a on smithi002 2024-09-21T13:40:06.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:05 smithi002 ceph-mon[40622]: Deploying daemon node-exporter.a on smithi002 2024-09-21T13:40:06.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:05 smithi162 ceph-mon[33046]: Deploying daemon node-exporter.a on smithi002 2024-09-21T13:40:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:06 smithi002 ceph-mon[30076]: pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:06 smithi002 ceph-mon[40622]: pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:07.100 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:06 smithi002 bash[74779]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-09-21T13:40:07.101 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:06 smithi002 bash[74779]: Writing manifest to image destination 2024-09-21T13:40:07.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:06 smithi162 ceph-mon[33046]: pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:07.524 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 podman[74779]: 2024-09-21 13:40:07.172627647 +0000 UTC m=+2.514102054 image pull 72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e quay.io/prometheus/node-exporter:v1.7.0 2024-09-21T13:40:07.524 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 podman[74779]: 2024-09-21 13:40:07.287619065 +0000 UTC m=+2.629093464 container create 533e8164e573b5badd9c18d9b64b59d6caf0cfa2beb292afa2f375775ef243a0 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:07.524 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 podman[74779]: 2024-09-21 13:40:07.523783107 +0000 UTC m=+2.865257506 container init 533e8164e573b5badd9c18d9b64b59d6caf0cfa2beb292afa2f375775ef243a0 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:07.841 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 podman[74779]: 2024-09-21 13:40:07.529285923 +0000 UTC m=+2.870760321 container start 533e8164e573b5badd9c18d9b64b59d6caf0cfa2beb292afa2f375775ef243a0 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:07.842 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.532Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-09-21T13:40:07.842 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.532Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-09-21T13:40:07.842 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.533Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-21T13:40:07.842 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.533Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-21T13:40:07.842 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.533Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-21T13:40:07.842 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.533Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-21T13:40:07.842 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-21T13:40:07.842 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=arp 2024-09-21T13:40:07.842 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-21T13:40:07.842 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-21T13:40:07.842 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-21T13:40:07.843 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-21T13:40:07.843 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-21T13:40:07.843 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-21T13:40:07.843 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-21T13:40:07.843 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-21T13:40:07.843 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=edac 2024-09-21T13:40:07.843 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-21T13:40:07.843 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-21T13:40:07.844 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=os 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=stat 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=time 2024-09-21T13:40:07.845 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-21T13:40:07.846 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=uname 2024-09-21T13:40:07.846 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-21T13:40:07.846 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-21T13:40:07.846 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.534Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-21T13:40:07.846 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.535Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-09-21T13:40:07.846 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a[74853]: ts=2024-09-21T13:40:07.535Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-21T13:40:07.846 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 bash[74779]: 533e8164e573b5badd9c18d9b64b59d6caf0cfa2beb292afa2f375775ef243a0 2024-09-21T13:40:08.100 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:40:07 smithi002 systemd[1]: Started Ceph node-exporter.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:40:08.850 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:40:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:40:08.850 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:08 smithi162 ceph-mon[33046]: pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:08.850 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:08 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:08.850 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:08 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:08.850 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:08 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:08.851 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:08 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:08 smithi002 ceph-mon[30076]: pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:08 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:08 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:08 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:08 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:09.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:08 smithi002 ceph-mon[40622]: pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:08 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:08 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:08 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:08 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:09.219 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:08 smithi162 bash[63739]: Trying to pull quay.io/prometheus/node-exporter:v1.7.0... 2024-09-21T13:40:09.219 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:09 smithi162 bash[63739]: Getting image source signatures 2024-09-21T13:40:09.220 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:09 smithi162 bash[63739]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-09-21T13:40:09.483 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:09 smithi162 bash[63739]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2024-09-21T13:40:09.483 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:09 smithi162 bash[63739]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2024-09-21T13:40:10.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:09 smithi002 ceph-mon[40622]: Deploying daemon node-exporter.b on smithi162 2024-09-21T13:40:10.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:09 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:09 smithi002 ceph-mon[30076]: Deploying daemon node-exporter.b on smithi162 2024-09-21T13:40:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:09 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:10.101 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:40:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:40:10.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:09 smithi162 ceph-mon[33046]: Deploying daemon node-exporter.b on smithi162 2024-09-21T13:40:10.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:09 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:11.026 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:10 smithi162 ceph-mon[33046]: pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:11.026 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:10 smithi162 bash[63739]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-09-21T13:40:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:10 smithi002 ceph-mon[30076]: pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:10 smithi002 ceph-mon[40622]: pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:11.283 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 bash[63739]: Writing manifest to image destination 2024-09-21T13:40:11.657 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 podman[63739]: 2024-09-21 13:40:11.273153024 +0000 UTC m=+2.515297406 image pull 72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e quay.io/prometheus/node-exporter:v1.7.0 2024-09-21T13:40:11.657 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 podman[63739]: 2024-09-21 13:40:11.405390422 +0000 UTC m=+2.647534803 container create 675cc8bbfb2cbc15ccc9b4c08affe8314540efc432c766bcebedfd03355a9e0e (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T13:40:11.657 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 podman[63739]: 2024-09-21 13:40:11.657305931 +0000 UTC m=+2.899450319 container init 675cc8bbfb2cbc15ccc9b4c08affe8314540efc432c766bcebedfd03355a9e0e (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T13:40:11.983 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 podman[63739]: 2024-09-21 13:40:11.662203557 +0000 UTC m=+2.904347948 container start 675cc8bbfb2cbc15ccc9b4c08affe8314540efc432c766bcebedfd03355a9e0e (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T13:40:11.983 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.665Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-09-21T13:40:11.983 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.665Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-09-21T13:40:11.983 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.666Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.666Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.666Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.666Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.666Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.666Z caller=node_exporter.go:117 level=info collector=arp 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.666Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-21T13:40:11.984 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-21T13:40:11.985 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=edac 2024-09-21T13:40:11.985 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-21T13:40:11.985 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-21T13:40:11.985 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-21T13:40:11.985 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-21T13:40:11.985 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-21T13:40:11.985 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-21T13:40:11.985 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-21T13:40:11.985 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-21T13:40:11.985 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=os 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-21T13:40:11.986 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=stat 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=time 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=uname 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-21T13:40:11.987 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-09-21T13:40:11.988 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b[63812]: ts=2024-09-21T13:40:11.667Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-21T13:40:11.988 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 bash[63739]: 675cc8bbfb2cbc15ccc9b4c08affe8314540efc432c766bcebedfd03355a9e0e 2024-09-21T13:40:11.988 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:40:11 smithi162 systemd[1]: Started Ceph node-exporter.b for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:40:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[30076]: pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:40:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[40622]: pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:12 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:40:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:12 smithi162 ceph-mon[33046]: pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:12 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:12 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:12 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:12 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:12 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:13.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:12 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:40:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:13 smithi162 ceph-mon[33046]: pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:13 smithi002 ceph-mon[30076]: pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:14.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:13 smithi002 ceph-mon[40622]: pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:16 smithi002 ceph-mon[30076]: pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:16 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:16 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:16.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:16 smithi002 ceph-mon[40622]: pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:16.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:16 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:16.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:16 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:16 smithi162 ceph-mon[33046]: pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:16 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:16 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:18.968 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[40622]: pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:18.968 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:18.968 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:18.968 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:40:18.968 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:40:18.969 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:18.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[30076]: pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:18.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:18.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:18.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:40:18.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:40:18.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:18 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:18.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:40:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:40:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:18 smithi162 ceph-mon[33046]: pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:18 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:18 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:18 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:40:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:18 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:40:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:18 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:19.934 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:40:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:40:19.934 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:19 smithi002 ceph-mon[30076]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-21T13:40:19.934 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:19 smithi002 ceph-mon[30076]: Reconfiguring daemon alertmanager.a on smithi002 2024-09-21T13:40:19.934 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:19 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:19.934 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:19 smithi002 ceph-mon[40622]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-21T13:40:19.934 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:19 smithi002 ceph-mon[40622]: Reconfiguring daemon alertmanager.a on smithi002 2024-09-21T13:40:19.935 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:19 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:19.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:19 smithi162 ceph-mon[33046]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-21T13:40:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:19 smithi162 ceph-mon[33046]: Reconfiguring daemon alertmanager.a on smithi002 2024-09-21T13:40:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:19 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:20 smithi162 ceph-mon[33046]: pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:20.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:20 smithi002 ceph-mon[30076]: pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:20.989 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:20 smithi002 ceph-mon[40622]: pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:21.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:21 smithi002 systemd[1]: Stopping Ceph alertmanager.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:40:21.712 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:21 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[74535]: ts=2024-09-21T13:40:21.413Z caller=main.go:542 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-21T13:40:21.712 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:21 smithi002 podman[75574]: 2024-09-21 13:40:21.43436042 +0000 UTC m=+0.133237429 container died 2606103a9845efd3d30b0177eb61e974b4cf840c7f4110cfe4050909e9d94022 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:22.095 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:21 smithi002 podman[75574]: 2024-09-21 13:40:21.859873116 +0000 UTC m=+0.558750120 container cleanup 2606103a9845efd3d30b0177eb61e974b4cf840c7f4110cfe4050909e9d94022 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:22.095 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:21 smithi002 bash[75574]: ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a 2024-09-21T13:40:22.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 podman[75589]: 2024-09-21 13:40:22.095147444 +0000 UTC m=+0.653268353 container remove 2606103a9845efd3d30b0177eb61e974b4cf840c7f4110cfe4050909e9d94022 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:22.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 podman[75589]: 2024-09-21 13:40:22.170894164 +0000 UTC m=+0.729015077 volume remove c09f1f26a8c1879eb834451cbf8b8e79ae0391cb3a2b51be14e55e94b3beef40 2024-09-21T13:40:22.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@alertmanager.a.service: Deactivated successfully. 2024-09-21T13:40:22.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 systemd[1]: Stopped Ceph alertmanager.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:40:22.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 systemd[1]: Starting Ceph alertmanager.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:40:22.818 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:22 smithi002 ceph-mon[30076]: pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:22.818 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:22 smithi002 ceph-mon[40622]: pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:22.818 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 podman[75677]: 2024-09-21 13:40:22.538960174 +0000 UTC m=+0.100185141 volume create 2d0161523a32f563b1342d9b0e0bb38af26b3976f92adf2edc664548e1a1039c 2024-09-21T13:40:22.818 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 podman[75677]: 2024-09-21 13:40:22.455767164 +0000 UTC m=+0.016992145 image pull 11f11916f8cdfb17c1da74b20deb2075d778357b4d60474d82453303f8d461f5 quay.io/prometheus/alertmanager:v0.27.0 2024-09-21T13:40:22.818 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 podman[75677]: 2024-09-21 13:40:22.631009636 +0000 UTC m=+0.192234605 container create deae1ea01a15fabc9dd7768b7b66f25dd6cb8d85f40c618fdc0742bc80fc8a13 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:22 smithi162 ceph-mon[33046]: pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:23.351 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 podman[75677]: 2024-09-21 13:40:22.917163716 +0000 UTC m=+0.478388701 container init deae1ea01a15fabc9dd7768b7b66f25dd6cb8d85f40c618fdc0742bc80fc8a13 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:23.351 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 podman[75677]: 2024-09-21 13:40:22.92392565 +0000 UTC m=+0.485150624 container start deae1ea01a15fabc9dd7768b7b66f25dd6cb8d85f40c618fdc0742bc80fc8a13 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:23.351 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:40:22.939Z caller=main.go:181 level=info msg="Starting Alertmanager" version="(version=0.27.0, branch=HEAD, revision=0aa3c2aad14cff039931923ab16b26b7481783b5)" 2024-09-21T13:40:23.351 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:40:22.939Z caller=main.go:182 level=info build_context="(go=go1.21.7, platform=linux/amd64, user=root@22cd11f671e9, date=20240228-11:51:20, tags=netgo)" 2024-09-21T13:40:23.351 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:40:22.940Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.2 port=9094 2024-09-21T13:40:23.351 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:40:22.941Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-21T13:40:23.351 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:40:22.967Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T13:40:23.351 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:40:22.967Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T13:40:23.352 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:40:22.970Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9093 2024-09-21T13:40:23.352 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:22 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:40:22.970Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-21T13:40:23.352 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:23 smithi002 bash[75677]: deae1ea01a15fabc9dd7768b7b66f25dd6cb8d85f40c618fdc0742bc80fc8a13 2024-09-21T13:40:23.352 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:23 smithi002 systemd[1]: Started Ceph alertmanager.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:40:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:24 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:24 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:24 smithi002 ceph-mon[30076]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T13:40:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:24 smithi002 ceph-mon[30076]: Reconfiguring daemon prometheus.a on smithi162 2024-09-21T13:40:24.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:24 smithi002 ceph-mon[30076]: pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:24 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:24 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:24 smithi002 ceph-mon[40622]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T13:40:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:24 smithi002 ceph-mon[40622]: Reconfiguring daemon prometheus.a on smithi162 2024-09-21T13:40:24.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:24 smithi002 ceph-mon[40622]: pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:24 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:24 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:24 smithi162 ceph-mon[33046]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T13:40:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:24 smithi162 ceph-mon[33046]: Reconfiguring daemon prometheus.a on smithi162 2024-09-21T13:40:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:24 smithi162 ceph-mon[33046]: pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:25.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:24 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:40:24.942Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000852217s 2024-09-21T13:40:26.733 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 systemd[1]: Stopping Ceph prometheus.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:40:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-mon[33046]: pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:26 smithi002 ceph-mon[30076]: pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:26.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:26 smithi002 ceph-mon[40622]: pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:27.050 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.767Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-21T13:40:27.050 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.767Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..." 2024-09-21T13:40:27.050 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.767Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..." 2024-09-21T13:40:27.050 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.767Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-21T13:40:27.050 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.767Z caller=main.go:984 level=info msg="Scrape discovery manager stopped" 2024-09-21T13:40:27.050 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.767Z caller=main.go:998 level=info msg="Notify discovery manager stopped" 2024-09-21T13:40:27.051 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.767Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped" 2024-09-21T13:40:27.051 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.767Z caller=main.go:1039 level=info msg="Stopping scrape manager..." 2024-09-21T13:40:27.051 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.767Z caller=main.go:1031 level=info msg="Scrape manager stopped" 2024-09-21T13:40:27.051 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.768Z caller=notifier.go:618 level=info component=notifier msg="Stopping notification manager..." 2024-09-21T13:40:27.051 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.768Z caller=main.go:1261 level=info msg="Notifier manager stopped" 2024-09-21T13:40:27.051 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[61900]: ts=2024-09-21T13:40:26.768Z caller=main.go:1273 level=info msg="See you next time!" 2024-09-21T13:40:27.051 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:26 smithi162 podman[64652]: 2024-09-21 13:40:26.777682986 +0000 UTC m=+0.142695040 container died a1560bd0df2137d348c92eb18b046de653ebde2f0a7251f5612cfb0702cfac8c (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:27.375 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 podman[64652]: 2024-09-21 13:40:27.165230699 +0000 UTC m=+0.530242759 container cleanup a1560bd0df2137d348c92eb18b046de653ebde2f0a7251f5612cfb0702cfac8c (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:27.375 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 bash[64652]: ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a 2024-09-21T13:40:27.715 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]} : dispatch 2024-09-21T13:40:27.715 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]} : dispatch 2024-09-21T13:40:27.715 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]} : dispatch 2024-09-21T13:40:27.715 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 podman[64669]: 2024-09-21 13:40:27.374824025 +0000 UTC m=+0.598822318 container remove a1560bd0df2137d348c92eb18b046de653ebde2f0a7251f5612cfb0702cfac8c (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:27.715 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-21T13:40:27.715 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 systemd[1]: Stopped Ceph prometheus.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:40:27.716 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@prometheus.a.service: Consumed 1.076s CPU time. 2024-09-21T13:40:27.716 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 systemd[1]: Starting Ceph prometheus.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:40:27.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]} : dispatch 2024-09-21T13:40:27.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]} : dispatch 2024-09-21T13:40:27.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:27 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]} : dispatch 2024-09-21T13:40:27.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]} : dispatch 2024-09-21T13:40:27.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]} : dispatch 2024-09-21T13:40:27.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:27 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]} : dispatch 2024-09-21T13:40:27.966 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 podman[64764]: 2024-09-21 13:40:27.618502208 +0000 UTC m=+0.017321316 image pull 1d3b7f56885b6dd623f1785be963aa9c195f86bc256ea454e8d02a7980b79c53 quay.io/prometheus/prometheus:v2.51.0 2024-09-21T13:40:27.966 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 podman[64764]: 2024-09-21 13:40:27.717432705 +0000 UTC m=+0.116251796 container create fdb2bf917df5bcb52d50133af640a6ab19325ab9d1817636d9734eef353b11b3 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:27.966 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 podman[64764]: 2024-09-21 13:40:27.961465559 +0000 UTC m=+0.360284660 container init fdb2bf917df5bcb52d50133af640a6ab19325ab9d1817636d9734eef353b11b3 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:27.966 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 podman[64764]: 2024-09-21 13:40:27.966048989 +0000 UTC m=+0.364868081 container start fdb2bf917df5bcb52d50133af640a6ab19325ab9d1817636d9734eef353b11b3 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T13:40:28.233 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.985Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.0, branch=HEAD, revision=c05c15512acb675e3f6cd662a6727854e93fc024)" 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.985Z caller=main.go:622 level=info build_context="(go=go1.22.1, platform=linux/amd64, user=root@b5723e458358, date=20240319-10:54:45, tags=netgo,builtinassets,stringlabels)" 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.985Z caller=main.go:623 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi162 (none))" 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.985Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.985Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.987Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=:9095 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.987Z caller=main.go:1129 level=info msg="Starting TSDB ..." 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.989Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.989Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.991Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.991Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.654µs 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.991Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-21T13:40:28.234 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.991Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-09-21T13:40:28.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.991Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-09-21T13:40:28.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.991Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=34.288µs wal_replay_duration=433.605µs wbl_replay_duration=84ns total_replay_duration=490.834µs 2024-09-21T13:40:28.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.993Z caller=main.go:1150 level=info fs_type=XFS_SUPER_MAGIC 2024-09-21T13:40:28.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.993Z caller=main.go:1153 level=info msg="TSDB started" 2024-09-21T13:40:28.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:27.993Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-21T13:40:28.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:28.009Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=15.620283ms db_storage=872ns remote_storage=1.031µs web_handler=240ns query_engine=605ns scrape=385.979µs scrape_sd=114.598µs notify=16.318µs notify_sd=15.823µs rules=14.733675ms tracing=5.938µs 2024-09-21T13:40:28.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:28.009Z caller=main.go:1114 level=info msg="Server is ready to receive web requests." 2024-09-21T13:40:28.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:40:28.009Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..." 2024-09-21T13:40:28.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:28 smithi162 bash[64764]: fdb2bf917df5bcb52d50133af640a6ab19325ab9d1817636d9734eef353b11b3 2024-09-21T13:40:28.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:40:28 smithi162 systemd[1]: Started Ceph prometheus.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:40:28.514 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE Bus STOPPING 2024-09-21T13:40:28.514 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T13:40:28.514 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE Bus STOPPED 2024-09-21T13:40:28.514 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE Bus STARTING 2024-09-21T13:40:28.514 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE Serving on http://:::9283 2024-09-21T13:40:28.514 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE Bus STARTED 2024-09-21T13:40:28.514 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE Bus STOPPING 2024-09-21T13:40:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: osdmap e64: 8 total, 8 up, 8 in 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"} : dispatch 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"} : dispatch 2024-09-21T13:40:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-21T13:40:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"} : dispatch 2024-09-21T13:40:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:40:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2024-09-21T13:40:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-09-21T13:40:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-09-21T13:40:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: osdmap e64: 8 total, 8 up, 8 in 2024-09-21T13:40:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"} : dispatch 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"} : dispatch 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"} : dispatch 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:40:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2024-09-21T13:40:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-09-21T13:40:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-09-21T13:40:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: osdmap e64: 8 total, 8 up, 8 in 2024-09-21T13:40:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"} : dispatch 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"} : dispatch 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"} : dispatch 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:40:28.985 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:40:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:40:29.350 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T13:40:29.350 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE Bus STOPPED 2024-09-21T13:40:29.351 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE Bus STARTING 2024-09-21T13:40:29.351 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE Serving on http://:::9283 2024-09-21T13:40:29.351 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE Bus STARTED 2024-09-21T13:40:29.351 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:28 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:28] ENGINE Bus STOPPING 2024-09-21T13:40:29.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T13:40:29.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T13:40:29.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T13:40:29.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T13:40:29.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T13:40:29.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T13:40:29.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:40:29.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: osdmap e65: 8 total, 8 up, 8 in 2024-09-21T13:40:29.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:29.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:40:29.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:40:29.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: osdmap e65: 8 total, 8 up, 8 in 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:40:29.689 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:40:29.690 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:29] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T13:40:29.690 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:29] ENGINE Bus STOPPED 2024-09-21T13:40:29.690 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:29] ENGINE Bus STARTING 2024-09-21T13:40:29.690 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:29] ENGINE Serving on http://:::9283 2024-09-21T13:40:29.690 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:40:29] ENGINE Bus STARTED 2024-09-21T13:40:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T13:40:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T13:40:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T13:40:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T13:40:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T13:40:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T13:40:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:40:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: osdmap e65: 8 total, 8 up, 8 in 2024-09-21T13:40:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:40:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:40:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T13:40:30.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:40:30.816 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:40:30.816 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:30 smithi002 ceph-mon[30076]: pgmap v36: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:30.816 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:40:30.816 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:30 smithi002 ceph-mon[30076]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T13:40:30.817 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:40:30.817 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:30 smithi002 ceph-mon[40622]: pgmap v36: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:30.817 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:40:30.817 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:30 smithi002 ceph-mon[40622]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T13:40:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:30 smithi162 ceph-mon[33046]: pgmap v36: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T13:40:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:30 smithi162 ceph-mon[33046]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T13:40:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:32 smithi002 ceph-mon[30076]: pgmap v37: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:40:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:32 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:32 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:32.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:32 smithi002 ceph-mon[40622]: pgmap v37: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:40:32.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:32 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:32.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:32 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:32 smithi162 ceph-mon[33046]: pgmap v37: 132 pgs: 3 peering, 129 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:40:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:32 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:32 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:33.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:40:32 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:40:32.946Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.0044132s 2024-09-21T13:40:33.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:33 smithi002 ceph-mon[30076]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T13:40:33.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:33 smithi002 ceph-mon[30076]: Cluster is now healthy 2024-09-21T13:40:33.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:33 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:33.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:33 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:33.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:33 smithi002 ceph-mon[40622]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T13:40:33.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:33 smithi002 ceph-mon[40622]: Cluster is now healthy 2024-09-21T13:40:33.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:33 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:33.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:33 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:33 smithi162 ceph-mon[33046]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T13:40:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:33 smithi162 ceph-mon[33046]: Cluster is now healthy 2024-09-21T13:40:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:33 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:33 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:34 smithi002 ceph-mon[30076]: pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 85 B/s, 2 objects/s recovering 2024-09-21T13:40:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:34 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:40:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:34 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:40:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:34 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:34 smithi002 ceph-mon[40622]: pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 85 B/s, 2 objects/s recovering 2024-09-21T13:40:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:34 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:40:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:34 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:40:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:34 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:34 smithi162 ceph-mon[33046]: pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 85 B/s, 2 objects/s recovering 2024-09-21T13:40:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:34 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:40:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:34 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:40:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:34 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:36.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:36 smithi002 ceph-mon[30076]: pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 85 B/s, 2 objects/s recovering 2024-09-21T13:40:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:36 smithi002 ceph-mon[40622]: pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 85 B/s, 2 objects/s recovering 2024-09-21T13:40:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:36 smithi162 ceph-mon[33046]: pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 85 B/s, 2 objects/s recovering 2024-09-21T13:40:38.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:38 smithi002 ceph-mon[30076]: pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 69 B/s, 1 objects/s recovering 2024-09-21T13:40:38.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:38 smithi002 ceph-mon[40622]: pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 69 B/s, 1 objects/s recovering 2024-09-21T13:40:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:38 smithi162 ceph-mon[33046]: pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 69 B/s, 1 objects/s recovering 2024-09-21T13:40:38.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:40:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:40:39.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:39 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:39.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:39 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:39.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:40:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:40:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:39 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:40.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:40 smithi002 ceph-mon[30076]: pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s; 62 B/s, 1 objects/s recovering 2024-09-21T13:40:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:40 smithi002 ceph-mon[40622]: pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s; 62 B/s, 1 objects/s recovering 2024-09-21T13:40:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:40 smithi162 ceph-mon[33046]: pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s; 62 B/s, 1 objects/s recovering 2024-09-21T13:40:42.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:42 smithi002 ceph-mon[40622]: pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 57 B/s, 1 objects/s recovering 2024-09-21T13:40:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:42 smithi002 ceph-mon[30076]: pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 57 B/s, 1 objects/s recovering 2024-09-21T13:40:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:42 smithi162 ceph-mon[33046]: pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 57 B/s, 1 objects/s recovering 2024-09-21T13:40:43.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:43.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:44 smithi002 ceph-mon[30076]: pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 57 B/s, 1 objects/s recovering 2024-09-21T13:40:44.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:44 smithi002 ceph-mon[40622]: pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 57 B/s, 1 objects/s recovering 2024-09-21T13:40:44.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:44 smithi162 ceph-mon[33046]: pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 57 B/s, 1 objects/s recovering 2024-09-21T13:40:46.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:46 smithi002 ceph-mon[30076]: pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:46.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:46 smithi002 ceph-mon[40622]: pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:46 smithi162 ceph-mon[33046]: pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:48 smithi162 ceph-mon[33046]: pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:48.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:40:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:40:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:48 smithi002 ceph-mon[30076]: pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:48 smithi002 ceph-mon[40622]: pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:49 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:49 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:49 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:50.101 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:40:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:40:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:50 smithi162 ceph-mon[33046]: pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:50 smithi002 ceph-mon[30076]: pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:50 smithi002 ceph-mon[40622]: pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:51.888 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 90% (11455/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T13:40:52.798 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '441784946648ff53dd310293f9dd752afeeea72a'. 2024-09-21T13:40:52.798 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-21T13:40:52.798 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T13:40:52.798 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T13:40:52.798 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T13:40:52.798 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-21T13:40:52.799 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 44178494664 Merge branch 'activate-lvm-tpm2' of https://github.com/guits/ceph into wip-guits-main-2024-09-21-0842 2024-09-21T13:40:52.803 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T13:40:52.830 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T13:40:52.832 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T13:40:52.833 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T13:40:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:52 smithi162 ceph-mon[33046]: pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:52 smithi002 ceph-mon[30076]: pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:52 smithi002 ceph-mon[40622]: pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:53.543 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T13:40:53.620 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T13:40:53.663 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T13:40:53.664 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T13:40:53.664 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T13:40:53.705 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T13:40:53.709 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-21T13:40:53.710 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T13:40:53.766 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-21T13:40:53.767 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-21T13:40:53.768 DEBUG:teuthology.orchestra.run.smithi002:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=441784946648ff53dd310293f9dd752afeeea72a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-09-21T13:40:53.835 INFO:tasks.workunit.client.0.smithi002.stderr:+ parallel=1 2024-09-21T13:40:53.836 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' '' = --serial ']' 2024-09-21T13:40:53.836 INFO:tasks.workunit.client.0.smithi002.stderr:+ crimson=0 2024-09-21T13:40:53.836 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' '' = --crimson ']' 2024-09-21T13:40:53.836 INFO:tasks.workunit.client.0.smithi002.stderr:+ color= 2024-09-21T13:40:53.836 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -t 1 ']' 2024-09-21T13:40:53.836 INFO:tasks.workunit.client.0.smithi002.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-21T13:40:53.836 INFO:tasks.workunit.client.0.smithi002.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-21T13:40:53.836 INFO:tasks.workunit.client.0.smithi002.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-21T13:40:53.837 INFO:tasks.workunit.client.0.smithi002.stderr:+ declare -A pids 2024-09-21T13:40:53.837 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.837 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.837 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_aio 2024-09-21T13:40:53.837 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_aio' 2024-09-21T13:40:53.837 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_aio 2024-09-21T13:40:53.837 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.838 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_aio 2024-09-21T13:40:53.838 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76314 2024-09-21T13:40:53.839 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_aio on pid 76314' 2024-09-21T13:40:53.839 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76314 2024-09-21T13:40:53.839 INFO:tasks.workunit.client.0.smithi002.stdout:test api_aio on pid 76314 2024-09-21T13:40:53.841 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.841 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.841 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-09-21T13:40:53.841 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_aio_pp 2024-09-21T13:40:53.841 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_aio_pp' 2024-09-21T13:40:53.841 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_aio_pp 2024-09-21T13:40:53.841 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.842 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.843 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.844 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_aio_pp 2024-09-21T13:40:53.844 INFO:tasks.workunit.client.0.smithi002.stdout:test api_aio_pp on pid 76321 2024-09-21T13:40:53.847 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76321 2024-09-21T13:40:53.847 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_aio_pp on pid 76321' 2024-09-21T13:40:53.847 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76321 2024-09-21T13:40:53.847 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.847 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_io 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_io' 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_io 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.848 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.849 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.850 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.850 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.850 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.850 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.850 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.850 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.850 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.850 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.850 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.850 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.850 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.851 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.852 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.852 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.852 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_io 2024-09-21T13:40:53.852 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76330 2024-09-21T13:40:53.852 INFO:tasks.workunit.client.0.smithi002.stdout:test api_io on pid 76330 2024-09-21T13:40:53.857 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_io on pid 76330' 2024-09-21T13:40:53.857 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-09-21T13:40:53.857 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76330 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_io_pp 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_io_pp' 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_io_pp 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.858 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_io_pp 2024-09-21T13:40:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76343 2024-09-21T13:40:53.863 INFO:tasks.workunit.client.0.smithi002.stdout:test api_io_pp on pid 76343 2024-09-21T13:40:53.868 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_io_pp on pid 76343' 2024-09-21T13:40:53.868 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76343 2024-09-21T13:40:53.868 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.868 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-09-21T13:40:53.868 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.868 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_asio 2024-09-21T13:40:53.868 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_asio' 2024-09-21T13:40:53.868 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_asio 2024-09-21T13:40:53.869 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.870 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:53.871 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:53.871 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.871 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.871 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:53.871 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.871 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.871 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.871 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.871 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.871 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.871 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.872 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.873 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:53.874 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:53.875 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_asio 2024-09-21T13:40:53.875 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76358 2024-09-21T13:40:53.875 INFO:tasks.workunit.client.0.smithi002.stdout:test api_asio on pid 76358 2024-09-21T13:40:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_asio on pid 76358' 2024-09-21T13:40:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76358 2024-09-21T13:40:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-09-21T13:40:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_list 2024-09-21T13:40:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_list' 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_list 2024-09-21T13:40:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76314/exe 2024-09-21T13:40:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_list 2024-09-21T13:40:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76375 2024-09-21T13:40:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_list on pid 76375' 2024-09-21T13:40:53.889 INFO:tasks.workunit.client.0.smithi002.stdout:test api_list on pid 76375 2024-09-21T13:40:53.894 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76375 2024-09-21T13:40:53.894 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.894 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.894 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-09-21T13:40:53.894 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:53.894 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_lock 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_lock' 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_lock 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:53.897 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76321/exe 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_aio: /' 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_aio.log 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.899 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:53.902 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:53.902 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.902 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.902 INFO:tasks.workunit.client.0.smithi002.stdout:test api_lock on pid 76392 2024-09-21T13:40:53.904 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_lock 2024-09-21T13:40:53.904 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.904 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.904 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.904 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.904 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76392 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_lock on pid 76392' 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76392 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:53.905 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_lock_pp 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_lock_pp' 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_aio_pp: /' 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.909 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_lock_pp 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76330/exe 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.912 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.914 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.914 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.914 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.914 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.914 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_lock_pp 2024-09-21T13:40:53.914 INFO:tasks.workunit.client.0.smithi002.stdout:test api_lock_pp on pid 76413 2024-09-21T13:40:53.918 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76413 2024-09-21T13:40:53.918 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_lock_pp on pid 76413' 2024-09-21T13:40:53.918 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76413 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_misc 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_misc' 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_misc 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.921 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_io.log 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:53.924 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.926 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76343/exe 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_io: /' 2024-09-21T13:40:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_io_pp: /' 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_misc 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.930 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.931 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.931 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.931 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.931 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.931 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.931 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.931 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.931 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76439 2024-09-21T13:40:53.931 INFO:tasks.workunit.client.0.smithi002.stdout:test api_misc on pid 76439 2024-09-21T13:40:53.934 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.934 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_misc on pid 76439' 2024-09-21T13:40:53.934 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76439 2024-09-21T13:40:53.934 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.934 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.934 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.934 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.934 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.934 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_misc_pp 2024-09-21T13:40:53.934 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_misc_pp' 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_misc_pp 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.936 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:53.940 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76358/exe 2024-09-21T13:40:53.941 INFO:tasks.workunit.client.0.smithi002.stdout:test api_misc_pp on pid 76459 2024-09-21T13:40:53.947 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.947 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.947 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.947 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.947 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.947 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.947 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.947 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.947 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.947 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_misc_pp 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.948 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76459 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_misc_pp on pid 76459' 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76459 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_tier_pp 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_tier_pp' 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:53.950 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_asio.log 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_asio: /' 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:53.953 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:53.955 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76375/exe 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_tier_pp 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.959 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.959 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.959 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.959 INFO:tasks.workunit.client.0.smithi002.stdout:test api_tier_pp on pid 76484 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_tier_pp 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76484 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_tier_pp on pid 76484' 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76484 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_pool 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_pool' 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_pool 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:53.963 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:53.965 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.965 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_pool 2024-09-21T13:40:53.965 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76496 2024-09-21T13:40:53.965 INFO:tasks.workunit.client.0.smithi002.stdout:test api_pool on pid 76496 2024-09-21T13:40:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_pool on pid 76496' 2024-09-21T13:40:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76413/exe 2024-09-21T13:40:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76496 2024-09-21T13:40:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_snapshots 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_list.log 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_snapshots' 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_list: /' 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_lock_pp: /' 2024-09-21T13:40:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.974 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76392/exe 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.976 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.977 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_lock.log 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76439/exe 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:53.982 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:53.984 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:53.986 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_misc.log 2024-09-21T13:40:53.986 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_snapshots 2024-09-21T13:40:53.986 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2024-09-21T13:40:53.986 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_snapshots 2024-09-21T13:40:53.986 INFO:tasks.workunit.client.0.smithi002.stdout:test api_snapshots on pid 76555 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76555 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_snapshots on pid 76555' 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76555 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_snapshots_pp 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_snapshots_pp' 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76459/exe 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_snapshots_pp 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.990 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_lock: /' 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_misc: /' 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_misc_pp: /' 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.994 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:53.996 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:53.997 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:53.997 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:53.997 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:53.997 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:53.997 INFO:tasks.workunit.client.0.smithi002.stdout:test api_snapshots_pp on pid 76602 2024-09-21T13:40:53.999 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_snapshots_pp 2024-09-21T13:40:53.999 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76602 2024-09-21T13:40:53.999 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_snapshots_pp on pid 76602' 2024-09-21T13:40:53.999 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76602 2024-09-21T13:40:53.999 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:53.999 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.000 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.001 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_stat 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_stat' 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_stat 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.003 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.003 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.003 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.003 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.003 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.003 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.003 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76496/exe 2024-09-21T13:40:54.003 INFO:tasks.workunit.client.0.smithi002.stdout:test api_stat on pid 76625 2024-09-21T13:40:54.005 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_stat 2024-09-21T13:40:54.005 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76625 2024-09-21T13:40:54.005 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_stat on pid 76625' 2024-09-21T13:40:54.005 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76625 2024-09-21T13:40:54.005 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.005 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.005 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.005 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_stat_pp 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_stat_pp' 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.006 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_stat_pp 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.008 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_pool: /' 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_pool.log 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.012 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.012 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.012 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.012 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.012 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.012 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.012 INFO:tasks.workunit.client.0.smithi002.stdout:test api_stat_pp on pid 76659 2024-09-21T13:40:54.014 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_stat_pp 2024-09-21T13:40:54.014 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76659 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_stat_pp on pid 76659' 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76659 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.015 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_watch_notify 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_watch_notify' 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.021 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_watch_notify 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76484/exe 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.023 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.024 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.024 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.024 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.024 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.024 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.024 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.024 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.024 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.024 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.024 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.024 INFO:tasks.workunit.client.0.smithi002.stdout:test api_watch_notify on pid 76707 2024-09-21T13:40:54.028 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.028 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.028 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.028 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_watch_notify 2024-09-21T13:40:54.028 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.028 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.028 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76707 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_watch_notify on pid 76707' 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76707 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_watch_notify_pp 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_watch_notify_pp' 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76555/exe 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.032 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_tier_pp: /' 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-09-21T13:40:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_snapshots: /' 2024-09-21T13:40:54.035 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.035 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.035 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.035 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.035 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.035 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.035 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.035 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.035 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.035 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.036 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.038 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.038 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.038 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.038 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.038 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.038 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2024-09-21T13:40:54.038 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.038 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.038 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.038 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.038 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.039 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.039 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.039 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.039 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.039 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.039 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_watch_notify_pp 2024-09-21T13:40:54.039 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-09-21T13:40:54.039 INFO:tasks.workunit.client.0.smithi002.stdout:test api_watch_notify_pp on pid 76751 2024-09-21T13:40:54.044 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_watch_notify_pp 2024-09-21T13:40:54.044 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76751 2024-09-21T13:40:54.044 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_watch_notify_pp on pid 76751' 2024-09-21T13:40:54.044 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76751 2024-09-21T13:40:54.044 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.045 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.050 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.052 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_cmd 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76659/exe 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_cmd' 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.056 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.058 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.058 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.058 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.058 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.058 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.058 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.058 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.058 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.058 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.058 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_cmd 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76602/exe 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.059 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_stat_pp: /' 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.060 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76625/exe 2024-09-21T13:40:54.062 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.064 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-09-21T13:40:54.064 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_stat: /' 2024-09-21T13:40:54.064 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2024-09-21T13:40:54.064 INFO:tasks.workunit.client.0.smithi002.stdout:test api_cmd on pid 76823 2024-09-21T13:40:54.065 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_cmd 2024-09-21T13:40:54.065 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76823 2024-09-21T13:40:54.065 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_cmd on pid 76823' 2024-09-21T13:40:54.065 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-09-21T13:40:54.065 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76823 2024-09-21T13:40:54.065 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.065 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.065 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-09-21T13:40:54.065 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_stat.log 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.066 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_cmd_pp 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_cmd_pp' 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_cmd_pp 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.068 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.070 INFO:tasks.workunit.client.0.smithi002.stdout:test api_cmd_pp on pid 76839 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_cmd_pp 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76839 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_cmd_pp on pid 76839' 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76839 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_service 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_service' 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_service 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.074 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.076 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.077 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.077 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.077 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.077 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.077 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_service 2024-09-21T13:40:54.077 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76875 2024-09-21T13:40:54.077 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_service on pid 76875' 2024-09-21T13:40:54.077 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76875 2024-09-21T13:40:54.077 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.077 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.077 INFO:tasks.workunit.client.0.smithi002.stdout:test api_service on pid 76875 2024-09-21T13:40:54.081 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-09-21T13:40:54.081 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.081 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.081 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.081 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.081 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.081 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.082 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76707/exe 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_service_pp 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_service_pp' 2024-09-21T13:40:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-09-21T13:40:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_watch_notify: /' 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_service_pp 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76751/exe 2024-09-21T13:40:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_service_pp 2024-09-21T13:40:54.092 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76911 2024-09-21T13:40:54.092 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_service_pp on pid 76911' 2024-09-21T13:40:54.092 INFO:tasks.workunit.client.0.smithi002.stdout:test api_service_pp on pid 76911 2024-09-21T13:40:54.099 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=76911 2024-09-21T13:40:54.099 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.099 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.099 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.099 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-09-21T13:40:54.099 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.099 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.099 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.099 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.100 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_c_write_operations 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_c_write_operations' 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_c_write_operations 2024-09-21T13:40:54.105 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.106 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.106 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.106 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.106 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.106 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.106 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.106 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.106 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.106 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.106 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.108 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76823/exe 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.110 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.113 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_cmd: /' 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_cmd.log 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.115 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.116 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.116 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.116 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.116 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.116 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76839/exe 2024-09-21T13:40:54.116 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_c_write_operations 2024-09-21T13:40:54.116 INFO:tasks.workunit.client.0.smithi002.stdout:test api_c_write_operations on pid 77005 2024-09-21T13:40:54.120 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77005 2024-09-21T13:40:54.120 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_c_write_operations on pid 77005' 2024-09-21T13:40:54.120 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77005 2024-09-21T13:40:54.120 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s api_c_read_operations 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' api_c_read_operations' 2024-09-21T13:40:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo api_c_read_operations 2024-09-21T13:40:54.122 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76875/exe 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.125 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.126 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.126 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.126 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.126 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.126 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2024-09-21T13:40:54.126 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.126 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-09-21T13:40:54.126 INFO:tasks.workunit.client.0.smithi002.stdout:test api_c_read_operations on pid 77026 2024-09-21T13:40:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=api_c_read_operations 2024-09-21T13:40:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-09-21T13:40:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77026 2024-09-21T13:40:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test api_c_read_operations on pid 77026' 2024-09-21T13:40:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77026 2024-09-21T13:40:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s list_parallel 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' list_parallel' 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_service.log 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.131 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_service: /' 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo list_parallel 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.134 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.136 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.137 INFO:tasks.workunit.client.0.smithi002.stdout:test list_parallel on pid 77051 2024-09-21T13:40:54.138 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=list_parallel 2024-09-21T13:40:54.138 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77051 2024-09-21T13:40:54.138 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test list_parallel on pid 77051' 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77051 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s open_pools_parallel 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' open_pools_parallel' 2024-09-21T13:40:54.139 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.141 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.143 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/76911/exe 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2024-09-21T13:40:54.145 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo open_pools_parallel 2024-09-21T13:40:54.145 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-09-21T13:40:54.145 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_service_pp: /' 2024-09-21T13:40:54.145 INFO:tasks.workunit.client.0.smithi002.stdout:test open_pools_parallel on pid 77081 2024-09-21T13:40:54.146 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=open_pools_parallel 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77081 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test open_pools_parallel on pid 77081' 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77081 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s delete_pools_parallel 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' delete_pools_parallel' 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.147 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo delete_pools_parallel 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.150 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.151 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.151 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.151 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.151 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.151 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.151 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.151 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.151 INFO:tasks.workunit.client.0.smithi002.stdout:test delete_pools_parallel on pid 77100 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=delete_pools_parallel 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77100 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test delete_pools_parallel on pid 77100' 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77100 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.160 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s cls 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' cls' 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.163 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77005/exe 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo cls 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.166 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.167 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.167 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-09-21T13:40:54.167 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.167 INFO:tasks.workunit.client.0.smithi002.stdout:test cls on pid 77143 2024-09-21T13:40:54.169 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=cls 2024-09-21T13:40:54.169 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77143 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test cls on pid 77143' 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77143 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s cmd 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' cmd' 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo cmd 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-09-21T13:40:54.172 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.173 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.175 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77026/exe 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.178 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.178 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.178 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.178 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.178 INFO:tasks.workunit.client.0.smithi002.stdout:test cmd on pid 77168 2024-09-21T13:40:54.182 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=cmd 2024-09-21T13:40:54.182 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77168 2024-09-21T13:40:54.182 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test cmd on pid 77168' 2024-09-21T13:40:54.182 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77168 2024-09-21T13:40:54.182 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.182 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.183 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s handler_error 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' handler_error' 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo handler_error 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.187 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.189 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=handler_error 2024-09-21T13:40:54.190 INFO:tasks.workunit.client.0.smithi002.stdout:test handler_error on pid 77195 2024-09-21T13:40:54.192 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.192 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.192 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77195 2024-09-21T13:40:54.192 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test handler_error on pid 77195' 2024-09-21T13:40:54.192 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77195 2024-09-21T13:40:54.192 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.192 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.192 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.192 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.194 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.196 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.196 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.196 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s io 2024-09-21T13:40:54.196 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' io' 2024-09-21T13:40:54.196 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.196 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-09-21T13:40:54.196 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo io 2024-09-21T13:40:54.196 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77051/exe 2024-09-21T13:40:54.196 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=io 2024-09-21T13:40:54.196 INFO:tasks.workunit.client.0.smithi002.stdout:test io on pid 77215 2024-09-21T13:40:54.200 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77215 2024-09-21T13:40:54.200 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test io on pid 77215' 2024-09-21T13:40:54.200 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77215 2024-09-21T13:40:54.200 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.200 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.200 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-09-21T13:40:54.200 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.200 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.200 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s ec_io 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2024-09-21T13:40:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' ec_io' 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.203 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ list_parallel: /' 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_list_parallel.log 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.209 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo ec_io 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.210 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.212 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.214 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.214 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.214 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.214 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=ec_io 2024-09-21T13:40:54.214 INFO:tasks.workunit.client.0.smithi002.stdout:test ec_io on pid 77258 2024-09-21T13:40:54.218 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77258 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test ec_io on pid 77258' 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77258 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77081/exe 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77143/exe 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.221 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.223 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s list 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' list' 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo list 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.225 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_cls 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2024-09-21T13:40:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.228 INFO:tasks.workunit.client.0.smithi002.stdout:test list on pid 77301 2024-09-21T13:40:54.230 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=list 2024-09-21T13:40:54.230 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77301 2024-09-21T13:40:54.230 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test list on pid 77301' 2024-09-21T13:40:54.230 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77301 2024-09-21T13:40:54.230 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.230 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.230 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-09-21T13:40:54.230 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s ec_list 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ cls: /' 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' ec_list' 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo ec_list 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_cls.log 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77100/exe 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.235 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.235 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.235 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.235 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.235 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.235 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.235 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.235 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.235 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.235 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.235 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=ec_list 2024-09-21T13:40:54.237 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77343 2024-09-21T13:40:54.237 INFO:tasks.workunit.client.0.smithi002.stdout:test ec_list on pid 77343 2024-09-21T13:40:54.240 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test ec_list on pid 77343' 2024-09-21T13:40:54.240 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77343 2024-09-21T13:40:54.240 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.241 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.242 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.243 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s misc 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' misc' 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.244 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.247 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77168/exe 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ cmd: /' 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_cmd.log 2024-09-21T13:40:54.249 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_cmd 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo misc 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.252 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.252 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.252 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.252 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.252 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.252 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.252 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.252 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.252 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=misc 2024-09-21T13:40:54.252 INFO:tasks.workunit.client.0.smithi002.stdout:test misc on pid 77420 2024-09-21T13:40:54.257 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.257 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77420 2024-09-21T13:40:54.257 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.257 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.257 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test misc on pid 77420' 2024-09-21T13:40:54.257 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77420 2024-09-21T13:40:54.257 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s pool 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.259 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' pool' 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77195/exe 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.262 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.263 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.266 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_handler_error 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo pool 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_handler_error.log 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ handler_error: /' 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.268 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.269 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.269 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.269 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.269 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.269 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.269 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=pool 2024-09-21T13:40:54.269 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77470 2024-09-21T13:40:54.269 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test pool on pid 77470' 2024-09-21T13:40:54.269 INFO:tasks.workunit.client.0.smithi002.stdout:test pool on pid 77470 2024-09-21T13:40:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77470 2024-09-21T13:40:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s read_operations 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' read_operations' 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo read_operations 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.276 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.277 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.279 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.279 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.279 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.279 INFO:tasks.workunit.client.0.smithi002.stdout:test read_operations on pid 77507 2024-09-21T13:40:54.282 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=read_operations 2024-09-21T13:40:54.282 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.282 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77507 2024-09-21T13:40:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test read_operations on pid 77507' 2024-09-21T13:40:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77507 2024-09-21T13:40:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77258/exe 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s snapshots 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77215/exe 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' snapshots' 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77343/exe 2024-09-21T13:40:54.286 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.288 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ ec_io: /' 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_ec_io.log 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ ec_list: /' 2024-09-21T13:40:54.289 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_ec_list 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_ec_list.log 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_ec_io 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_io.log 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_io 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.292 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo snapshots 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.295 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.295 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.295 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.295 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.295 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.295 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.295 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.295 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ io: /' 2024-09-21T13:40:54.295 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77301/exe 2024-09-21T13:40:54.295 INFO:tasks.workunit.client.0.smithi002.stdout:test snapshots on pid 77597 2024-09-21T13:40:54.299 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=snapshots 2024-09-21T13:40:54.299 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.299 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.299 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.299 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.299 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.299 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.299 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.299 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.299 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77597 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test snapshots on pid 77597' 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77597 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s watch_notify 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' watch_notify' 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.302 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo watch_notify 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.307 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ list: /' 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_list.log 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_list 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.309 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.309 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.309 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.309 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.309 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.309 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.309 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.309 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.309 INFO:tasks.workunit.client.0.smithi002.stdout:test watch_notify on pid 77644 2024-09-21T13:40:54.312 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=watch_notify 2024-09-21T13:40:54.312 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77644 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test watch_notify on pid 77644' 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77644 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:++ printf %25s write_operations 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:+ r=' write_operations' 2024-09-21T13:40:54.313 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77420/exe 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:++ echo write_operations 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.315 INFO:tasks.workunit.client.0.smithi002.stderr:++ awk '{print $1}' 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.317 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.317 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.317 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.317 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.317 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.317 INFO:tasks.workunit.client.0.smithi002.stdout:test write_operations on pid 77663 2024-09-21T13:40:54.320 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:+ ff=write_operations 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77663 2024-09-21T13:40:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'test write_operations on pid 77663' 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:+ pids[$f]=77663 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:+ ret=0 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76484 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76484 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_misc 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.322 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.324 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77470/exe 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -f /etc/bashrc ']' 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:+ . /etc/bashrc 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:++ BASHRCSOURCED=Y 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.327 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:++ shopt -q login_shell 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_misc.log 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ misc: /' 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.329 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.331 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_pool.log 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:+++ umask 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ pool: /' 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' 0022 -eq 0 ']' 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:++ SHELL=/bin/bash 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_pool 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.334 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.334 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77507/exe 2024-09-21T13:40:54.334 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.336 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.336 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_read_operations 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ read_operations: /' 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_read_operations.log 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.338 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'grep=grep --color=auto' 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-21T13:40:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorls.sh 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' '!' -t 0 ']' 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:+++ return 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export S_COLORS=auto 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:+++ S_COLORS=auto 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.340 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-21T13:40:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.344 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.345 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.345 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.345 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.345 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.345 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.345 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77597/exe 2024-09-21T13:40:54.347 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.347 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.347 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.347 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.347 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.347 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.347 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.347 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77644/exe 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_snapshots 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ snapshots: /' 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_snapshots.log 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.350 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/gawk.sh 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/lang.sh 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/locale 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.351 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_watch_notify 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ watch_notify: /' 2024-09-21T13:40:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-21T13:40:54.353 INFO:tasks.workunit.client.0.smithi002.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-21T13:40:54.353 INFO:tasks.workunit.client.0.smithi002.stderr:++++ export LANG=en_US.UTF-8 2024-09-21T13:40:54.353 INFO:tasks.workunit.client.0.smithi002.stderr:++++ LANG=en_US.UTF-8 2024-09-21T13:40:54.353 INFO:tasks.workunit.client.0.smithi002.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-21T13:40:54.353 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-21T13:40:54.353 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:+++ LANG=en_US.UTF-8 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:+++ unset LANG_backup config 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n '' ']' 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' dumb = linux ']' 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/less.sh 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:++ for i in /etc/profile.d/*.sh 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '' ']' 2024-09-21T13:40:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:++ . /etc/profile.d/which2.sh 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:+++++ readlink /proc/77663/exe 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:++++ basename /usr/bin/bash 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_declare='declare -f' 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:+++ which_opt=-f 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export which_declare 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:+++ export -f which 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset i 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset -f pathmunge 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset rc 2024-09-21T13:40:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph_test_neorados_write_operations 2024-09-21T13:40:54.356 INFO:tasks.workunit.client.0.smithi002.stderr:+ sed 's/^/ write_operations: /' 2024-09-21T13:40:54.356 INFO:tasks.workunit.client.0.smithi002.stderr:+ tee ceph_test_neorados_write_operations.log 2024-09-21T13:40:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:54.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:54.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:54.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2414277242' entity='client.admin' cmd={"prefix":"quorum_status"} : dispatch 2024-09-21T13:40:54.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi002-77546-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:54.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi002-77546-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:54.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi002-77538-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:54.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi002-77538-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2414277242' entity='client.admin' cmd={"prefix":"quorum_status"} : dispatch 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi002-77546-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi002-77546-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi002-77538-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi002-77538-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2414277242' entity='client.admin' cmd={"prefix":"quorum_status"} : dispatch 2024-09-21T13:40:55.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi002-77546-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi002-77546-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi002-77538-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi002-77538-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi002-77546-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi002-77538-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: osdmap e66: 8 total, 8 up, 8 in 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi002-77546-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi002-77538-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi002-77546-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4226450212' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_smithi002-76384-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2450065314' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3204662134' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76976-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3892045129' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi002-76421-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2153502582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi002-76395-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3195587541' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi002-76731-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2370810815' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi002-76791-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2625487694' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi002-76734-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2994651067' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi002-76434-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi002-76921-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi002-76491-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/215675491' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi002-76797-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4200693795' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77021-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/402339769' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2596568106' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi002-76883-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3666693648' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi002-76813-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1493644076' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi002-77172-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76976-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi002-77538-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi002-76421-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi002-76734-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi002-76395-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi002-76921-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:55.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi002-76731-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi002-76791-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi002-76883-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi002-76434-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi002-76813-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi002-76491-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi002-77172-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi002-76797-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1778186949' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi002-76514-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.987 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77021-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.987 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3457876789' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi002-76501-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.987 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi002-76514-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:55.987 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi002-76501-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.070 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [----------] Global test environment set-up. 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [----------] 12 tests from AsioRados 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (1 ms) 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (0 ms) 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (6 ms) 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (17 ms) 2024-09-21T13:40:56.071 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (6 ms) 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (1 ms) 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (3 ms) 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (3 ms) 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (2 ms) 2024-09-21T13:40:56.072 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [----------] 12 tests from AsioRados (40 ms total) 2024-09-21T13:40:56.073 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: 2024-09-21T13:40:56.073 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [----------] Global test environment tear-down 2024-09-21T13:40:56.073 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (2133 ms total) 2024-09-21T13:40:56.073 INFO:tasks.workunit.client.0.smithi002.stdout: api_asio: [ PASSED ] 12 tests. 2024-09-21T13:40:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi002-77546-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi002-77538-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: osdmap e66: 8 total, 8 up, 8 in 2024-09-21T13:40:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi002-77546-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:40:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi002-77538-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi002-77546-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:40:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4226450212' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_smithi002-76384-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2450065314' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3204662134' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76976-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3892045129' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi002-76421-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2153502582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi002-76395-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3195587541' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi002-76731-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2370810815' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi002-76791-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2625487694' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi002-76734-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:56.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi002-77546-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:56.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi002-77538-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:56.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: osdmap e66: 8 total, 8 up, 8 in 2024-09-21T13:40:56.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi002-77546-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:40:56.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi002-77538-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:56.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectssmithi002-77546-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:40:56.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4226450212' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_smithi002-76384-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2450065314' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3204662134' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76976-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3892045129' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi002-76421-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2153502582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi002-76395-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3195587541' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi002-76731-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2370810815' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi002-76791-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2625487694' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi002-76734-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2994651067' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi002-76434-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi002-76921-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi002-76491-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/215675491' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi002-76797-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4200693795' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77021-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/402339769' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2596568106' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi002-76883-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3666693648' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi002-76813-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1493644076' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi002-77172-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76976-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi002-77538-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:56.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi002-76421-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi002-76734-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi002-76395-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi002-76921-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:56.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi002-76731-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2994651067' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi002-76434-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi002-76921-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:56.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi002-76491-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/215675491' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi002-76797-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4200693795' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77021-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/402339769' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2596568106' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi002-76883-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3666693648' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi002-76813-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1493644076' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi002-77172-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76976-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritesmithi002-77538-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_smithi002-76421-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi002-76734-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_smithi002-76395-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi002-76921-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:56.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi002-76731-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi002-76791-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi002-76883-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi002-76434-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi002-76813-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi002-76491-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi002-77172-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi002-76797-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1778186949' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi002-76514-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77021-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.108 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3457876789' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi002-76501-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.108 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi002-76514-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.108 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi002-76501-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi002-76791-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi002-76883-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi002-76434-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_smithi002-76813-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_smithi002-76491-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi002-77172-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi002-76797-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1778186949' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi002-76514-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77021-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3457876789' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi002-76501-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_smithi002-76514-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi002-76501-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:56.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-09-21T13:40:56.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [----------] Global test environment set-up. 2024-09-21T13:40:56.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [----------] 7 tests from LibRadosList 2024-09-21T13:40:56.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-09-21T13:40:56.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ OK ] LibRadosList.ListObjects (460 ms) 2024-09-21T13:40:56.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-21T13:40:56.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (45 ms) 2024-09-21T13:40:56.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-09-21T13:40:56.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: myset foo1,foo2,foo3 2024-09-21T13:40:56.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo1 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo2 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo3 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: myset foo1,foo4,foo5 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo4 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo5 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo1 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: myset foo6,foo7 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo7 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo6 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: ns1:foo4 2024-09-21T13:40:56.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: ns1:foo5 2024-09-21T13:40:56.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: ns2:foo7 2024-09-21T13:40:56.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: ns2:foo6 2024-09-21T13:40:56.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: ns1:foo1 2024-09-21T13:40:56.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: :foo1 2024-09-21T13:40:56.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: :foo2 2024-09-21T13:40:56.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: :foo3 2024-09-21T13:40:56.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (92 ms) 2024-09-21T13:40:56.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-09-21T13:40:56.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 1 0 2024-09-21T13:40:56.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 10 0 2024-09-21T13:40:56.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 13 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 7 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 14 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 0 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 15 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 11 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 5 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 8 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 6 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 3 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 4 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 12 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 9 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 2 0 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-21T13:40:56.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (79 ms) 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: x cursor=MIN 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=1 cursor=14:02547ec2:::1:head 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=10 cursor=14:52ea6a34:::10:head 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=13 cursor=14:566253c9:::13:head 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=7 cursor=14:5c6b0b28:::7:head 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=14 cursor=14:62a1935d:::14:head 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=0 cursor=14:6cac518f:::0:head 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=15 cursor=14:863748b0:::15:head 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=11 cursor=14:89d3ae78:::11:head 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=5 cursor=14:b29083e3:::5:head 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=8 cursor=14:bd63b0f1:::8:head 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=6 cursor=14:c4fdafeb:::6:head 2024-09-21T13:40:56.430 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=3 cursor=14:cfc208b3:::3:head 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=4 cursor=14:d83876eb:::4:head 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=12 cursor=14:de5d7c5f:::12:head 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=9 cursor=14:e960b815:::9:head 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > oid=2 cursor=14:f905c69b:::2:head 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: FIRST> seek to MIN oid=1 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=1 cursor=14:02547ec2:::1:head 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:02547ec2:::1:head 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:02547ec2:::1:head -> 1 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=10 cursor=14:52ea6a34:::10:head 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:52ea6a34:::10:head 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:52ea6a34:::10:head -> 10 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=13 cursor=14:566253c9:::13:head 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:566253c9:::13:head 2024-09-21T13:40:56.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:566253c9:::13:head -> 13 2024-09-21T13:40:56.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=7 cursor=14:5c6b0b28:::7:head 2024-09-21T13:40:56.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:5c6b0b28:::7:head 2024-09-21T13:40:56.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:5c6b0b28:::7:head -> 7 2024-09-21T13:40:56.494 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=14 cursor=14:62a1935d:::14:head 2024-09-21T13:40:56.494 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:62a1935d:::14:head 2024-09-21T13:40:56.494 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:62a1935d:::14:head -> 14 2024-09-21T13:40:56.494 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=0 cursor=14:6cac518f:::0:head 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:6cac518f:::0:head 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:6cac518f:::0:head -> 0 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=15 cursor=14:863748b0:::15:head 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:863748b0:::15:head 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:863748b0:::15:head -> 15 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=11 cursor=14:89d3ae78:::11:head 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:89d3ae78:::11:head 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:89d3ae78:::11:head -> 11 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=5 cursor=14:b29083e3:::5:head 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:b29083e3:::5:head 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:b29083e3:::5:head -> 5 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=8 cursor=14:bd63b0f1:::8:head 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:bd63b0f1:::8:head 2024-09-21T13:40:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:bd63b0f1:::8:head -> 8 2024-09-21T13:40:56.496 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=6 cursor=14:c4fdafeb:::6:head 2024-09-21T13:40:56.496 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:c4fdafeb:::6:head 2024-09-21T13:40:56.496 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:c4fdafeb:::6:head -> 6 2024-09-21T13:40:56.496 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=3 cursor=14:cfc208b3:::3:head 2024-09-21T13:40:56.496 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:cfc208b3:::3:head 2024-09-21T13:40:56.496 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:cfc208b3:::3:head -> 3 2024-09-21T13:40:56.496 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=4 cursor=14:d83876eb:::4:head 2024-09-21T13:40:56.496 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:d83876eb:::4:head 2024-09-21T13:40:56.496 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:d83876eb:::4:head -> 4 2024-09-21T13:40:56.496 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=12 cursor=14:de5d7c5f:::12:head 2024-09-21T13:40:56.496 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:de5d7c5f:::12:head 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:de5d7c5f:::12:head -> 12 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=9 cursor=14:e960b815:::9:head 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:e960b815:::9:head 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:e960b815:::9:head -> 9 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : oid=2 cursor=14:f905c69b:::2:head 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:f905c69b:::2:head 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:f905c69b:::2:head -> 2 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:863748b0:::15:head 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:863748b0:::15:head expected=14:863748b0:::15:head 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:863748b0:::15:head -> 15 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=15 expected=15 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:d83876eb:::4:head 2024-09-21T13:40:56.497 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:d83876eb:::4:head expected=14:d83876eb:::4:head 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:d83876eb:::4:head -> 4 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=4 expected=4 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:cfc208b3:::3:head 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:cfc208b3:::3:head expected=14:cfc208b3:::3:head 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:cfc208b3:::3:head -> 3 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=3 expected=3 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:c4fdafeb:::6:head 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:c4fdafeb:::6:head expected=14:c4fdafeb:::6:head 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:c4fdafeb:::6:head -> 6 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=6 expected=6 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:bd63b0f1:::8:head 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:bd63b0f1:::8:head expected=14:bd63b0f1:::8:head 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:bd63b0f1:::8:head -> 8 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=8 expected=8 2024-09-21T13:40:56.498 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:b29083e3:::5:head 2024-09-21T13:40:56.499 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:b29083e3:::5:head expected=14:b29083e3:::5:head 2024-09-21T13:40:56.499 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:b29083e3:::5:head -> 5 2024-09-21T13:40:56.499 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=5 expected=5 2024-09-21T13:40:56.499 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:89d3ae78:::11:head 2024-09-21T13:40:56.499 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:89d3ae78:::11:head expected=14:89d3ae78:::11:head 2024-09-21T13:40:56.499 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:89d3ae78:::11:head -> 11 2024-09-21T13:40:56.499 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=11 expected=11 2024-09-21T13:40:56.499 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:6cac518f:::0:head 2024-09-21T13:40:56.499 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:6cac518f:::0:head expected=14:6cac518f:::0:head 2024-09-21T13:40:56.499 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:6cac518f:::0:head -> 0 2024-09-21T13:40:56.669 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=0 cls: Running main() from gmock_main.cc 2024-09-21T13:40:56.669 INFO:tasks.workunit.client.0.smithi002.stdout: cls: [==========] Running 1 test from 1 test suite. 2024-09-21T13:40:56.669 INFO:tasks.workunit.client.0.smithi002.stdout: cls: [----------] Global test environment set-up. 2024-09-21T13:40:56.669 INFO:tasks.workunit.client.0.smithi002.stdout: cls: [----------] 1 test from NeoRadosCls 2024-09-21T13:40:56.669 INFO:tasks.workunit.client.0.smithi002.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-09-21T13:40:56.669 INFO:tasks.workunit.client.0.smithi002.stdout: cls: [ OK ] NeoRadosCls.DNE (2465 ms) 2024-09-21T13:40:56.669 INFO:tasks.workunit.client.0.smithi002.stdout: cls: [----------] 1 test from NeoRadosCls (2465 ms total) 2024-09-21T13:40:56.669 INFO:tasks.workunit.client.0.smithi002.stdout: cls: 2024-09-21T13:40:56.669 INFO:tasks.workunit.client.0.smithi002.stdout: cls: [----------] Global test environment tear-down 2024-09-21T13:40:56.670 INFO:tasks.workunit.client.0.smithi002.stdout: cls: [==========] 1 test from 1 test suite ran. (2465 ms total) 2024-09-21T13:40:56.670 INFO:tasks.workunit.client.0.smithi002.stdout: cls: [ PASSED ] 1 test. 2024-09-21T13:40:56.672 INFO:tasks.workunit.client.0.smithi002.stdout: handler_error: Running main() from gmock_main.cc 2024-09-21T13:40:56.672 INFO:tasks.workunit.client.0.smithi002.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-09-21T13:40:56.672 INFO:tasks.workunit.client.0.smithi002.stdout: handler_error: [----------] Global test environment set-up. 2024-09-21T13:40:56.672 INFO:tasks.workunit.client.0.smithi002.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-09-21T13:40:56.672 INFO:tasks.workunit.client.0.smithi002.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-09-21T13:40:56.672 INFO:tasks.workunit.client.0.smithi002.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (2413 ms) 2024-09-21T13:40:56.672 INFO:tasks.workunit.client.0.smithi002.stdout: handler_error: [----------] 1 test from neocls_handler_error (2413 ms total) 2024-09-21T13:40:56.672 INFO:tasks.workunit.client.0.smithi002.stdout: handler_error: 2024-09-21T13:40:56.672 INFO:tasks.workunit.client.0.smithi002.stdout: handler_error: [----------] Global test environment tear-down 2024-09-21T13:40:56.672 INFO:tasks.workunit.client.0.smithi002.stdout: handler_error: [==========] 1 test from 1 test suite ran. (2413 ms total) 2024-09-21T13:40:56.672 INFO:tasks.workunit.client.0.smithi002.stdout: handler_error: [ PASSED ] 1 test. 2024-09-21T13:40:56.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: Running main() from gmock_main.cc 2024-09-21T13:40:56.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (330 ms) 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (32 ms) 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (15 ms) 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (52 ms) 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-09-21T13:40:56.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (11 ms) 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (8 ms) 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (7 ms) 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (7 ms) 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (3 ms) 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (6 ms) 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (6 ms) 2024-09-21T13:40:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (7 ms) 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (14 ms) 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (15 ms) 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (9 ms) 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (4 ms) 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (527 ms total) 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (2523 ms total) 2024-09-21T13:40:56.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-09-21T13:40:56.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-09-21T13:40:56.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-09-21T13:40:56.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-09-21T13:40:56.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-09-21T13:40:56.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-09-21T13:40:56.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (57 ms) 2024-09-21T13:40:56.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-09-21T13:40:56.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (83 ms) 2024-09-21T13:40:56.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-09-21T13:40:56.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (2438 ms) 2024-09-21T13:40:56.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (2578 ms total) 2024-09-21T13:40:56.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: 2024-09-21T13:40:56.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-09-21T13:40:56.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (2578 ms total) 2024-09-21T13:40:56.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-09-21T13:40:56.883 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: Running main() from gmock_main.cc 2024-09-21T13:40:56.883 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [----------] Global test environment set-up. 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (48 ms) 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (73 ms) 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (2467 ms) 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.626613+0000 mon.a [WRN] Health check failed: 34 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.637787+0000 mon.a [INF] from='client.? 172.21.15.2:0/4226450212' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi002-76384-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.637839+0000 mon.a [INF] from='client.? 172.21.15.2:0/2450065314' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.637870+0000 mon.a [INF] from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.884 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.637910+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76976-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.885 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638017+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi002-76421-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.885 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638086+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi002-76734-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.885 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638157+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi002-76395-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.885 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638285+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi002-76731-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.885 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638375+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.885 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638436+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi002-76791-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.885 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638479+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi002-76883-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.885 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638517+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi002-76434-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_1_[77270]: starting. 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_1_[77270]: creating pool ceph_test_rados_list_parallel.smithi002-77221 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_1_[77270]: created object 0... 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_1_[77270]: created object 25... 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_1_[77270]: created object 49... 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_1_[77270]: finishing. 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_1_[77270]: shutting down. 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_2_[77272]: starting. 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_2_[77272]: listing objects. 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_2_[77272]: listed object 0... 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_2_[77272]: listed object 25... 2024-09-21T13:40:56.932 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_2_[77272]: saw 50 objects 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_2_[77272]: shutting down. 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_3_[77986]: starting. 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_3_[77986]: creating pool ceph_test_rados_list_parallel.smithi002-77221 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_3_[77986]: created object 0... 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_3_[77986]: created object 25... 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_3_[77986]: created object 49... 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_3_[77986]: finishing. 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_3_[77986]: shutting down. 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_4_[77987]: starting. 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_4_[77987]: listing objects. 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_4_[77987]: listed object 0... 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_4_[77987]: listed object 25... 2024-09-21T13:40:56.933 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_4_[77987]: saw 42 objects 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_4_[77987]: shutting down. 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_5_[77988]: starting. 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_5_[77988]: removed 25 objects... 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_5_[77988]: removed half of the objects 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_5_[77988]: removed 50 objects... 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_5_[77988]: removed 50 objects 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_5_[77988]: shutting down. 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_6_[78034]: starting. 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_6_[78034]: creating pool ceph_test_rados_list_parallel.smithi002-77221 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_6_[78034]: created object 0... 2024-09-21T13:40:56.934 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_6_[78034]: created object 25... 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_6_[78034]: created object 49... 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_6_[78034]: finishing. 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_6_[78034]: shutting down. 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_7_[78035]: starting. 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_7_[78035]: listing objects. 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_7_[78035]: listed object 0... 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_7_[78035]: listed object 25... 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_7_[78035]: listed object 50... 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_7_[78035]: saw 56 objects 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_7_[78035]: shutting down. 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:56.935 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_8_[78036]: starting. 2024-09-21T13:40:56.936 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_8_[78036]: added 25 objects... 2024-09-21T13:40:56.936 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_8_[78036]: added half of the objects 2024-09-21T13:40:56.936 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_8_[78036]: added 50 objects... 2024-09-21T13:40:56.936 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_8_[78036]: added 50 objects 2024-09-21T13:40:56.936 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_8_[78036]: shutting down. 2024-09-21T13:40:56.936 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:56.936 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: pgmap v50: 1220 pgs: 1088 unknown, 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:40:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: Health check failed: 34 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:40:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4226450212' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi002-76384-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2450065314' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76976-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi002-76421-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi002-76734-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi002-76395-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi002-76731-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi002-76791-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi002-76883-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi002-76434-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi002-76813-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi002-76491-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi002-77172-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi002-76797-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77021-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi002-76514-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi002-76501-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:56.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: osdmap e67: 8 total, 8 up, 8 in 2024-09-21T13:40:56.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:40:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: pgmap v50: 1220 pgs: 1088 unknown, 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:40:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: Health check failed: 34 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:40:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4226450212' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi002-76384-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2450065314' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76976-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi002-76421-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi002-76734-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi002-76395-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi002-76731-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi002-76791-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi002-76883-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi002-76434-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi002-76813-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi002-76491-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi002-77172-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi002-76797-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: pgmap v50: 1220 pgs: 1088 unknown, 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:40:57.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: Health check failed: 34 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:40:57.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4226450212' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi002-76384-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2450065314' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76976-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi002-76421-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi002-76734-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi002-76395-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi002-76731-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi002-76791-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi002-76883-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi002-76434-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi002-76813-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi002-76491-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi002-77172-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi002-76797-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77021-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi002-76514-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi002-76501-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: osdmap e67: 8 total, 8 up, 8 in 2024-09-21T13:40:57.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:40:57.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77021-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi002-76514-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi002-76501-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: osdmap e67: 8 total, 8 up, 8 in 2024-09-21T13:40:57.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:40:57.154 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.154 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_9_[78082]: starting. 2024-09-21T13:40:57.154 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_9_[78082]: creating pool ceph_test_rados_list_parallel.smithi002-77221 2024-09-21T13:40:57.154 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_9_[78082]: created object 0... 2024-09-21T13:40:57.154 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_9_[78082]: created object 25... 2024-09-21T13:40:57.154 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_9_[78082]: created object 49... 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_9_[78082]: finishing. 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_9_[78082]: shutting down. 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_10_[78083]: starting. 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_10_[78083]: listing objects. 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_10_[78083]: listed object 0... 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_10_[78083]: listed object 25... 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_10_[78083]: listed object 50... 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_10_[78083]: listed object 75... 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_10_[78083]: saw 100 objects 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_10_[78083]: shutting down. 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.155 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_12_[78085]: starting. 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_12_[78085]: added 25 objects... 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_12_[78085]: added half of the objects 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_12_[78085]: added 50 objects... 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_12_[78085]: added 50 objects 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_12_[78085]: shutting down. 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_11_[78084]: starting. 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_11_[78084]: added 25 objects... 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_11_[78084]: added half of the objects 2024-09-21T13:40:57.156 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_11_[78084]: added 50 objects... 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_11_[78084]: added 50 objects 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_11_[78084]: shutting down. 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_13_[78086]: starting. 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_13_[78086]: removed 25 objects... 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_13_[78086]: removed half of the objects 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_13_[78086]: removed 50 objects... 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_13_[78086]: removed 50 objects 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_13_[78086]: shutting down. 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.157 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_14_[78464]: starting. 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_14_[78464]: creating pool ceph_test_rados_list_parallel.smithi002-77221 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_14_[78464]: created object 0... 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_14_[78464]: created object 25... 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_14_[78464]: created object 49... 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_14_[78464]: finishing. 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_14_[78464]: shutting down. 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_15_[78465]: starting. 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_15_[78465]: listing objects. 2024-09-21T13:40:57.158 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_15_[78465]: listed object 0... 2024-09-21T13:40:57.665 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_15_[78465]: listed object api_cmd: got: 2024-09-21T13:40:55.638556+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi002-76813-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638599+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi002-76491-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638640+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi002-77172-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638679+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi002-76797-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638718+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77021-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638755+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi002-76514-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:55.638794+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi002-76501-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.648279+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi002-77546-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi002-77546-1"}]': finished 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.648353+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi002-77538-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.648422+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi002-76921-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"}]': finished 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.661250+0000 mon.b [INF] from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.668947+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:57.666 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.788919+0000 mon.b [INF] from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.834452+0000 mon.c [INF] from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.835788+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.836049+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.840285+0000 mon.b [INF] from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.840885+0000 mon.c [INF] from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.848271+0000 mon.b [INF] from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.857642+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.863744+0000 mon.c [INF] from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.875179+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.875523+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.875836+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.876509+0000 mon.b [INF] from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi002-76421-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.877171+0000 mon.c [INF] from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.877599+0000 mon.b [INF] from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.879359+0000 client.admin [INF] onexx 2024-09-21T13:40:57.667 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.883817+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi002-76421-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.668 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.884168+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T13:40:57.668 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.884349+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.668 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.885107+0000 mon.b [INF] from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.886066+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-cod25... 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_15_[78465]: listed object 50... 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_15_[78465]: listed object 75... 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_15_[78465]: listed object 100... 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_15_[78465]: listed object 125... 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_15_[78465]: saw 150 objects 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_15_[78465]: shutting down. 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_16_[78466]: starting. 2024-09-21T13:40:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_16_[78466]: added 25 objects... 2024-09-21T13:40:57.694 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_16_[78466]: added half of the objects 2024-09-21T13:40:57.694 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_16_[78466]: added 50 objects... 2024-09-21T13:40:57.694 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_16_[78466]: added 50 objects 2024-09-21T13:40:57.694 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: process_16_[78466]: shutting down. 2024-09-21T13:40:57.694 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.694 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.694 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.694 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.694 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******************************* 2024-09-21T13:40:57.694 INFO:tasks.workunit.client.0.smithi002.stdout: list_parallel: ******* SUCCESS ********** 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi002-77546-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi002-77546-1"}]': finished 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi002-77538-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi002-76921-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"}]': finished 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: osdmap e68: 8 total, 8 up, 8 in 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi002-77546-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi002-77546-1"}]': finished 2024-09-21T13:40:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi002-77538-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:40:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi002-76921-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"}]': finished 2024-09-21T13:40:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: osdmap e68: 8 total, 8 up, 8 in 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi002-76421-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T13:40:57.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: onexx 2024-09-21T13:40:57.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi002-76421-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T13:40:57.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi002-76813-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi002-76813-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi002-76421-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: onexx 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi002-76421-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T13:40:57.855 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.856 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.856 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.856 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.856 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.856 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.856 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.856 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi002-76813-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.856 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi002-76813-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.856 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:40:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi002-77546-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi002-77546-1"}]': finished 2024-09-21T13:40:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi002-77538-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:40:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi002-76921-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"}]': finished 2024-09-21T13:40:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: osdmap e68: 8 total, 8 up, 8 in 2024-09-21T13:40:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi002-76421-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: onexx 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi002-76421-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:57.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi002-76813-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi002-76813-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:57.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:40:58.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:40:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: pgmap v53: 636 pgs: 504 unknown, 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi002-76421-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi002-76813-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi002-76421-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi002-76813-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: osdmap e69: 8 total, 8 up, 8 in 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi002-76421-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi002-76813-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2441929276' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/739713324' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi002-76384-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi002-76791-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/655436286' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/20945394' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: twoxx 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi002-76791-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:58.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T13:40:58.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:58.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:58.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi002-76384-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:58.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:58.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:58.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:58.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:58.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:40:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: pgmap v53: 636 pgs: 504 unknown, 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi002-76421-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi002-76813-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi002-76421-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi002-76813-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: osdmap e69: 8 total, 8 up, 8 in 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi002-76421-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi002-76813-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2441929276' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/739713324' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi002-76384-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: pgmap v53: 636 pgs: 504 unknown, 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:40:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi002-76421-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi002-76813-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi002-76421-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi002-76813-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: osdmap e69: 8 total, 8 up, 8 in 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi002-76421-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi002-76813-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2441929276' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/739713324' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi002-76384-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi002-76791-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:59.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/655436286' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/20945394' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: twoxx 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi002-76791-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi002-76384-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:59.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:59.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:40:59.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi002-76791-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:59.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T13:40:59.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/655436286' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/20945394' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: twoxx 2024-09-21T13:40:59.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:59.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi002-76791-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:40:59.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2024-09-21T13:40:59.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:59.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_smithi002-76384-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:40:59.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:40:59.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:40:59.714 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_1_[77437]: starting. 2024-09-21T13:40:59.714 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_1_[77437]: creating pool ceph_test_rados_delete_pools_parallel.smithi002-77350 2024-09-21T13:40:59.714 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_1_[77437]: created object 0... 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_1_[77437]: created object 25... 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_1_[77437]: created object 49... 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_1_[77437]: finishing. 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_1_[77437]: shutting down. 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_2_[77438]: starting. 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_2_[77438]: deleting pool ceph_test_rados_delete_pools_parallel.smithi002-77350 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_2_[77438]: shutting down. 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: ******************************* 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_3_[78167]: starting. 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_3_[78167]: creating pool ceph_test_rados_delete_pools_parallel.smithi002-77350 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_3_[78167]: created object 0... 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_3_[78167]: created object 25... 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_3_[78167]: created object 49... 2024-09-21T13:40:59.715 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_3_[78167]: finishing. 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_3_[78167]: shutting down. 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: ******************************* 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_5_[78169]: starting. 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_5_[78169]: listing objects. 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_5_[78169]: listed object 0... 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_5_[78169]: listed object 25... 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_5_[78169]: saw 50 objects 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_5_[78169]: shutting down. 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: ******************************* 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_4_[78168]: starting. 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_4_[78168]: deleting pool ceph_test_rados_delete_pools_parallel.smithi002-77350 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: process_4_[78168]: shutting down. 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: ******************************* 2024-09-21T13:40:59.716 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: ******************************* 2024-09-21T13:40:59.717 INFO:tasks.workunit.client.0.smithi002.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-09-21T13:40:59.717 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_1_[77378]: starting. 2024-09-21T13:40:59.717 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_1_[77378]: creating pool ceph_test_rados_open_pools_parallel.smithi002-77278 2024-09-21T13:40:59.717 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_1_[77378]: created object 0... 2024-09-21T13:40:59.717 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_1_[77378]: created object 25... 2024-09-21T13:40:59.717 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_1_[77378]: created object 49... 2024-09-21T13:40:59.717 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_1_[77378]: finishing. 2024-09-21T13:40:59.717 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_1_[77378]: shutting down. 2024-09-21T13:40:59.717 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_2_[77379]: starting. 2024-09-21T13:40:59.717 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_2_[77379]: rados_pool_create. 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_2_[77379]: rados_ioctx_create. 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_2_[77379]: shutting down. 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: ******************************* 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_3_[78162]: starting. 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_3_[78162]: creating pool ceph_test_rados_open_pools_parallel.smithi002-77278 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_3_[78162]: created object 0... 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_3_[78162]: created object 25... 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_3_[78162]: created object 49... 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_3_[78162]: finishing. 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_3_[78162]: shutting down. 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: ******************************* 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_4_[78163]: starting. 2024-09-21T13:40:59.718 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_4_[78163]: rados_pool_create. 2024-09-21T13:40:59.719 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_4_[78163]: rados_ioctx_create. 2024-09-21T13:40:59.719 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: process_4_[78163]: shutting down. 2024-09-21T13:40:59.719 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: ******************************* 2024-09-21T13:40:59.719 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: ******************************* 2024-09-21T13:40:59.719 INFO:tasks.workunit.client.0.smithi002.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-09-21T13:40:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:40:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-21T13:40:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:40:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi002-76384-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: osdmap e70: 8 total, 8 up, 8 in 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.0"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.1"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.2"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.3"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.4"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.5"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.6"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.7"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.8"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.9"} : dispatch 2024-09-21T13:40:59.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: 15.0 deep-scrub starts 2024-09-21T13:40:59.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: 15.0 deep-scrub ok 2024-09-21T13:40:59.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: 15.4 deep-scrub starts 2024-09-21T13:40:59.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: 15.4 deep-scrub ok 2024-09-21T13:40:59.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/904218922' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T13:40:59.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: 15.6 deep-scrub starts 2024-09-21T13:40:59.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: 15.6 deep-scrub ok 2024-09-21T13:40:59.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:40:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:40:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:41:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi002-76384-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: osdmap e70: 8 total, 8 up, 8 in 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-21T13:41:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:41:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi002-76384-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: osdmap e70: 8 total, 8 up, 8 in 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:00.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.0"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.1"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.2"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.3"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.4"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.5"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.6"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.7"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.8"} : dispatch 2024-09-21T13:41:00.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.9"} : dispatch 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: 15.0 deep-scrub starts 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: 15.0 deep-scrub ok 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: 15.4 deep-scrub starts 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: 15.4 deep-scrub ok 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/904218922' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: 15.6 deep-scrub starts 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: 15.6 deep-scrub ok 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.0"} : dispatch 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.1"} : dispatch 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.2"} : dispatch 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.3"} : dispatch 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.4"} : dispatch 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.5"} : dispatch 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.6"} : dispatch 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.7"} : dispatch 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.8"} : dispatch 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.9"} : dispatch 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: 15.0 deep-scrub starts 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: 15.0 deep-scrub ok 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: 15.4 deep-scrub starts 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: 15.4 deep-scrub ok 2024-09-21T13:41:00.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/904218922' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T13:41:00.107 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: 15.6 deep-scrub starts 2024-09-21T13:41:00.107 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: 15.6 deep-scrub ok 2024-09-21T13:41:00.107 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:40:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:00.678 INFO:tasks.workunit.client.0.smithi002.stdout:e-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.888340+0000 mon.b [INF] from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.888882+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.892939+0000 mon.b [INF] from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.893516+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.894521+0000 mon.b [INF] from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi002-76813-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:56.894999+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi002-76813-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.672895+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.679884+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.679942+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.679979+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi002-76384-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.680023+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.680085+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.687552+0000 mon.c [INF] from='client.? 172.21.15.2:0/3334620466' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.706211+0000 mon.b [INF] from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.714606+0000 mon.b [INF] from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.718403+0000 mon.c [INF] from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.734370+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.735038+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.735532+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.735810+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.769780+0000 mon.a [INF] from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.785140+0000 mon.a [INF] from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.789365+0000 mon.b [INF] from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.789933+0000 mon.a [INF] from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.796003+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.804058+0000 mon.b [INF] from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.814444+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.818664+0000 mon.b [INF] from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.827142+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.954293+0000 mon.a [INF] from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.0"} : dispatch 2024-09-21T13:41:00.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.955063+0000 mon.a [INF] from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.1"} : dispatch 2024-09-21T13:41:00.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.955651+0000 mon.a [INF] from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.2"} : dispatch 2024-09-21T13:41:00.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.956337+0000 mon.a [INF] from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.3"} : dispatch 2024-09-21T13:41:00.694 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.957005+0000 mon.a [INF] from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.4"} : dispatch 2024-09-21T13:41:00.694 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.957585+0000 mon.a [INF] from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.5"} : dispatch 2024-09-21T13:41:00.694 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.958086+0000 mon.a [INF] from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.6"} : dispatch 2024-09-21T13:41:00.694 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.958658+0000 mon.a [INF] from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.7"} : dispatch 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.959244+0000 mon.a [INF] from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.8"} : dispatch 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:58.959895+0000 mon.a [INF] from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.9"} : dispatch 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.686829+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi002-76421-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi002-76421-16"}]': finished 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.686927+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi002-76813-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi002-76813-7"}]': finished 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.686985+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.687050+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi002-76791-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi002-76791-7"}]': finished 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.687113+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.687178+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"}]': finished 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.687266+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.687339+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"}]': finished 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.687387+0000 mon.a [INF] from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:00.695 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.687444+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:00.737 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.693885+0000 mon.c [INF] from='client.? 172.21.15.2:0/1905322988' cmd: Running main() from gmock_main.cc 2024-09-21T13:41:00.737 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-09-21T13:41:00.737 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [----------] Global test environment set-up. 2024-09-21T13:41:00.737 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-09-21T13:41:00.737 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-09-21T13:41:00.737 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (1458 ms) 2024-09-21T13:41:00.738 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-09-21T13:41:00.738 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (1983 ms) 2024-09-21T13:41:00.738 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-09-21T13:41:00.738 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (3054 ms) 2024-09-21T13:41:00.738 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [----------] 3 tests from NeoRadosCmd (6495 ms total) 2024-09-21T13:41:00.738 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: 2024-09-21T13:41:00.738 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [----------] Global test environment tear-down 2024-09-21T13:41:00.738 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [==========] 3 tests from 1 test suite ran. (6495 ms total) 2024-09-21T13:41:00.738 INFO:tasks.workunit.client.0.smithi002.stdout: cmd: [ PASSED ] 3 tests. 2024-09-21T13:41:00.853 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: Running main() from gmock_main.cc 2024-09-21T13:41:00.853 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2024-09-21T13:41:00.853 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [----------] Global test environment set-up. 2024-09-21T13:41:00.853 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2024-09-21T13:41:00.853 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: seed 76434 2024-09-21T13:41:00.853 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-09-21T13:41:00.853 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-21T13:41:00.853 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-21T13:41:00.853 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (375 ms) 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (28 ms) 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (6 ms) 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (367 ms) 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (6 ms) 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (2 ms) 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (2 ms) 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-21T13:41:00.854 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (4 ms) 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (5 ms) 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (3 ms) 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (5 ms) 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (4 ms) 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (4 ms) 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (4 ms) 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (4 ms) 2024-09-21T13:41:00.855 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (8 ms) 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (4 ms) 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (3 ms) 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (5 ms) 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (2 ms) 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (5 ms) 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (846 ms total) 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: 2024-09-21T13:41:00.856 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2024-09-21T13:41:00.857 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-21T13:41:00.857 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1139 ms) 2024-09-21T13:41:00.857 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-21T13:41:00.857 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (11 ms) 2024-09-21T13:41:00.857 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-21T13:41:00.857 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (4 ms) 2024-09-21T13:41:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-09-21T13:41:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-09-21T13:41:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-09-21T13:41:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-09-21T13:41:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-09-21T13:41:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: pgmap v56: 868 pgs: 352 creating+peering, 128 unknown, 388 active+clean; 73 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 18 MiB/s wr, 544 op/s 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi002-76421-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi002-76421-16"}]': finished 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi002-76813-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi002-76813-7"}]': finished 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi002-76791-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi002-76791-7"}]': finished 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"}]': finished 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"}]': finished 2024-09-21T13:41:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: 15.1 deep-scrub starts 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: 15.1 deep-scrub ok 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: osdmap e71: 8 total, 8 up, 8 in 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi002-76501-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi002-76514-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi002-76514-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2441929276' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:00.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi002-77538-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi002-77538-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: 15.3 deep-scrub starts 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: 15.3 deep-scrub ok 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: 15.2 deep-scrub starts 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: 15.2 deep-scrub ok 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: 15.7 deep-scrub starts 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: 15.7 deep-scrub ok 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: threexx 2024-09-21T13:41:00.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T13:41:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: pgmap v56: 868 pgs: 352 creating+peering, 128 unknown, 388 active+clean; 73 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 18 MiB/s wr, 544 op/s 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi002-76421-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi002-76421-16"}]': finished 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi002-76813-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi002-76813-7"}]': finished 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi002-76791-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi002-76791-7"}]': finished 2024-09-21T13:41:01.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:41:01.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"}]': finished 2024-09-21T13:41:01.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:01.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"}]': finished 2024-09-21T13:41:01.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: 15.1 deep-scrub starts 2024-09-21T13:41:01.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:01.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-09-21T13:41:01.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-09-21T13:41:01.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-09-21T13:41:01.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-09-21T13:41:01.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: pgmap v56: 868 pgs: 352 creating+peering, 128 unknown, 388 active+clean; 73 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 18 MiB/s wr, 544 op/s 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi002-76421-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi002-76421-16"}]': finished 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi002-76813-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi002-76813-7"}]': finished 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi002-76791-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi002-76791-7"}]': finished 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi002-77538-1"}]': finished 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi002-76921-1"}]': finished 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi002-77546-1"}]': finished 2024-09-21T13:41:01.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: 15.1 deep-scrub starts 2024-09-21T13:41:01.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:01.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:01.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: 15.1 deep-scrub ok 2024-09-21T13:41:01.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: osdmap e71: 8 total, 8 up, 8 in 2024-09-21T13:41:01.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:01.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi002-76501-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:01.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi002-76514-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:01.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:01.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi002-76514-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:01.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2441929276' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi002-77538-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi002-77538-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: 15.3 deep-scrub starts 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: 15.3 deep-scrub ok 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: 15.2 deep-scrub starts 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: 15.2 deep-scrub ok 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: 15.7 deep-scrub starts 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: 15.7 deep-scrub ok 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:01.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: threexx 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi002-76514-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: 15.1 deep-scrub ok 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: osdmap e71: 8 total, 8 up, 8 in 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1905322988' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi002-76501-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi002-76514-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi002-76514-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2441929276' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:01.106 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi002-77538-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi002-77538-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: 15.3 deep-scrub starts 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: 15.3 deep-scrub ok 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: 15.2 deep-scrub starts 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: 15.2 deep-scrub ok 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: 15.7 deep-scrub starts 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: 15.7 deep-scrub ok 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:01.107 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T13:41:01.108 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: threexx 2024-09-21T13:41:01.108 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T13:41:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-21T13:41:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T13:41:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: fourxx 2024-09-21T13:41:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T13:41:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"}]': finished 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi002-77546-1"}]': finished 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"}]': finished 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi002-77538-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: 15.5 deep-scrub starts 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-4", "overlaypool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi002-77538-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2441929276' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi002-76395-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: osdmap e72: 8 total, 8 up, 8 in 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-4", "overlaypool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi002-77538-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1466460003' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi002-76395-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T13:41:01.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2898018887' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi002-76384-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi002-76384-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/244396846' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi002-77546-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi002-77546-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi002-76434-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi002-76434-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: 15.8 deep-scrub starts 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: 15.8 deep-scrub ok 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2649975775' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T13:41:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-21T13:41:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T13:41:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: fourxx 2024-09-21T13:41:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"}]': finished 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi002-77546-1"}]': finished 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"}]': finished 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi002-77538-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: 15.5 deep-scrub starts 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-4", "overlaypool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi002-77538-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2441929276' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi002-76395-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: osdmap e72: 8 total, 8 up, 8 in 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-4", "overlaypool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi002-77538-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1466460003' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi002-76395-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T13:41:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2898018887' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi002-76384-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-21T13:41:02.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T13:41:02.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: fourxx 2024-09-21T13:41:02.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2024-09-21T13:41:02.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"}]': finished 2024-09-21T13:41:02.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi002-77546-1"}]': finished 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"}]': finished 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi002-77538-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: 15.5 deep-scrub starts 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-4", "overlaypool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi002-77538-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2441929276' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi002-76395-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: osdmap e72: 8 total, 8 up, 8 in 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-4", "overlaypool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOpsmithi002-77538-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1466460003' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi002-76395-3", "field": "max_bytes", "val": "4096"} : dispatch 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2898018887' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi002-76384-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi002-76384-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/244396846' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi002-77546-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:02.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi002-77546-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:02.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi002-76434-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T13:41:02.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi002-76434-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T13:41:02.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: 15.8 deep-scrub starts 2024-09-21T13:41:02.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: 15.8 deep-scrub ok 2024-09-21T13:41:02.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2649975775' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T13:41:02.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:02.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_smithi002-76384-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/244396846' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi002-77546-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:02.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi002-77546-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:02.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi002-76434-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T13:41:02.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi002-76434-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T13:41:02.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: 15.8 deep-scrub starts 2024-09-21T13:41:02.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: 15.8 deep-scrub ok 2024-09-21T13:41:02.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2649975775' entity='client.admin' cmd={"prefix":"status"} : dispatch 2024-09-21T13:41:02.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: ap list: Running main() from gmock_main.cc 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: list: [----------] Global test environment set-up. 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: list: [----------] 3 tests from NeoradosList 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: list: [ OK ] NeoradosList.ListObjects (2361 ms) 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: list: [ OK ] NeoradosList.ListObjectsNS (3030 ms) 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: list: [ OK ] NeoradosList.ListObjectsMany (3041 ms) 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: list: [----------] 3 tests from NeoradosList (8432 ms total) 2024-09-21T13:41:02.751 INFO:tasks.workunit.client.0.smithi002.stdout: list: 2024-09-21T13:41:02.752 INFO:tasks.workunit.client.0.smithi002.stdout: list: [----------] Global test environment tear-down 2024-09-21T13:41:02.752 INFO:tasks.workunit.client.0.smithi002.stdout: list: [==========] 3 tests from 1 test suite ran. (8432 ms total) 2024-09-21T13:41:02.752 INFO:tasks.workunit.client.0.smithi002.stdout: list: [ PASSED ] 3 tests. 2024-09-21T13:41:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: 15.5 deep-scrub ok 2024-09-21T13:41:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: pgmap v59: 900 pgs: 64 creating+peering, 448 unknown, 388 active+clean; 73 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 18 MiB/s wr, 544 op/s 2024-09-21T13:41:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: 15.9 deep-scrub starts 2024-09-21T13:41:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: 15.9 deep-scrub ok 2024-09-21T13:41:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-21T13:41:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi002-76501-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi002-76501-10"}]': finished 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi002-76514-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi002-76514-10"}]': finished 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-4", "overlaypool": "test-rados-api-smithi002-76734-4-cache"}]': finished 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi002-76395-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi002-76384-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi002-77546-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi002-76434-24", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-4-cache", "mode": "writeback"} : dispatch 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNSsmithi002-77546-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: osdmap e73: 8 total, 8 up, 8 in 2024-09-21T13:41:02.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:02.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:02.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:02.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-4-cache", "mode": "writeback"} : dispatch 2024-09-21T13:41:02.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNSsmithi002-77546-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:02.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:02.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:02.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:02.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:02.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: 15.5 deep-scrub ok 2024-09-21T13:41:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: pgmap v59: 900 pgs: 64 creating+peering, 448 unknown, 388 active+clean; 73 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 18 MiB/s wr, 544 op/s 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: 15.9 deep-scrub starts 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: 15.9 deep-scrub ok 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi002-76501-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi002-76501-10"}]': finished 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi002-76514-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi002-76514-10"}]': finished 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-4", "overlaypool": "test-rados-api-smithi002-76734-4-cache"}]': finished 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi002-76395-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi002-76384-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi002-77546-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi002-76434-24", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T13:41:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-4-cache", "mode": "writeback"} : dispatch 2024-09-21T13:41:03.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNSsmithi002-77546-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:03.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: osdmap e73: 8 total, 8 up, 8 in 2024-09-21T13:41:03.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:03.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: 15.5 deep-scrub ok 2024-09-21T13:41:03.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: pgmap v59: 900 pgs: 64 creating+peering, 448 unknown, 388 active+clean; 73 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 18 MiB/s wr, 544 op/s 2024-09-21T13:41:03.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: 15.9 deep-scrub starts 2024-09-21T13:41:03.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: 15.9 deep-scrub ok 2024-09-21T13:41:03.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi002-76501-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi002-76501-10"}]': finished 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi002-76514-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi002-76514-10"}]': finished 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-4", "overlaypool": "test-rados-api-smithi002-76734-4-cache"}]': finished 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi002-76395-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi002-76384-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi002-77546-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi002-76434-24", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-4-cache", "mode": "writeback"} : dispatch 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNSsmithi002-77546-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: osdmap e73: 8 total, 8 up, 8 in 2024-09-21T13:41:03.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:03.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:03.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:03.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-4-cache", "mode": "writeback"} : dispatch 2024-09-21T13:41:03.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNSsmithi002-77546-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:03.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:03.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:03.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:03.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:03.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:03.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:03.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-4-cache", "mode": "writeback"} : dispatch 2024-09-21T13:41:03.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNSsmithi002-77546-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:03.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:03.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:03.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:03.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:03.304 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: Running main() from gmock_main.cc 2024-09-21T13:41:03.304 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-09-21T13:41:03.304 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: [----------] Global test environment set-up. 2024-09-21T13:41:03.304 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-09-21T13:41:03.304 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-09-21T13:41:03.304 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: handle_notify cookie 94610445676944 notify_id 287762808832 notifier_gid 24845 2024-09-21T13:41:03.304 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (2314 ms) 2024-09-21T13:41:03.304 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-09-21T13:41:03.304 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: Trying... 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: handle_notify cookie 94610458383024 notify_id 300647710720 notifier_gid 24916 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: Waiting for 3.000000000s 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: Timed out. 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: Flushing... 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: Flushed... 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (6627 ms) 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (8941 ms total) 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: [----------] Global test environment tear-down 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (8941 ms total) 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: watch_notify: [ PASSED ] 2 tests. 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: Running main() from gmock_main.cc 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-09-21T13:41:03.305 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [----------] Global test environment set-up. 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (373 ms) 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: no timeout :/ 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: no timeout :/ 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: no timeout :/ 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: no timeout :/ 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: no timeout :/ 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (59 ms) 2024-09-21T13:41:03.306 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (9 ms) 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.Checksum (4 ms) 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (5 ms) 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (7 ms) 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (6 ms) 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (2 ms) 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.TruncTest (5 ms) 2024-09-21T13:41:03.307 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (4 ms) 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (8 ms) 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.RmXattr (12 ms) 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIo.XattrIter (6 ms) 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [----------] 14 tests from LibRadosIo (501 ms total) 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1136 ms) 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-09-21T13:41:03.308 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (5 ms) 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (6 ms) 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (4 ms) 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (7 ms) 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (4 ms) 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (3 ms) 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (4 ms) 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-09-21T13:41:03.309 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (10 ms) 2024-09-21T13:41:03.310 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-09-21T13:41:03.310 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (3 ms) 2024-09-21T13:41:03.310 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1182 ms total) 2024-09-21T13:41:03.310 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: 2024-09-21T13:41:03.310 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [----------] Global test environment tear-down 2024-09-21T13:41:03.310 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [==========] 24 tests from 2 test suites ran. (9420 ms total) 2024-09-21T13:41:03.310 INFO:tasks.workunit.client.0.smithi002.stdout: api_io: [ PASSED ] 24 tests. 2024-09-21T13:41:03.313 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-09-21T13:41:03.313 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-09-21T13:41:03.313 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-09-21T13:41:03.313 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-09-21T13:41:03.313 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: seed 76791 2024-09-21T13:41:03.313 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-09-21T13:41:03.313 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (365 ms) 2024-09-21T13:41:03.313 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-21T13:41:03.313 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (8 ms) 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (24 ms) 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (23 ms) 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (420 ms total) 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1141 ms) 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (2 ms) 2024-09-21T13:41:03.314 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-21T13:41:03.315 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (2 ms) 2024-09-21T13:41:03.315 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-09-21T13:41:03.315 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (8 ms) 2024-09-21T13:41:03.315 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1153 ms total) 2024-09-21T13:41:03.315 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: 2024-09-21T13:41:03.315 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-09-21T13:41:03.315 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (9280 ms total) 2024-09-21T13:41:03.315 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-09-21T13:41:03.319 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: Running main() from gmock_main.cc 2024-09-21T13:41:03.319 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-09-21T13:41:03.319 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [----------] Global test environment set-up. 2024-09-21T13:41:03.319 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-09-21T13:41:03.319 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-09-21T13:41:03.319 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ OK ] LibRadosStat.Stat (333 ms) 2024-09-21T13:41:03.319 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-09-21T13:41:03.319 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (73 ms) 2024-09-21T13:41:03.319 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ OK ] LibRadosStat.StatNS (14 ms) 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (4 ms) 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [----------] 5 tests from LibRadosStat (424 ms total) 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1130 ms) 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (10 ms) 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-09-21T13:41:03.320 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (1 ms) 2024-09-21T13:41:03.321 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-09-21T13:41:03.321 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (1 ms) 2024-09-21T13:41:03.321 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1142 ms total) 2024-09-21T13:41:03.321 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: 2024-09-21T13:41:03.321 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [----------] Global test environment tear-down 2024-09-21T13:41:03.321 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (9281 ms total) 2024-09-21T13:41:03.321 INFO:tasks.workunit.client.0.smithi002.stdout: api_stat: [ PASSED ] 9 tests. 2024-09-21T13:41:03.700 INFO:tasks.workunit.client.0.smithi002.stdout:entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:03.700 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.695332+0000 mon.a [INF] from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi002-76501-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:03.700 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.696269+0000 mon.b [INF] from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi002-76514-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:03.700 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.696494+0000 mon.b [INF] from='client.? 172.21.15.2:0/3354496540' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.697661+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi002-76514-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.698070+0000 mon.b [INF] from='client.? 172.21.15.2:0/2441929276' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.698133+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi002-76921-1"} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.698450+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectssmithi002-77546-1"} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.699493+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi002-76395-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.700334+0000 mon.b [INF] from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.704799+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.770310+0000 mon.c [INF] from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi002-77538-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:40:59.786349+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi002-77538-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:41:00.678551+0000 mon.c [INF] from='client.? 172.21.15.2:0/1480843327' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:41:00.678737+0000 client.admin [INF] threexx 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: got: 2024-09-21T13:41:00.678986+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T13:41:03.701 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (7025 ms) 2024-09-21T13:41:03.702 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (9613 ms total) 2024-09-21T13:41:03.702 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: 2024-09-21T13:41:03.702 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [----------] Global test environment tear-down 2024-09-21T13:41:03.702 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (9613 ms total) 2024-09-21T13:41:03.702 INFO:tasks.workunit.client.0.smithi002.stdout: api_cmd: [ PASSED ] 4 tests. 2024-09-21T13:41:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi002-77538-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi002-77538-2"}]': finished 2024-09-21T13:41:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-4-cache", "mode": "writeback"}]': finished 2024-09-21T13:41:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"}]': finished 2024-09-21T13:41:03.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"}]': finished 2024-09-21T13:41:03.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:03.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"}]': finished 2024-09-21T13:41:03.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:03.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:03.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:03.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: osdmap e74: 8 total, 8 up, 8 in 2024-09-21T13:41:03.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:03.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:03.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:03.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-4"} : dispatch 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-4"} : dispatch 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76921-6", "pg_num": 4} : dispatch 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76921-6", "pg_num": 4} : dispatch 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi002-77546-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi002-77546-2"}]': finished 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"}]': finished 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"}]': finished 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"}]': finished 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-4"}]': finished 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76921-6", "pg_num": 4}]': finished 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: osdmap e75: 8 total, 8 up, 8 in 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:03.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:03.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:03.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2201066126' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi002-76384-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi002-76384-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1287662174' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3439518389' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:03.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:04.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:04.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi002-77538-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi002-77538-2"}]': finished 2024-09-21T13:41:04.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-4-cache", "mode": "writeback"}]': finished 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"}]': finished 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"}]': finished 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"}]': finished 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: osdmap e74: 8 total, 8 up, 8 in 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-4"} : dispatch 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-4"} : dispatch 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76921-6", "pg_num": 4} : dispatch 2024-09-21T13:41:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76921-6", "pg_num": 4} : dispatch 2024-09-21T13:41:04.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi002-77546-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi002-77546-2"}]': finished 2024-09-21T13:41:04.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"}]': finished 2024-09-21T13:41:04.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"}]': finished 2024-09-21T13:41:04.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:04.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi002-77538-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi002-77538-2"}]': finished 2024-09-21T13:41:04.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-4-cache", "mode": "writeback"}]': finished 2024-09-21T13:41:04.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi002-76791-7"}]': finished 2024-09-21T13:41:04.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi002-76421-16"}]': finished 2024-09-21T13:41:04.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:04.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi002-76813-7"}]': finished 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1448699446' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4142031745' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2056998646' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: osdmap e74: 8 total, 8 up, 8 in 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"} : dispatch 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"} : dispatch 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"} : dispatch 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-4"} : dispatch 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-4"} : dispatch 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76921-6", "pg_num": 4} : dispatch 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76921-6", "pg_num": 4} : dispatch 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi002-77546-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi002-77546-2"}]': finished 2024-09-21T13:41:04.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi002-76421-16"}]': finished 2024-09-21T13:41:04.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi002-76791-7"}]': finished 2024-09-21T13:41:04.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"}]': finished 2024-09-21T13:41:04.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-4"}]': finished 2024-09-21T13:41:04.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76921-6", "pg_num": 4}]': finished 2024-09-21T13:41:04.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: osdmap e75: 8 total, 8 up, 8 in 2024-09-21T13:41:04.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:04.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:04.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:04.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:04.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2201066126' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi002-76384-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi002-76384-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1287662174' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3439518389' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.105 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:04.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi002-76813-7"}]': finished 2024-09-21T13:41:04.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-4"}]': finished 2024-09-21T13:41:04.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76921-6", "pg_num": 4}]': finished 2024-09-21T13:41:04.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: osdmap e75: 8 total, 8 up, 8 in 2024-09-21T13:41:04.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:04.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/593806306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:04.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:04.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"} : dispatch 2024-09-21T13:41:04.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2201066126' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi002-76384-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_smithi002-76384-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1287662174' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3439518389' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:04.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: pgmap v63: 784 pgs: 181 creating+peering, 39 unknown, 564 active+clean; 121 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2024-09-21T13:41:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"}]': finished 2024-09-21T13:41:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi002-76384-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:04.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "overlaypool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:04.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: osdmap e76: 8 total, 8 up, 8 in 2024-09-21T13:41:04.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:04.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "overlaypool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:04.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:04.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:04.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:04.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: pgmap v63: 784 pgs: 181 creating+peering, 39 unknown, 564 active+clean; 121 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2024-09-21T13:41:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"}]': finished 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi002-76384-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "overlaypool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: osdmap e76: 8 total, 8 up, 8 in 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "overlaypool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: pgmap v63: 784 pgs: 181 creating+peering, 39 unknown, 564 active+clean; 121 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2024-09-21T13:41:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-4", "tierpool": "test-rados-api-smithi002-76734-4-cache"}]': finished 2024-09-21T13:41:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi002-76384-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "overlaypool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:05.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: osdmap e76: 8 total, 8 up, 8 in 2024-09-21T13:41:05.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:05.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "overlaypool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:05.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:05.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:05.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:05.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:06.327 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: Running main() from gmock_main.cc 2024-09-21T13:41:06.327 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-09-21T13:41:06.327 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: [----------] Global test environment set-up. 2024-09-21T13:41:06.328 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-09-21T13:41:06.328 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-09-21T13:41:06.328 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (5389 ms) 2024-09-21T13:41:06.328 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-09-21T13:41:06.328 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (6627 ms) 2024-09-21T13:41:06.328 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (12017 ms total) 2024-09-21T13:41:06.328 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: 2024-09-21T13:41:06.328 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: [----------] Global test environment tear-down 2024-09-21T13:41:06.328 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (12017 ms total) 2024-09-21T13:41:06.328 INFO:tasks.workunit.client.0.smithi002.stdout: ec_io: [ PASSED ] 2 tests. 2024-09-21T13:41:06.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "overlaypool": "test-rados-api-smithi002-76921-6"}]': finished 2024-09-21T13:41:06.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi002-77538-2"}]': finished 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: osdmap e77: 8 total, 8 up, 8 in 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76921-6", "mode": "writeback"} : dispatch 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76921-6", "mode": "writeback"} : dispatch 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:06.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/611665088' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi002-76731-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:06.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi002-76731-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "overlaypool": "test-rados-api-smithi002-76921-6"}]': finished 2024-09-21T13:41:06.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:06.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi002-77538-2"}]': finished 2024-09-21T13:41:06.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: osdmap e77: 8 total, 8 up, 8 in 2024-09-21T13:41:06.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76921-6", "mode": "writeback"} : dispatch 2024-09-21T13:41:06.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:06.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76921-6", "mode": "writeback"} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/611665088' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi002-76731-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:06.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi002-76731-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: pgmap v66: 552 pgs: 4 creating+peering, 128 unknown, 420 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 21 MiB/s wr, 3 op/s 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:06.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:06.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: pgmap v66: 552 pgs: 4 creating+peering, 128 unknown, 420 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 21 MiB/s wr, 3 op/s 2024-09-21T13:41:06.605 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "overlaypool": "test-rados-api-smithi002-76921-6"}]': finished 2024-09-21T13:41:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi002-77538-2"}]': finished 2024-09-21T13:41:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: osdmap e77: 8 total, 8 up, 8 in 2024-09-21T13:41:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76921-6", "mode": "writeback"} : dispatch 2024-09-21T13:41:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1198975608' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2303220713' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOpsmithi002-77538-2"} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76921-6", "mode": "writeback"} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/611665088' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi002-76731-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi002-76731-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:06.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:06.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:06.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:06.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: pgmap v66: 552 pgs: 4 creating+peering, 128 unknown, 420 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 21 MiB/s wr, 3 op/s 2024-09-21T13:41:06.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:07.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: Running main() from gmock_main.cc 2024-09-21T13:41:07.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-09-21T13:41:07.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [----------] Global test environment set-up. 2024-09-21T13:41:07.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-09-21T13:41:07.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-09-21T13:41:07.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (397 ms) 2024-09-21T13:41:07.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-09-21T13:41:07.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLock.LockShared (9 ms) 2024-09-21T13:41:07.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1007 ms) 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1005 ms) 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (3 ms) 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLock.Unlock (3 ms) 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (5 ms) 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (3 ms) 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [----------] 8 tests from LibRadosLock (2432 ms total) 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: 2024-09-21T13:41:07.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1149 ms) 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (7 ms) 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1007 ms) 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1004 ms) 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (4 ms) 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (4 ms) 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (6 ms) 2024-09-21T13:41:07.341 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-09-21T13:41:07.342 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (3 ms) 2024-09-21T13:41:07.342 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3184 ms total) 2024-09-21T13:41:07.342 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: 2024-09-21T13:41:07.342 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [----------] Global test environment tear-down 2024-09-21T13:41:07.342 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (13409 ms total) 2024-09-21T13:41:07.342 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock: [ PASSED ] 16 tests. 2024-09-21T13:41:07.346 INFO:tasks.workunit.client.0.smithi002.stdout: pool: Running main() from gmock_main.cc 2024-09-21T13:41:07.346 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-09-21T13:41:07.346 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [----------] Global test environment set-up. 2024-09-21T13:41:07.346 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ OK ] NeoRadosPools.PoolList (1345 ms) 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (1984 ms) 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (2030 ms) 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (3605 ms) 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2021 ms) 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2015 ms) 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [----------] 6 tests from NeoRadosPools (13000 ms total) 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: 2024-09-21T13:41:07.347 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [----------] Global test environment tear-down 2024-09-21T13:41:07.348 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [==========] 6 tests from 1 test suite ran. (13000 ms total) 2024-09-21T13:41:07.348 INFO:tasks.workunit.client.0.smithi002.stdout: pool: [ PASSED ] 6 tests. 2024-09-21T13:41:07.356 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: seed 76501 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (300 ms) 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (68 ms) 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1012 ms) 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1008 ms) 2024-09-21T13:41:07.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (4 ms) 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (3 ms) 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (4 ms) 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (3 ms) 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2402 ms total) 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1123 ms) 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-21T13:41:07.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (21 ms) 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1005 ms) 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1004 ms) 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (4 ms) 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (5 ms) 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (5 ms) 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (3 ms) 2024-09-21T13:41:07.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3170 ms total) 2024-09-21T13:41:07.360 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: 2024-09-21T13:41:07.360 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-09-21T13:41:07.360 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (13426 ms total) 2024-09-21T13:41:07.360 INFO:tasks.workunit.client.0.smithi002.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-09-21T13:41:07.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:07.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi002-77538-2"}]': finished 2024-09-21T13:41:07.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76921-6", "mode": "writeback"}]': finished 2024-09-21T13:41:07.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10"}]': finished 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"}]': finished 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi002-77546-2"}]': finished 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi002-76731-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi002-76883-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: osdmap e78: 8 total, 8 up, 8 in 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2622450794' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3628231333' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi002-76384-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3225926364' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:07.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi002-76883-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:07.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:07.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi002-77538-2"}]': finished 2024-09-21T13:41:07.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76921-6", "mode": "writeback"}]': finished 2024-09-21T13:41:07.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10"}]': finished 2024-09-21T13:41:07.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:07.602 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"}]': finished 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi002-77546-2"}]': finished 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi002-76731-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi002-76883-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: osdmap e78: 8 total, 8 up, 8 in 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2622450794' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3628231333' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi002-76384-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3225926364' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi002-76883-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:07.603 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi002-76384-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd dump"} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.604 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:07.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:07.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:07.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi002-76384-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:07.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:07.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd dump"} : dispatch 2024-09-21T13:41:07.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi002-77538-2"}]': finished 2024-09-21T13:41:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76921-6", "mode": "writeback"}]': finished 2024-09-21T13:41:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi002-76501-10"}]': finished 2024-09-21T13:41:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi002-76514-10"}]': finished 2024-09-21T13:41:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi002-77546-2"}]': finished 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi002-76731-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi002-76883-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4122678749' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: osdmap e78: 8 total, 8 up, 8 in 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1411572632' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2622450794' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3628231333' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi002-76384-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3225926364' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi002-76501-10"} : dispatch 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi002-76883-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi002-77546-2"} : dispatch 2024-09-21T13:41:07.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_smithi002-76384-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd dump"} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:07.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:08.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:41:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi002-76501-10"}]': finished 2024-09-21T13:41:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi002-77546-2"}]': finished 2024-09-21T13:41:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"}]': finished 2024-09-21T13:41:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi002-76384-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2"} : dispatch 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: osdmap e79: 8 total, 8 up, 8 in 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi002-77546-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: pgmap v69: 648 pgs: 4 creating+peering, 288 unknown, 356 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: pool 'PoolQuotaPP_smithi002-76395-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-21T13:41:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:41:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi002-76883-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"}]': finished 2024-09-21T13:41:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi002-77546-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: osdmap e80: 8 total, 8 up, 8 in 2024-09-21T13:41:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsManysmithi002-77546-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi002-77546-3"} : dispatch 2024-09-21T13:41:08.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi002-76501-10"}]': finished 2024-09-21T13:41:08.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi002-77546-2"}]': finished 2024-09-21T13:41:08.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"}]': finished 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi002-76384-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2"} : dispatch 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: osdmap e79: 8 total, 8 up, 8 in 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi002-77546-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: pgmap v69: 648 pgs: 4 creating+peering, 288 unknown, 356 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: pool 'PoolQuotaPP_smithi002-76395-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-21T13:41:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:41:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4107924626' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi002-76501-10"}]': finished 2024-09-21T13:41:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi002-77546-2"}]': finished 2024-09-21T13:41:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi002-76514-10"}]': finished 2024-09-21T13:41:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi002-76384-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2"} : dispatch 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: osdmap e79: 8 total, 8 up, 8 in 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi002-77546-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: pgmap v69: 648 pgs: 4 creating+peering, 288 unknown, 356 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: pool 'PoolQuotaPP_smithi002-76395-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-21T13:41:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:41:08.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi002-76883-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"}]': finished 2024-09-21T13:41:08.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi002-77546-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:08.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: osdmap e80: 8 total, 8 up, 8 in 2024-09-21T13:41:08.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsManysmithi002-77546-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi002-77546-3"} : dispatch 2024-09-21T13:41:08.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi002-76883-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"}]': finished 2024-09-21T13:41:08.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi002-76538-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:08.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi002-77546-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:08.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: osdmap e80: 8 total, 8 up, 8 in 2024-09-21T13:41:08.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsManysmithi002-77546-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi002-77546-3"} : dispatch 2024-09-21T13:41:09.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-09-21T13:41:09.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-09-21T13:41:09.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-09-21T13:41:09.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-21T13:41:09.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-21T13:41:09.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: notify 2024-09-21T13:41:09.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1133 ms) 2024-09-21T13:41:09.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-21T13:41:09.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (5 ms) 2024-09-21T13:41:09.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1138 ms total) 2024-09-21T13:41:09.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: notify 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (161 ms) 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: notify 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3515 ms) 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (12 ms) 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (13 ms) 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-21T13:41:09.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: handle_notify cookie 94849419716128 notify_id 335007449091 notifier_gid 25153 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (6 ms) 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: handle_notify cookie 94849419728176 notify_id 335007449090 notifier_gid 25153 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (5 ms) 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: handle_notify cookie 94849419710592 notify_id 335007449090 notifier_gid 25153 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (5 ms) 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: handle_notify cookie 94849420514816 notify_id 335007449092 notifier_gid 25153 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (5 ms) 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: handle_notify cookie 94849420514816 notify_id 335007449091 notifier_gid 25153 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (4 ms) 2024-09-21T13:41:09.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-21T13:41:09.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: handle_notify cookie 94849420514816 notify_id 335007449092 notifier_gid 25153 2024-09-21T13:41:09.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (5 ms) 2024-09-21T13:41:09.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-21T13:41:09.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: trying... 2024-09-21T13:41:09.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: handle_notify cookie 94849420514816 notify_id 335007449093 notifier_gid 25153 2024-09-21T13:41:09.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: timed out 2024-09-21T13:41:09.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: flushing 2024-09-21T13:41:09.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"dne","key":"key","value":"value"} : dispatch 2024-09-21T13:41:09.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T13:41:09.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T13:41:09.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:09.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: osdmap e81: 8 total, 8 up, 8 in 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1250593560' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi002-76797-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/341229688' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/570805860' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2807783610' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip3_smithi002-76384-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi002-76797-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T13:41:09.671 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"dne","key":"key","value":"value"} : dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: osdmap e81: 8 total, 8 up, 8 in 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1250593560' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi002-76797-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/341229688' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/570805860' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2807783610' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip3_smithi002-76384-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi002-76797-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.673 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T13:41:09.673 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.673 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.673 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.673 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"dne","key":"key","value":"value"} : dispatch 2024-09-21T13:41:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T13:41:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T13:41:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi002-76434-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: osdmap e81: 8 total, 8 up, 8 in 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1250593560' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi002-76797-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/341229688' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/570805860' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2807783610' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip3_smithi002-76384-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi002-76797-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T13:41:09.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:09.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:10.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:41:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:41:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:41:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: pgmap v72: 696 pgs: 72 creating+peering, 232 unknown, 392 active+clean; 145 MiB data, 786 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 7.5 KiB/s wr, 6 op/s 2024-09-21T13:41:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi002-77546-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi002-77546-3"}]': finished 2024-09-21T13:41:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2807783610' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi002-76384-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi002-76797-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T13:41:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: osdmap e82: 8 total, 8 up, 8 in 2024-09-21T13:41:10.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:10.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:10.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:10.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:10.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1"} : dispatch 2024-09-21T13:41:10.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1"} : dispatch 2024-09-21T13:41:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: pgmap v72: 696 pgs: 72 creating+peering, 232 unknown, 392 active+clean; 145 MiB data, 786 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 7.5 KiB/s wr, 6 op/s 2024-09-21T13:41:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi002-77546-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi002-77546-3"}]': finished 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2807783610' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi002-76384-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi002-76797-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: osdmap e82: 8 total, 8 up, 8 in 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1"} : dispatch 2024-09-21T13:41:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1"} : dispatch 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: pgmap v72: 696 pgs: 72 creating+peering, 232 unknown, 392 active+clean; 145 MiB data, 786 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 7.5 KiB/s wr, 6 op/s 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi002-77546-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi002-77546-3"}]': finished 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2807783610' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi002-76384-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi002-76797-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: osdmap e82: 8 total, 8 up, 8 in 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:10.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2485729881' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1"} : dispatch 2024-09-21T13:41:10.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1"} : dispatch 2024-09-21T13:41:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"}]': finished 2024-09-21T13:41:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1"}]': finished 2024-09-21T13:41:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:11 smithi162 ceph-mon[33046]: osdmap e83: 8 total, 8 up, 8 in 2024-09-21T13:41:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:11.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:11.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:11.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"}]': finished 2024-09-21T13:41:11.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1"}]': finished 2024-09-21T13:41:11.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[40622]: osdmap e83: 8 total, 8 up, 8 in 2024-09-21T13:41:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:11.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:11.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:11.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi002-76883-12"}]': finished 2024-09-21T13:41:11.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi002-76538-1","app":"app1","key":"key1"}]': finished 2024-09-21T13:41:11.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[30076]: osdmap e83: 8 total, 8 up, 8 in 2024-09-21T13:41:11.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2849022755' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:11.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"} : dispatch 2024-09-21T13:41:11.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:11.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:12.367 INFO:tasks.workunit.client.0.smithi002.stdout: api_wa api_watch_notify: Running main() from gmock_main.cc 2024-09-21T13:41:12.367 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify_test_cb 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (400 ms) 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94841079356768 err -107 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (9 ms) 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94841079356768 err -107 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (13 ms) 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-21T13:41:12.368 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_cb from 24704 notify_id 287762808832 cookie 94841079371360 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (10 ms) 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_cb from 24704 notify_id 287762808833 cookie 94841079536112 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (15 ms) 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_cb from 24704 notify_id 287762808833 cookie 94841079541616 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (10 ms) 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_cb from 24704 notify_id 287762808833 cookie 94841079541616 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_cb from 24704 notify_id 287762808833 cookie 94841079555072 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (14 ms) 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_cb from 24704 notify_id 287762808834 cookie 94841079541616 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_cb from 24704 notify_id 292057776131 cookie 94841079541616 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3007 ms) 2024-09-21T13:41:12.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94841079554048 err -107 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_cb from 24704 notify_id 322122547202 cookie 94841079554048 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5008 ms) 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94841079554048 err -107 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1005 ms) 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (9491 ms total) 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: watch_notify_test_cb 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1081 ms) 2024-09-21T13:41:12.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1081 ms total) 2024-09-21T13:41:12.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: 2024-09-21T13:41:12.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-09-21T13:41:12.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (18303 ms total) 2024-09-21T13:41:12.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-09-21T13:41:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: pgmap v75: 560 pgs: 64 creating+peering, 104 unknown, 392 active+clean; 145 MiB data, 786 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 7.7 KiB/s wr, 7 op/s 2024-09-21T13:41:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"}]': finished 2024-09-21T13:41:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: osdmap e84: 8 total, 8 up, 8 in 2024-09-21T13:41:12.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:12.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/229130985' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:12.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:12.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:12.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:12.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:12.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/681166890' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi002-76384-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:12.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi002-76384-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:12.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: pgmap v75: 560 pgs: 64 creating+peering, 104 unknown, 392 active+clean; 145 MiB data, 786 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 7.7 KiB/s wr, 7 op/s 2024-09-21T13:41:12.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"}]': finished 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: osdmap e84: 8 total, 8 up, 8 in 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/229130985' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/681166890' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi002-76384-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi002-76384-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: pgmap v75: 560 pgs: 64 creating+peering, 104 unknown, 392 active+clean; 145 MiB data, 786 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 7.7 KiB/s wr, 7 op/s 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi002-76883-12"}]': finished 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: osdmap e84: 8 total, 8 up, 8 in 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/251232058' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/229130985' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"} : dispatch 2024-09-21T13:41:12.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:12.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:12.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:12.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/681166890' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi002-76384-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:12.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi002-76384-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:13.356 INFO:tasks.workunit.client.0.smithi002.stdout:i_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (4 ms) 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (3 ms) 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (4 ms) 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (3 ms) 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (3 ms) 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (5 ms) 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-21T13:41:13.357 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (3 ms) 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (4 ms) 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (3 ms) 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (7 ms) 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CrcZeroWrite (8421 ms) 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (1060 ms) 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (67 ms) 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-21T13:41:13.358 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (2 ms) 2024-09-21T13:41:13.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-21T13:41:13.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (4 ms) 2024-09-21T13:41:13.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (10747 ms total) 2024-09-21T13:41:13.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: 2024-09-21T13:41:13.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [----------] Global test environment tear-down 2024-09-21T13:41:13.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (19463 ms total) 2024-09-21T13:41:13.359 INFO:tasks.workunit.client.0.smithi002.stdout: api_io_pp: [ PASSED ] 40 tests. 2024-09-21T13:41:13.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:13.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:13.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:13.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:13 smithi162 ceph-mon[33046]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:13.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:13.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:13.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-7"}]': finished 2024-09-21T13:41:13.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi002-76384-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:13.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:13 smithi162 ceph-mon[33046]: osdmap e85: 8 total, 8 up, 8 in 2024-09-21T13:41:13.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi002-77546-3"} : dispatch 2024-09-21T13:41:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[40622]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:13.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-7"}]': finished 2024-09-21T13:41:13.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi002-76384-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:13.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[40622]: osdmap e85: 8 total, 8 up, 8 in 2024-09-21T13:41:13.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi002-77546-3"} : dispatch 2024-09-21T13:41:13.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:13.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:13.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:13.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[30076]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:13.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi002-76434-24"}]': finished 2024-09-21T13:41:13.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-77135-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:13.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-7"}]': finished 2024-09-21T13:41:13.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi002-76384-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:13.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[30076]: osdmap e85: 8 total, 8 up, 8 in 2024-09-21T13:41:13.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi002-77546-3"} : dispatch 2024-09-21T13:41:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: pgmap v78: 712 pgs: 1 active+clean+snaptrim, 23 creating+activating, 48 creating+peering, 143 unknown, 497 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-09-21T13:41:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:41:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi002-77546-3"}]': finished 2024-09-21T13:41:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:41:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: osdmap e86: 8 total, 8 up, 8 in 2024-09-21T13:41:14.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/470272040' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:14.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi002-77546-3"} : dispatch 2024-09-21T13:41:14.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:14.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:14.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:14.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: pgmap v78: 712 pgs: 1 active+clean+snaptrim, 23 creating+activating, 48 creating+peering, 143 unknown, 497 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-09-21T13:41:14.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:14.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:14.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:14.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:41:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi002-77546-3"}]': finished 2024-09-21T13:41:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:41:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: osdmap e86: 8 total, 8 up, 8 in 2024-09-21T13:41:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/470272040' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi002-77546-3"} : dispatch 2024-09-21T13:41:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:14.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: pgmap v78: 712 pgs: 1 active+clean+snaptrim, 23 creating+activating, 48 creating+peering, 143 unknown, 497 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-09-21T13:41:14.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:14.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:14.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:14.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:41:14.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi002-77546-3"}]': finished 2024-09-21T13:41:14.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:41:14.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: osdmap e86: 8 total, 8 up, 8 in 2024-09-21T13:41:14.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/470272040' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:14.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi002-77546-3"} : dispatch 2024-09-21T13:41:14.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:14.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:14.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7"} : dispatch 2024-09-21T13:41:15.354 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: Running main() from gmock_main.cc 2024-09-21T13:41:15.354 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-09-21T13:41:15.354 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [----------] Global test environment set-up. 2024-09-21T13:41:15.354 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-09-21T13:41:15.354 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-09-21T13:41:15.354 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (6416 ms) 2024-09-21T13:41:15.354 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-09-21T13:41:15.354 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (6619 ms) 2024-09-21T13:41:15.354 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-09-21T13:41:15.354 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (8010 ms) 2024-09-21T13:41:15.355 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [----------] 3 tests from NeoradosECList (21045 ms total) 2024-09-21T13:41:15.355 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: 2024-09-21T13:41:15.355 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [----------] Global test environment tear-down 2024-09-21T13:41:15.355 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (21045 ms total) 2024-09-21T13:41:15.355 INFO:tasks.workunit.client.0.smithi002.stdout: ec_list: [ PASSED ] 3 tests. 2024-09-21T13:41:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi002-77546-3"}]': finished 2024-09-21T13:41:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7"}]': finished 2024-09-21T13:41:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:15 smithi162 ceph-mon[33046]: osdmap e87: 8 total, 8 up, 8 in 2024-09-21T13:41:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/203328135' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi002-76384-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi002-76384-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi002-77546-3"}]': finished 2024-09-21T13:41:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7"}]': finished 2024-09-21T13:41:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[40622]: osdmap e87: 8 total, 8 up, 8 in 2024-09-21T13:41:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/203328135' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi002-76384-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi002-76384-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4249391317' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi002-77546-3"}]': finished 2024-09-21T13:41:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-7"}]': finished 2024-09-21T13:41:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[30076]: osdmap e87: 8 total, 8 up, 8 in 2024-09-21T13:41:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/203328135' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi002-76384-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_smithi002-76384-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:16 smithi162 ceph-mon[33046]: pgmap v81: 648 pgs: 1 active+clean+snaptrim, 24 creating+activating, 32 creating+peering, 128 unknown, 463 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T13:41:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi002-76384-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:16 smithi162 ceph-mon[33046]: osdmap e88: 8 total, 8 up, 8 in 2024-09-21T13:41:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1945157176' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[40622]: pgmap v81: 648 pgs: 1 active+clean+snaptrim, 24 creating+activating, 32 creating+peering, 128 unknown, 463 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T13:41:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi002-76384-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[40622]: osdmap e88: 8 total, 8 up, 8 in 2024-09-21T13:41:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1945157176' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[30076]: pgmap v81: 648 pgs: 1 active+clean+snaptrim, 24 creating+activating, 32 creating+peering, 128 unknown, 463 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T13:41:16.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:16.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi002-76384-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:16.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[30076]: osdmap e88: 8 total, 8 up, 8 in 2024-09-21T13:41:16.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1945157176' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:16.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:17.419 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: Running main() from gmock_main.cc 2024-09-21T13:41:17.419 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-09-21T13:41:17.419 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [----------] Global test environment set-up. 2024-09-21T13:41:17.419 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-09-21T13:41:17.419 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (2300 ms) 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3035 ms) 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3055 ms) 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (2556 ms) 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (3029 ms) 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (3001 ms) 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (6049 ms) 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (23025 ms total) 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: 2024-09-21T13:41:17.420 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [----------] Global test environment tear-down 2024-09-21T13:41:17.421 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (23025 ms total) 2024-09-21T13:41:17.421 INFO:tasks.workunit.client.0.smithi002.stdout: write_operations: [ PASSED ] 7 tests. 2024-09-21T13:41:17.431 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (2523 ms) 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3038 ms) 2024-09-21T13:41:17.432 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3040 ms) 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (2580 ms) 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3023 ms) 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (2974 ms) 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (6111 ms) 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (23289 ms total) 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (23289 ms total) 2024-09-21T13:41:17.433 INFO:tasks.workunit.client.0.smithi002.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-09-21T13:41:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:17 smithi002 ceph-mon[40622]: osdmap e89: 8 total, 8 up, 8 in 2024-09-21T13:41:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:17.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:17.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:17.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:17 smithi002 ceph-mon[30076]: osdmap e89: 8 total, 8 up, 8 in 2024-09-21T13:41:17.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:17.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:17 smithi162 ceph-mon[33046]: osdmap e89: 8 total, 8 up, 8 in 2024-09-21T13:41:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[40622]: pgmap v84: 552 pgs: 1 active+clean+snaptrim, 32 creating+peering, 128 unknown, 391 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[40622]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[40622]: osdmap e90: 8 total, 8 up, 8 in 2024-09-21T13:41:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1201065568' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi002-76384-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi002-76384-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[30076]: pgmap v84: 552 pgs: 1 active+clean+snaptrim, 32 creating+peering, 128 unknown, 391 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[30076]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[30076]: osdmap e90: 8 total, 8 up, 8 in 2024-09-21T13:41:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1201065568' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi002-76384-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:18.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi002-76384-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:18.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:18.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:18.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:41:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:41:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:18 smithi162 ceph-mon[33046]: pgmap v84: 552 pgs: 1 active+clean+snaptrim, 32 creating+peering, 128 unknown, 391 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:18 smithi162 ceph-mon[33046]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:18 smithi162 ceph-mon[33046]: osdmap e90: 8 total, 8 up, 8 in 2024-09-21T13:41:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1201065568' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi002-76384-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:18.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi002-76384-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:18.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:18.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:19.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4"} : dispatch 2024-09-21T13:41:19.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4"} : dispatch 2024-09-21T13:41:19.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi002-76384-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4"}]': finished 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: osdmap e91: 8 total, 8 up, 8 in 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2603820632' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:19.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3781657910' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4"} : dispatch 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4"} : dispatch 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi002-76384-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4"}]': finished 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: osdmap e91: 8 total, 8 up, 8 in 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2603820632' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:19.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:19.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:19.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:19.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3781657910' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:19.853 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:41:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:41:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:41:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4"} : dispatch 2024-09-21T13:41:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4"} : dispatch 2024-09-21T13:41:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi002-76384-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4"}]': finished 2024-09-21T13:41:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: osdmap e91: 8 total, 8 up, 8 in 2024-09-21T13:41:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2603820632' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6"} : dispatch 2024-09-21T13:41:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3781657910' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:20.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: pgmap v87: 616 pgs: 96 unknown, 96 creating+peering, 424 active+clean; 145 MiB data, 774 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:41:20.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:20.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:20.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:20.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-9"}]': finished 2024-09-21T13:41:20.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6"}]': finished 2024-09-21T13:41:20.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3781657910' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:20.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: osdmap e92: 8 total, 8 up, 8 in 2024-09-21T13:41:20.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-9", "mode": "writeback"} : dispatch 2024-09-21T13:41:20.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi002-76921-6", "pool2": "test-rados-api-smithi002-76921-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:41:20.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-9", "mode": "writeback"} : dispatch 2024-09-21T13:41:20.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi002-76921-6", "pool2": "test-rados-api-smithi002-76921-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:41:20.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:20.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:20.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:20.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: pgmap v87: 616 pgs: 96 unknown, 96 creating+peering, 424 active+clean; 145 MiB data, 774 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:41:20.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:20.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-9"}]': finished 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6"}]': finished 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3781657910' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: osdmap e92: 8 total, 8 up, 8 in 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-9", "mode": "writeback"} : dispatch 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi002-76921-6", "pool2": "test-rados-api-smithi002-76921-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-9", "mode": "writeback"} : dispatch 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi002-76921-6", "pool2": "test-rados-api-smithi002-76921-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:20.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: pgmap v87: 616 pgs: 96 unknown, 96 creating+peering, 424 active+clean; 145 MiB data, 774 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:41:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-9"}]': finished 2024-09-21T13:41:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi002-76921-4", "tierpool": "test-rados-api-smithi002-76921-6"}]': finished 2024-09-21T13:41:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3781657910' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi002-76395-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: osdmap e92: 8 total, 8 up, 8 in 2024-09-21T13:41:20.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-9", "mode": "writeback"} : dispatch 2024-09-21T13:41:20.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2317687285' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi002-76921-6", "pool2": "test-rados-api-smithi002-76921-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:41:20.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-9", "mode": "writeback"} : dispatch 2024-09-21T13:41:20.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "test-rados-api-smithi002-76921-6", "pool2": "test-rados-api-smithi002-76921-6", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:41:20.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:20.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:20.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:21.460 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [----------] Global test environment set-up. 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [----------] 4 tests from LibRadosService 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5066 ms) 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [ OK ] LibRadosService.RegisterLate (16 ms) 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: cluster: 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: id: e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: health: HEALTH_WARN 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 10 pool(s) do not have an application enabled 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: services: 2024-09-21T13:41:21.461 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 6m) 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: mgr: y(active, since 91s), standbys: x 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: data: 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: pools: 24 pools, 636 pgs 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: objects: 199 objects, 583 KiB 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: usage: 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: pgs: 79.245% pgs unknown 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 504 unknown 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 132 active+clean 2024-09-21T13:41:21.462 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: io: 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: cluster: 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: id: e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: health: HEALTH_WARN 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 12 pool(s) do not have an application enabled 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: services: 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 6m) 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: mgr: y(active, since 93s), standbys: x 2024-09-21T13:41:21.463 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: data: 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: pools: 29 pools, 868 pgs 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: objects: 252 objects, 73 MiB 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: usage: 342 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: pgs: 14.747% pgs unknown 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 40.553% pgs not active 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 388 active+clean 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 352 creating+peering 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 128 unknown 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: io: 2024-09-21T13:41:21.464 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: client: 12 MiB/s rd, 18 MiB/s wr, 255 op/s rd, 288 op/s wr 2024-09-21T13:41:21.465 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 2024-09-21T13:41:21.465 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 2024-09-21T13:41:21.465 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [ OK ] LibRadosService.StatusFormat (2177 ms) 2024-09-21T13:41:21.465 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [ RUN ] LibRadosService.Status 2024-09-21T13:41:21.465 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [ OK ] LibRadosService.Status (20057 ms) 2024-09-21T13:41:21.465 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [----------] 4 tests from LibRadosService (27316 ms total) 2024-09-21T13:41:21.465 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: 2024-09-21T13:41:21.465 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [----------] Global test environment tear-down 2024-09-21T13:41:21.465 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [==========] 4 tests from 1 test suite ran. (27316 ms total) 2024-09-21T13:41:21.465 INFO:tasks.workunit.client.0.smithi002.stdout: api_service: [ PASSED ] 4 tests. 2024-09-21T13:41:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-9", "mode": "writeback"}]': finished 2024-09-21T13:41:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi002-76921-6", "pool2": "test-rados-api-smithi002-76921-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T13:41:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[30076]: osdmap e93: 8 total, 8 up, 8 in 2024-09-21T13:41:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi002-76731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/391294192' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi002-76384-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi002-76384-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:21.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:21.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:21.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-9", "mode": "writeback"}]': finished 2024-09-21T13:41:21.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi002-76921-6", "pool2": "test-rados-api-smithi002-76921-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T13:41:21.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:21.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[40622]: osdmap e93: 8 total, 8 up, 8 in 2024-09-21T13:41:21.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi002-76731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:21.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/391294192' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi002-76384-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:21.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi002-76384-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:21 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-9", "mode": "writeback"}]': finished 2024-09-21T13:41:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi002-76921-6", "pool2": "test-rados-api-smithi002-76921-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T13:41:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:21 smithi162 ceph-mon[33046]: osdmap e93: 8 total, 8 up, 8 in 2024-09-21T13:41:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi002-76731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/391294192' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi002-76384-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_smithi002-76384-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:22.400 INFO:tasks.workunit.client.0.smithi002.stdout:tch_notify_pp: flushed 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3004 ms) 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: trying... 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: handle_notify cookie 94849420514816 notify_id 347892350983 notifier_gid 25153 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: timed out 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: flushing 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: flushed 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3004 ms) 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: List watches 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: notify2 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: handle_notify cookie 94849420514816 notify_id 360777252869 notifier_gid 25153 2024-09-21T13:41:22.401 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: notify2 done 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: watch_check 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: unwatch2 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: flushing 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: done 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3030 ms) 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: List watches 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: notify2 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: handle_notify cookie 94849420514816 notify_id 373662154760 notifier_gid 25153 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: notify2 done 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: watch_check 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: unwatch2 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: flushing 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: done 2024-09-21T13:41:22.402 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3008 ms) 2024-09-21T13:41:22.403 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (15777 ms total) 2024-09-21T13:41:22.403 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: 2024-09-21T13:41:22.403 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-09-21T13:41:22.403 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (28307 ms total) 2024-09-21T13:41:22.403 INFO:tasks.workunit.client.0.smithi002.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-09-21T13:41:22.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:22 smithi162 ceph-mon[33046]: pgmap v90: 580 pgs: 192 unknown, 388 active+clean; 145 MiB data, 774 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:22.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:22.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:22.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:22.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi002-76384-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:22.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:41:22.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:22 smithi162 ceph-mon[33046]: osdmap e94: 8 total, 8 up, 8 in 2024-09-21T13:41:22.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:22.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:22.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3299040985' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi002-76395-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:22.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi002-76395-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[30076]: pgmap v90: 580 pgs: 192 unknown, 388 active+clean; 145 MiB data, 774 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi002-76384-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[30076]: osdmap e94: 8 total, 8 up, 8 in 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3299040985' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi002-76395-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi002-76395-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[40622]: pgmap v90: 580 pgs: 192 unknown, 388 active+clean; 145 MiB data, 774 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:22.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi002-76384-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:41:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[40622]: osdmap e94: 8 total, 8 up, 8 in 2024-09-21T13:41:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9"} : dispatch 2024-09-21T13:41:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3299040985' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi002-76395-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi002-76395-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:23.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi002-76731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi002-76731-10"}]': finished 2024-09-21T13:41:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9"}]': finished 2024-09-21T13:41:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi002-76395-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[30076]: osdmap e95: 8 total, 8 up, 8 in 2024-09-21T13:41:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi002-76731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi002-76731-10"}]': finished 2024-09-21T13:41:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9"}]': finished 2024-09-21T13:41:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi002-76395-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:23 smithi002 ceph-mon[40622]: osdmap e95: 8 total, 8 up, 8 in 2024-09-21T13:41:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:23 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi002-76731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi002-76731-10"}]': finished 2024-09-21T13:41:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-9"}]': finished 2024-09-21T13:41:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi002-76395-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:23 smithi162 ceph-mon[33046]: osdmap e95: 8 total, 8 up, 8 in 2024-09-21T13:41:24.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-09-21T13:41:24.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [----------] Global test environment set-up. 2024-09-21T13:41:24.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-09-21T13:41:24.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-09-21T13:41:24.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5045 ms) 2024-09-21T13:41:24.422 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-09-21T13:41:24.422 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (26 ms) 2024-09-21T13:41:24.422 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-09-21T13:41:24.422 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20037 ms) 2024-09-21T13:41:24.422 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-09-21T13:41:24.423 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: attempt 0 of 20 2024-09-21T13:41:24.423 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5162 ms) 2024-09-21T13:41:24.423 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (30270 ms total) 2024-09-21T13:41:24.423 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: 2024-09-21T13:41:24.423 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [----------] Global test environment tear-down 2024-09-21T13:41:24.423 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (30270 ms total) 2024-09-21T13:41:24.424 INFO:tasks.workunit.client.0.smithi002.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-09-21T13:41:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[30076]: pgmap v93: 428 pgs: 7 creating+peering, 1 creating+activating, 29 unknown, 391 active+clean; 145 MiB data, 792 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:24.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:24.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[30076]: osdmap e96: 8 total, 8 up, 8 in 2024-09-21T13:41:24.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/773505582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi002-76384-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi002-76384-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/847431213' entity='client.admin' cmd={"prefix": "service dump"} : dispatch 2024-09-21T13:41:24.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[40622]: pgmap v93: 428 pgs: 7 creating+peering, 1 creating+activating, 29 unknown, 391 active+clean; 145 MiB data, 792 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:24.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:24.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:24.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[40622]: osdmap e96: 8 total, 8 up, 8 in 2024-09-21T13:41:24.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/773505582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi002-76384-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi002-76384-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/847431213' entity='client.admin' cmd={"prefix": "service dump"} : dispatch 2024-09-21T13:41:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:24 smithi162 ceph-mon[33046]: pgmap v93: 428 pgs: 7 creating+peering, 1 creating+activating, 29 unknown, 391 active+clean; 145 MiB data, 792 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:24 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:24 smithi162 ceph-mon[33046]: osdmap e96: 8 total, 8 up, 8 in 2024-09-21T13:41:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/773505582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi002-76384-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_smithi002-76384-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:24.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/847431213' entity='client.admin' cmd={"prefix": "service dump"} : dispatch 2024-09-21T13:41:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-21T13:41:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi002-76384-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[30076]: osdmap e97: 8 total, 8 up, 8 in 2024-09-21T13:41:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/489077967' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP_smithi002-76395-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:25.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-21T13:41:25.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:25.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi002-76384-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:25.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:25.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[40622]: osdmap e97: 8 total, 8 up, 8 in 2024-09-21T13:41:25.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:25.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/489077967' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP_smithi002-76395-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:25.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:25 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-21T13:41:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi002-76384-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76641-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:25 smithi162 ceph-mon[33046]: osdmap e97: 8 total, 8 up, 8 in 2024-09-21T13:41:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/489077967' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP_smithi002-76395-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:26.388 INFO:tasks.workunit.client.0.smithi002.stdout: misc: Running main() from gmock_main.cc 2024-09-21T13:41:26.388 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [----------] Global test environment set-up. 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.Version (1365 ms) 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (1995 ms) 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.LongName (3052 ms) 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (2575 ms) 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (3056 ms) 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (2958 ms) 2024-09-21T13:41:26.389 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.Exec (3022 ms) 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (3005 ms) 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (2977 ms) 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.BigObject (3006 ms) 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (2001 ms) 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (3017 ms) 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [----------] 12 tests from NeoRadosMisc (32030 ms total) 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: 2024-09-21T13:41:26.390 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [----------] Global test environment tear-down 2024-09-21T13:41:26.391 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [==========] 12 tests from 1 test suite ran. (32030 ms total) 2024-09-21T13:41:26.391 INFO:tasks.workunit.client.0.smithi002.stdout: misc: [ PASSED ] 12 tests. 2024-09-21T13:41:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[30076]: pgmap v96: 588 pgs: 8 creating+peering, 256 unknown, 324 active+clean; 145 MiB data, 777 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-09-21T13:41:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/489077967' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi002-76395-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[30076]: osdmap e98: 8 total, 8 up, 8 in 2024-09-21T13:41:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache", "force_nonempty":""} : dispatch 2024-09-21T13:41:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache", "force_nonempty":""} : dispatch 2024-09-21T13:41:26.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[40622]: pgmap v96: 588 pgs: 8 creating+peering, 256 unknown, 324 active+clean; 145 MiB data, 777 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-09-21T13:41:26.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:26.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/489077967' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi002-76395-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:26.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:26.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[40622]: osdmap e98: 8 total, 8 up, 8 in 2024-09-21T13:41:26.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache", "force_nonempty":""} : dispatch 2024-09-21T13:41:26.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache", "force_nonempty":""} : dispatch 2024-09-21T13:41:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:26 smithi162 ceph-mon[33046]: pgmap v96: 588 pgs: 8 creating+peering, 256 unknown, 324 active+clean; 145 MiB data, 777 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-09-21T13:41:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/489077967' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi002-76395-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:26 smithi162 ceph-mon[33046]: osdmap e98: 8 total, 8 up, 8 in 2024-09-21T13:41:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache", "force_nonempty":""} : dispatch 2024-09-21T13:41:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache", "force_nonempty":""} : dispatch 2024-09-21T13:41:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache", "force_nonempty":""}]': finished 2024-09-21T13:41:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[40622]: osdmap e99: 8 total, 8 up, 8 in 2024-09-21T13:41:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1583819692' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi002-76384-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi002-76384-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76641-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76641-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache", "force_nonempty":""}]': finished 2024-09-21T13:41:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[30076]: osdmap e99: 8 total, 8 up, 8 in 2024-09-21T13:41:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1583819692' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi002-76384-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi002-76384-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76641-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76641-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache", "force_nonempty":""}]': finished 2024-09-21T13:41:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:27 smithi162 ceph-mon[33046]: osdmap e99: 8 total, 8 up, 8 in 2024-09-21T13:41:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1583819692' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi002-76384-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_smithi002-76384-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76641-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76641-10-cache", "mode":"readonly", "yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: pgmap v99: 556 pgs: 8 creating+peering, 224 unknown, 324 active+clean; 145 MiB data, 777 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-21T13:41:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi002-76384-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76641-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: osdmap e100: 8 total, 8 up, 8 in 2024-09-21T13:41:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache"} : dispatch 2024-09-21T13:41:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache"} : dispatch 2024-09-21T13:41:28.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3254994149' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi002-76395-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:28.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: pgmap v99: 556 pgs: 8 creating+peering, 224 unknown, 324 active+clean; 145 MiB data, 777 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-21T13:41:28.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:28.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:28.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:28.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi002-76384-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:28.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76641-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:28.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:28.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: osdmap e100: 8 total, 8 up, 8 in 2024-09-21T13:41:28.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache"} : dispatch 2024-09-21T13:41:28.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:28.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:28.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache"} : dispatch 2024-09-21T13:41:28.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3254994149' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi002-76395-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:28.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:41:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: pgmap v99: 556 pgs: 8 creating+peering, 224 unknown, 324 active+clean; 145 MiB data, 777 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-21T13:41:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi002-76384-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76641-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: osdmap e100: 8 total, 8 up, 8 in 2024-09-21T13:41:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/708498119' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache"} : dispatch 2024-09-21T13:41:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache"} : dispatch 2024-09-21T13:41:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3254994149' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi002-76395-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:29.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:41:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:41:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.0"} : dispatch 2024-09-21T13:41:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.1"} : dispatch 2024-09-21T13:41:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.2"} : dispatch 2024-09-21T13:41:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.3"} : dispatch 2024-09-21T13:41:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.4"} : dispatch 2024-09-21T13:41:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.5"} : dispatch 2024-09-21T13:41:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.6"} : dispatch 2024-09-21T13:41:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.7"} : dispatch 2024-09-21T13:41:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.8"} : dispatch 2024-09-21T13:41:29.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.9"} : dispatch 2024-09-21T13:41:29.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-11"}]': finished 2024-09-21T13:41:29.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache"}]': finished 2024-09-21T13:41:29.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3254994149' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi002-76395-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:29.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: osdmap e101: 8 total, 8 up, 8 in 2024-09-21T13:41:29.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-11", "mode": "writeback"} : dispatch 2024-09-21T13:41:29.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-11", "mode": "writeback"} : dispatch 2024-09-21T13:41:29.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:29.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:29.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.0"} : dispatch 2024-09-21T13:41:29.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.1"} : dispatch 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.2"} : dispatch 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.3"} : dispatch 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.4"} : dispatch 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.5"} : dispatch 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.6"} : dispatch 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.7"} : dispatch 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.8"} : dispatch 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.9"} : dispatch 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-11"}]': finished 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache"}]': finished 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3254994149' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi002-76395-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: osdmap e101: 8 total, 8 up, 8 in 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-11", "mode": "writeback"} : dispatch 2024-09-21T13:41:29.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-11", "mode": "writeback"} : dispatch 2024-09-21T13:41:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.0"} : dispatch 2024-09-21T13:41:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.1"} : dispatch 2024-09-21T13:41:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.2"} : dispatch 2024-09-21T13:41:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.3"} : dispatch 2024-09-21T13:41:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.4"} : dispatch 2024-09-21T13:41:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.5"} : dispatch 2024-09-21T13:41:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.6"} : dispatch 2024-09-21T13:41:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.7"} : dispatch 2024-09-21T13:41:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.8"} : dispatch 2024-09-21T13:41:29.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "15.9"} : dispatch 2024-09-21T13:41:29.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-11"}]': finished 2024-09-21T13:41:29.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76641-10", "tierpool":"test-rados-api-smithi002-76641-10-cache"}]': finished 2024-09-21T13:41:29.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3254994149' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi002-76395-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:29.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: osdmap e101: 8 total, 8 up, 8 in 2024-09-21T13:41:29.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-11", "mode": "writeback"} : dispatch 2024-09-21T13:41:29.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-11", "mode": "writeback"} : dispatch 2024-09-21T13:41:30.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-09-21T13:41:30.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-09-21T13:41:30.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-09-21T13:41:30.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-09-21T13:41:30.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-09-21T13:41:30.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-09-21T13:41:30.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: 15.0 deep-scrub starts 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: pgmap v102: 492 pgs: 32 creating+peering, 460 active+clean; 145 MiB data, 790 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 260 KiB/s wr, 7 op/s 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: 15.6 deep-scrub starts 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: 15.6 deep-scrub ok 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: 15.0 deep-scrub ok 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: 15.1 deep-scrub starts 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: 15.1 deep-scrub ok 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: 15.3 deep-scrub starts 2024-09-21T13:41:30.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: 15.3 deep-scrub ok 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: 15.4 deep-scrub starts 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: 15.4 deep-scrub ok 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-11", "mode": "writeback"}]': finished 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: osdmap e102: 8 total, 8 up, 8 in 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2052845635' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi002-76384-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi002-76384-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-09-21T13:41:30.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: 15.0 deep-scrub starts 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: pgmap v102: 492 pgs: 32 creating+peering, 460 active+clean; 145 MiB data, 790 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 260 KiB/s wr, 7 op/s 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: 15.6 deep-scrub starts 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: 15.6 deep-scrub ok 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: 15.0 deep-scrub ok 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: 15.1 deep-scrub starts 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: 15.1 deep-scrub ok 2024-09-21T13:41:30.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: 15.3 deep-scrub starts 2024-09-21T13:41:30.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: 15.3 deep-scrub ok 2024-09-21T13:41:30.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: 15.4 deep-scrub starts 2024-09-21T13:41:30.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: 15.4 deep-scrub ok 2024-09-21T13:41:30.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:30.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:30.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-11", "mode": "writeback"}]': finished 2024-09-21T13:41:30.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: osdmap e102: 8 total, 8 up, 8 in 2024-09-21T13:41:30.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2052845635' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi002-76384-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:30.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:30 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi002-76384-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-09-21T13:41:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-09-21T13:41:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-09-21T13:41:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-09-21T13:41:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-09-21T13:41:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-09-21T13:41:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: 15.0 deep-scrub starts 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: pgmap v102: 492 pgs: 32 creating+peering, 460 active+clean; 145 MiB data, 790 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 260 KiB/s wr, 7 op/s 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: 15.6 deep-scrub starts 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: 15.6 deep-scrub ok 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: 15.0 deep-scrub ok 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: 15.1 deep-scrub starts 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: 15.1 deep-scrub ok 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: 15.3 deep-scrub starts 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: 15.3 deep-scrub ok 2024-09-21T13:41:30.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: 15.4 deep-scrub starts 2024-09-21T13:41:30.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: 15.4 deep-scrub ok 2024-09-21T13:41:30.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:30.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:30.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-11", "mode": "writeback"}]': finished 2024-09-21T13:41:30.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: osdmap e102: 8 total, 8 up, 8 in 2024-09-21T13:41:30.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2052845635' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi002-76384-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:30.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:30 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_smithi002-76384-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:31.397 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: Running main() from gmock_main.cc 2024-09-21T13:41:31.397 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-09-21T13:41:31.397 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [----------] Global test environment set-up. 2024-09-21T13:41:31.397 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-09-21T13:41:31.397 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-09-21T13:41:31.397 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ OK ] LibRadosPools.PoolList (2712 ms) 2024-09-21T13:41:31.397 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3022 ms) 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3028 ms) 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (2615 ms) 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (2979 ms) 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5043 ms) 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (4962 ms) 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-21T13:41:31.398 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5014 ms) 2024-09-21T13:41:31.399 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-21T13:41:31.399 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8044 ms) 2024-09-21T13:41:31.399 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [----------] 9 tests from LibRadosPools (37419 ms total) 2024-09-21T13:41:31.399 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: 2024-09-21T13:41:31.399 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [----------] Global test environment tear-down 2024-09-21T13:41:31.399 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (37419 ms total) 2024-09-21T13:41:31.399 INFO:tasks.workunit.client.0.smithi002.stdout: api_pool: [ PASSED ] 9 tests. 2024-09-21T13:41:31.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[30076]: 15.2 deep-scrub starts 2024-09-21T13:41:31.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[30076]: 15.2 deep-scrub ok 2024-09-21T13:41:31.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[30076]: 15.5 deep-scrub starts 2024-09-21T13:41:31.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[30076]: 15.5 deep-scrub ok 2024-09-21T13:41:31.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:31.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[30076]: 15.7 deep-scrub starts 2024-09-21T13:41:31.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[30076]: 15.7 deep-scrub ok 2024-09-21T13:41:31.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi002-76384-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:31.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[30076]: osdmap e103: 8 total, 8 up, 8 in 2024-09-21T13:41:31.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/399322525' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:31.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[40622]: 15.2 deep-scrub starts 2024-09-21T13:41:31.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[40622]: 15.2 deep-scrub ok 2024-09-21T13:41:31.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[40622]: 15.5 deep-scrub starts 2024-09-21T13:41:31.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[40622]: 15.5 deep-scrub ok 2024-09-21T13:41:31.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:31.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[40622]: 15.7 deep-scrub starts 2024-09-21T13:41:31.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[40622]: 15.7 deep-scrub ok 2024-09-21T13:41:31.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi002-76384-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:31.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[40622]: osdmap e103: 8 total, 8 up, 8 in 2024-09-21T13:41:31.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/399322525' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:31 smithi162 ceph-mon[33046]: 15.2 deep-scrub starts 2024-09-21T13:41:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:31 smithi162 ceph-mon[33046]: 15.2 deep-scrub ok 2024-09-21T13:41:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:31 smithi162 ceph-mon[33046]: 15.5 deep-scrub starts 2024-09-21T13:41:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:31 smithi162 ceph-mon[33046]: 15.5 deep-scrub ok 2024-09-21T13:41:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:31 smithi162 ceph-mon[33046]: 15.7 deep-scrub starts 2024-09-21T13:41:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:31 smithi162 ceph-mon[33046]: 15.7 deep-scrub ok 2024-09-21T13:41:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:31 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi002-76384-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:31 smithi162 ceph-mon[33046]: osdmap e103: 8 total, 8 up, 8 in 2024-09-21T13:41:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/399322525' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: pgmap v105: 524 pgs: 160 unknown, 364 active+clean; 145 MiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-09-21T13:41:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: 15.8 deep-scrub starts 2024-09-21T13:41:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: 15.8 deep-scrub ok 2024-09-21T13:41:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:32.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:32.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: 15.9 deep-scrub starts 2024-09-21T13:41:32.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: 15.9 deep-scrub ok 2024-09-21T13:41:32.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:32.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/399322525' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:32.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:41:32.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: osdmap e104: 8 total, 8 up, 8 in 2024-09-21T13:41:32.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:32.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:32.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: pgmap v105: 524 pgs: 160 unknown, 364 active+clean; 145 MiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: 15.8 deep-scrub starts 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: 15.8 deep-scrub ok 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: 15.9 deep-scrub starts 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: 15.9 deep-scrub ok 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/399322525' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: osdmap e104: 8 total, 8 up, 8 in 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:32.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: pgmap v105: 524 pgs: 160 unknown, 364 active+clean; 145 MiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: 15.8 deep-scrub starts 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: 15.8 deep-scrub ok 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: 15.9 deep-scrub starts 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: 15.9 deep-scrub ok 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/399322525' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: osdmap e104: 8 total, 8 up, 8 in 2024-09-21T13:41:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:32.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11"} : dispatch 2024-09-21T13:41:33.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-09-21T13:41:33.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [----------] Global test environment set-up. 2024-09-21T13:41:33.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-09-21T13:41:33.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-09-21T13:41:33.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-21T13:41:33.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: 2024-09-21T13:40:54.040+0000 7f40b060b780 -1 failed for service _ceph-mon._tcp 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: 2024-09-21T13:40:54.040+0000 7f40b060b780 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (84 ms) 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5011 ms) 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5095 ms total) 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: started 0x7f409806a6c0 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: started 0x55e83cd9f150 2024-09-21T13:41:33.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: started 2 aios 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: waiting 0x7f409806a6c0 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: waiting 0x55e83cd9f150 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: done. 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (5257 ms) 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (5257 ms total) 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMisc.Exec (80 ms) 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-09-21T13:41:33.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (16 ms) 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (5 ms) 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4895 ms) 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (21572 ms) 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [----------] 8 tests from LibRadosMisc (26568 ms total) 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [----------] Global test environment tear-down 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (39367 ms total) 2024-09-21T13:41:33.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc: [ PASSED ] 12 tests. 2024-09-21T13:41:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11"}]': finished 2024-09-21T13:41:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[40622]: osdmap e105: 8 total, 8 up, 8 in 2024-09-21T13:41:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/589555976' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi002-76384-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi002-76384-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:33.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11"}]': finished 2024-09-21T13:41:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[30076]: osdmap e105: 8 total, 8 up, 8 in 2024-09-21T13:41:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/589555976' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi002-76384-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi002-76384-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:33 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:41:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-11"}]': finished 2024-09-21T13:41:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:33 smithi162 ceph-mon[33046]: osdmap e105: 8 total, 8 up, 8 in 2024-09-21T13:41:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/589555976' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi002-76384-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_smithi002-76384-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[30076]: pgmap v108: 452 pgs: 56 creating+peering, 49 unknown, 347 active+clean; 217 MiB data, 1011 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 2 op/s 2024-09-21T13:41:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi002-76384-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:34.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10"}]': finished 2024-09-21T13:41:34.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[30076]: osdmap e106: 8 total, 8 up, 8 in 2024-09-21T13:41:34.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:34.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4208476491' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi002-76395-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:34.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi002-76395-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:34.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:41:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[40622]: pgmap v108: 452 pgs: 56 creating+peering, 49 unknown, 347 active+clean; 217 MiB data, 1011 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 2 op/s 2024-09-21T13:41:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi002-76384-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10"}]': finished 2024-09-21T13:41:34.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[40622]: osdmap e106: 8 total, 8 up, 8 in 2024-09-21T13:41:34.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:34.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4208476491' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi002-76395-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:34.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi002-76395-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:34.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:34 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:41:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:34 smithi162 ceph-mon[33046]: pgmap v108: 452 pgs: 56 creating+peering, 49 unknown, 347 active+clean; 217 MiB data, 1011 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 2 op/s 2024-09-21T13:41:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi002-76384-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi002-76731-10"}]': finished 2024-09-21T13:41:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:34 smithi162 ceph-mon[33046]: osdmap e106: 8 total, 8 up, 8 in 2024-09-21T13:41:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi002-76731-10"} : dispatch 2024-09-21T13:41:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4208476491' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi002-76395-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi002-76395-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:34 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:41:35.334 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: Running main() from gmock_main.cc 2024-09-21T13:41:35.334 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-09-21T13:41:35.334 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [----------] Global test environment set-up. 2024-09-21T13:41:35.334 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-09-21T13:41:35.334 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-09-21T13:41:35.334 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (2329 ms) 2024-09-21T13:41:35.334 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-09-21T13:41:35.334 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (3030 ms) 2024-09-21T13:41:35.334 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-09-21T13:41:35.334 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3048 ms) 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (2587 ms) 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (2978 ms) 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (3000 ms) 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (3020 ms) 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (3043 ms) 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (2971 ms) 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-09-21T13:41:35.335 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (2991 ms) 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (3010 ms) 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3033 ms) 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (3003 ms) 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (2937 ms) 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (40982 ms total) 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [----------] Global test environment tear-down 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (40982 ms total) 2024-09-21T13:41:35.336 INFO:tasks.workunit.client.0.smithi002.stdout: read_operations: [ PASSED ] 14 tests. 2024-09-21T13:41:35.339 INFO:tasks.workunit.client.0.smithi002.stdout: io: Running main() from gmock_main.cc 2024-09-21T13:41:35.339 INFO:tasks.workunit.client.0.smithi002.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-09-21T13:41:35.339 INFO:tasks.workunit.client.0.smithi002.stdout: io: [----------] Global test environment set-up. 2024-09-21T13:41:35.339 INFO:tasks.workunit.client.0.smithi002.stdout: io: [----------] 14 tests from NeoRadosIo 2024-09-21T13:41:35.339 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-09-21T13:41:35.339 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.Limits (2373 ms) 2024-09-21T13:41:35.339 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-09-21T13:41:35.339 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (3031 ms) 2024-09-21T13:41:35.339 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-09-21T13:41:35.339 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.ReadOp (3032 ms) 2024-09-21T13:41:35.339 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.SparseRead (2580 ms) 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.RoundTrip (3006 ms) 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (3026 ms) 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (2998 ms) 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (3053 ms) 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (2950 ms) 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.Trunc (3005 ms) 2024-09-21T13:41:35.340 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.Remove (3010 ms) 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3048 ms) 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.RmXattr (2982 ms) 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ OK ] NeoRadosIo.GetXattrs (2940 ms) 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: [----------] 14 tests from NeoRadosIo (41034 ms total) 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: [----------] Global test environment tear-down 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: [==========] 14 tests from 1 test suite ran. (41034 ms total) 2024-09-21T13:41:35.341 INFO:tasks.workunit.client.0.smithi002.stdout: io: [ PASSED ] 14 tests. 2024-09-21T13:41:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi002-76731-10"}]': finished 2024-09-21T13:41:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi002-76395-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: osdmap e107: 8 total, 8 up, 8 in 2024-09-21T13:41:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:35.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi002-76731-10"}]': finished 2024-09-21T13:41:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi002-76395-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: osdmap e107: 8 total, 8 up, 8 in 2024-09-21T13:41:35.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:35.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:35.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:35.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:35.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:35.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3391382159' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi002-76731-10"}]': finished 2024-09-21T13:41:35.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi002-76395-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:35.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: osdmap e107: 8 total, 8 up, 8 in 2024-09-21T13:41:35.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:35.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:35.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:35.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:35.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[40622]: pgmap v111: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 4 op/s 2024-09-21T13:41:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[40622]: osdmap e108: 8 total, 8 up, 8 in 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/710692231' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi002-76384-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi002-76384-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[30076]: pgmap v111: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 4 op/s 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[30076]: osdmap e108: 8 total, 8 up, 8 in 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/710692231' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi002-76384-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi002-76384-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:36 smithi162 ceph-mon[33046]: pgmap v111: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 4 op/s 2024-09-21T13:41:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:36 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:36 smithi162 ceph-mon[33046]: osdmap e108: 8 total, 8 up, 8 in 2024-09-21T13:41:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/710692231' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi002-76384-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:36.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_smithi002-76384-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi002-76384-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:37 smithi162 ceph-mon[33046]: osdmap e109: 8 total, 8 up, 8 in 2024-09-21T13:41:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/855951247' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsCompletePP_smithi002-76395-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:37 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:37 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi002-76384-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[30076]: osdmap e109: 8 total, 8 up, 8 in 2024-09-21T13:41:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/855951247' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsCompletePP_smithi002-76395-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi002-76384-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[40622]: osdmap e109: 8 total, 8 up, 8 in 2024-09-21T13:41:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/855951247' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsCompletePP_smithi002-76395-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:37 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:38.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:38 smithi002 ceph-mon[40622]: pgmap v114: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:38.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:38.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"}]': finished 2024-09-21T13:41:38.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/855951247' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi002-76395-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:38.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:38 smithi002 ceph-mon[40622]: osdmap e110: 8 total, 8 up, 8 in 2024-09-21T13:41:38.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:38 smithi002 ceph-mon[30076]: pgmap v114: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"}]': finished 2024-09-21T13:41:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/855951247' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi002-76395-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:38 smithi002 ceph-mon[30076]: osdmap e110: 8 total, 8 up, 8 in 2024-09-21T13:41:38.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:41:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:41:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:38 smithi162 ceph-mon[33046]: pgmap v114: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi002-76731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"}]': finished 2024-09-21T13:41:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/855951247' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi002-76395-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:38 smithi162 ceph-mon[33046]: osdmap e110: 8 total, 8 up, 8 in 2024-09-21T13:41:39.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:41:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:41:39.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:39.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:39.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[30076]: osdmap e111: 8 total, 8 up, 8 in 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2558805917' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi002-76384-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi002-76384-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:39.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:41:39.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:41:39.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:39.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[40622]: osdmap e111: 8 total, 8 up, 8 in 2024-09-21T13:41:39.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2558805917' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi002-76384-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:39.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi002-76384-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:39 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:39 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:39 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:39 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:41:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:39 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:41:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:39 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:39 smithi162 ceph-mon[33046]: osdmap e111: 8 total, 8 up, 8 in 2024-09-21T13:41:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2558805917' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi002-76384-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_smithi002-76384-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:40.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[40622]: pgmap v117: 396 pgs: 8 creating+peering, 64 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T13:41:40.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:40.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi002-76384-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:40.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[40622]: osdmap e112: 8 total, 8 up, 8 in 2024-09-21T13:41:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2410546581' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi002-76395-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi002-76395-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[30076]: pgmap v117: 396 pgs: 8 creating+peering, 64 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T13:41:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi002-76384-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[30076]: osdmap e112: 8 total, 8 up, 8 in 2024-09-21T13:41:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2410546581' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi002-76395-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi002-76395-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:40.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:40 smithi162 ceph-mon[33046]: pgmap v117: 396 pgs: 8 creating+peering, 64 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T13:41:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi002-76384-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:40 smithi162 ceph-mon[33046]: osdmap e112: 8 total, 8 up, 8 in 2024-09-21T13:41:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2410546581' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi002-76395-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_smithi002-76395-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:41:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi002-76395-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[40622]: osdmap e113: 8 total, 8 up, 8 in 2024-09-21T13:41:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:41:41.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:41:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi002-76395-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[30076]: osdmap e113: 8 total, 8 up, 8 in 2024-09-21T13:41:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:41:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:41:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi002-76395-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:41:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:41 smithi162 ceph-mon[33046]: osdmap e113: 8 total, 8 up, 8 in 2024-09-21T13:41:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:41:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:41:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[30076]: pgmap v120: 396 pgs: 8 creating+peering, 64 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T13:41:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-13"}]': finished 2024-09-21T13:41:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[30076]: osdmap e114: 8 total, 8 up, 8 in 2024-09-21T13:41:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-13", "mode": "writeback"} : dispatch 2024-09-21T13:41:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2671615627' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi002-76384-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-13", "mode": "writeback"} : dispatch 2024-09-21T13:41:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi002-76384-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[40622]: pgmap v120: 396 pgs: 8 creating+peering, 64 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T13:41:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-13"}]': finished 2024-09-21T13:41:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[40622]: osdmap e114: 8 total, 8 up, 8 in 2024-09-21T13:41:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-13", "mode": "writeback"} : dispatch 2024-09-21T13:41:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2671615627' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi002-76384-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-13", "mode": "writeback"} : dispatch 2024-09-21T13:41:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi002-76384-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:42 smithi162 ceph-mon[33046]: pgmap v120: 396 pgs: 8 creating+peering, 64 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 67 KiB/s wr, 68 op/s 2024-09-21T13:41:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:42 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-13"}]': finished 2024-09-21T13:41:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:42 smithi162 ceph-mon[33046]: osdmap e114: 8 total, 8 up, 8 in 2024-09-21T13:41:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-13", "mode": "writeback"} : dispatch 2024-09-21T13:41:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2671615627' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi002-76384-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-13", "mode": "writeback"} : dispatch 2024-09-21T13:41:42.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi002-76384-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:43.483 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:41:43 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=infra.usagestats t=2024-09-21T13:41:43.069785345Z level=info msg="Usage stats are ready to report" 2024-09-21T13:41:43.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:43.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:43.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:43.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-13", "mode": "writeback"}]': finished 2024-09-21T13:41:43.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi002-76384-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:43.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[40622]: osdmap e115: 8 total, 8 up, 8 in 2024-09-21T13:41:43.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1476037553' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi002-76395-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-13", "mode": "writeback"}]': finished 2024-09-21T13:41:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi002-76384-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[30076]: osdmap e115: 8 total, 8 up, 8 in 2024-09-21T13:41:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1476037553' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi002-76395-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:43 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:41:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-13", "mode": "writeback"}]': finished 2024-09-21T13:41:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi002-76384-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:43 smithi162 ceph-mon[33046]: osdmap e115: 8 total, 8 up, 8 in 2024-09-21T13:41:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1476037553' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi002-76395-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: pgmap v123: 428 pgs: 23 creating+peering, 25 unknown, 380 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 9.0 KiB/s rd, 298 KiB/s wr, 55 op/s 2024-09-21T13:41:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.0"} : dispatch 2024-09-21T13:41:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.1"} : dispatch 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.2"} : dispatch 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.3"} : dispatch 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.4"} : dispatch 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.5"} : dispatch 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.6"} : dispatch 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.7"} : dispatch 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.8"} : dispatch 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.9"} : dispatch 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: 172.2 scrub starts 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: 172.2 scrub ok 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: 172.8 scrub starts 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: 172.8 scrub ok 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1476037553' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi002-76395-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[30076]: osdmap e116: 8 total, 8 up, 8 in 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: pgmap v123: 428 pgs: 23 creating+peering, 25 unknown, 380 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 9.0 KiB/s rd, 298 KiB/s wr, 55 op/s 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.0"} : dispatch 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.1"} : dispatch 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.2"} : dispatch 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.3"} : dispatch 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.4"} : dispatch 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.5"} : dispatch 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.6"} : dispatch 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.7"} : dispatch 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.8"} : dispatch 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.9"} : dispatch 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: 172.2 scrub starts 2024-09-21T13:41:44.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: 172.2 scrub ok 2024-09-21T13:41:44.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: 172.8 scrub starts 2024-09-21T13:41:44.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: 172.8 scrub ok 2024-09-21T13:41:44.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1476037553' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi002-76395-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:44.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:44 smithi002 ceph-mon[40622]: osdmap e116: 8 total, 8 up, 8 in 2024-09-21T13:41:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: pgmap v123: 428 pgs: 23 creating+peering, 25 unknown, 380 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 9.0 KiB/s rd, 298 KiB/s wr, 55 op/s 2024-09-21T13:41:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.0"} : dispatch 2024-09-21T13:41:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.1"} : dispatch 2024-09-21T13:41:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.2"} : dispatch 2024-09-21T13:41:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.3"} : dispatch 2024-09-21T13:41:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.4"} : dispatch 2024-09-21T13:41:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.5"} : dispatch 2024-09-21T13:41:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.6"} : dispatch 2024-09-21T13:41:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.7"} : dispatch 2024-09-21T13:41:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.8"} : dispatch 2024-09-21T13:41:44.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "172.9"} : dispatch 2024-09-21T13:41:44.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: 172.2 scrub starts 2024-09-21T13:41:44.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: 172.2 scrub ok 2024-09-21T13:41:44.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: 172.8 scrub starts 2024-09-21T13:41:44.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: 172.8 scrub ok 2024-09-21T13:41:44.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1476037553' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi002-76395-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:44.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:44 smithi162 ceph-mon[33046]: osdmap e116: 8 total, 8 up, 8 in 2024-09-21T13:41:45.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.0"}]: dispatch 2024-09-21T13:41:45.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.1"}]: dispatch 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.2"}]: dispatch 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.3"}]: dispatch 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.4"}]: dispatch 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.5"}]: dispatch 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.6"}]: dispatch 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.7"}]: dispatch 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.8"}]: dispatch 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.9"}]: dispatch 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.9 scrub starts 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.9 scrub ok 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.0 scrub starts 2024-09-21T13:41:45.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.0 scrub ok 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.1 scrub starts 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.1 scrub ok 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.4 scrub starts 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.4 scrub ok 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.7 scrub starts 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.7 scrub ok 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.3 scrub starts 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: 172.3 scrub ok 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: osdmap e117: 8 total, 8 up, 8 in 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/252667416' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi002-76384-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:45.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi002-76384-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.0"}]: dispatch 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.1"}]: dispatch 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.2"}]: dispatch 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.3"}]: dispatch 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.4"}]: dispatch 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.5"}]: dispatch 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.6"}]: dispatch 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.7"}]: dispatch 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.8"}]: dispatch 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.9"}]: dispatch 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.9 scrub starts 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.9 scrub ok 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.0 scrub starts 2024-09-21T13:41:45.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.0 scrub ok 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.1 scrub starts 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.1 scrub ok 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.4 scrub starts 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.4 scrub ok 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.7 scrub starts 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.7 scrub ok 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.3 scrub starts 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: 172.3 scrub ok 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: osdmap e117: 8 total, 8 up, 8 in 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/252667416' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi002-76384-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:45.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:45 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi002-76384-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:45.901 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.0"}]: dispatch 2024-09-21T13:41:45.901 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.1"}]: dispatch 2024-09-21T13:41:45.901 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.2"}]: dispatch 2024-09-21T13:41:45.901 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.3"}]: dispatch 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.4"}]: dispatch 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.5"}]: dispatch 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.6"}]: dispatch 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.7"}]: dispatch 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.8"}]: dispatch 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "172.9"}]: dispatch 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.9 scrub starts 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.9 scrub ok 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.0 scrub starts 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.0 scrub ok 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.1 scrub starts 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.1 scrub ok 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.4 scrub starts 2024-09-21T13:41:45.902 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.4 scrub ok 2024-09-21T13:41:45.903 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:45.903 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.7 scrub starts 2024-09-21T13:41:45.903 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.7 scrub ok 2024-09-21T13:41:45.903 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.3 scrub starts 2024-09-21T13:41:45.903 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: 172.3 scrub ok 2024-09-21T13:41:45.903 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: osdmap e117: 8 total, 8 up, 8 in 2024-09-21T13:41:45.903 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/252667416' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi002-76384-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:45.903 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:45 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi002-76384-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:46.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[30076]: pgmap v126: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 13 KiB/s rd, 61 KiB/s wr, 72 op/s 2024-09-21T13:41:46.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[30076]: 172.5 scrub starts 2024-09-21T13:41:46.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[30076]: 172.5 scrub ok 2024-09-21T13:41:46.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:46.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi002-76384-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:46.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[30076]: osdmap e118: 8 total, 8 up, 8 in 2024-09-21T13:41:46.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3017200942' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushPP_smithi002-76395-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[40622]: pgmap v126: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 13 KiB/s rd, 61 KiB/s wr, 72 op/s 2024-09-21T13:41:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[40622]: 172.5 scrub starts 2024-09-21T13:41:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[40622]: 172.5 scrub ok 2024-09-21T13:41:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi002-76384-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:46.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[40622]: osdmap e118: 8 total, 8 up, 8 in 2024-09-21T13:41:46.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3017200942' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushPP_smithi002-76395-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:46.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:46 smithi162 ceph-mon[33046]: pgmap v126: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 13 KiB/s rd, 61 KiB/s wr, 72 op/s 2024-09-21T13:41:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:46 smithi162 ceph-mon[33046]: 172.5 scrub starts 2024-09-21T13:41:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:46 smithi162 ceph-mon[33046]: 172.5 scrub ok 2024-09-21T13:41:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:46 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi002-76384-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:46 smithi162 ceph-mon[33046]: osdmap e118: 8 total, 8 up, 8 in 2024-09-21T13:41:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3017200942' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushPP_smithi002-76395-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:47.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[30076]: 172.6 scrub starts 2024-09-21T13:41:47.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[30076]: 172.6 scrub ok 2024-09-21T13:41:47.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:47.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3017200942' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi002-76395-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:47.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[30076]: osdmap e119: 8 total, 8 up, 8 in 2024-09-21T13:41:47.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:47.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:47.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[40622]: 172.6 scrub starts 2024-09-21T13:41:47.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[40622]: 172.6 scrub ok 2024-09-21T13:41:47.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:47.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3017200942' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi002-76395-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:47.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[40622]: osdmap e119: 8 total, 8 up, 8 in 2024-09-21T13:41:47.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:47.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:47 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:47 smithi162 ceph-mon[33046]: 172.6 scrub starts 2024-09-21T13:41:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:47 smithi162 ceph-mon[33046]: 172.6 scrub ok 2024-09-21T13:41:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3017200942' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi002-76395-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:47 smithi162 ceph-mon[33046]: osdmap e119: 8 total, 8 up, 8 in 2024-09-21T13:41:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:47 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:48.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[40622]: pgmap v129: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-21T13:41:48.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:48.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[40622]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:48.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"}]': finished 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[40622]: osdmap e120: 8 total, 8 up, 8 in 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2965809673' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStat_smithi002-76384-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[30076]: pgmap v129: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[30076]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"}]': finished 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[30076]: osdmap e120: 8 total, 8 up, 8 in 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2965809673' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStat_smithi002-76384-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:48.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:41:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:41:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:48 smithi162 ceph-mon[33046]: pgmap v129: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-21T13:41:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:48 smithi162 ceph-mon[33046]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:48 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"}]': finished 2024-09-21T13:41:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:48 smithi162 ceph-mon[33046]: osdmap e120: 8 total, 8 up, 8 in 2024-09-21T13:41:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/666941514' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:48 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"} : dispatch 2024-09-21T13:41:48.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2965809673' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStat_smithi002-76384-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: Running main() from gmock_main.cc 2024-09-21T13:41:49.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-09-21T13:41:49.369 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [----------] Global test environment set-up. 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (2015 ms) 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2029 ms) 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2027 ms) 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (1574 ms) 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (7645 ms total) 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4062 ms) 2024-09-21T13:41:49.370 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (4038 ms) 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5018 ms) 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (13118 ms total) 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (2971 ms) 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2024 ms) 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2030 ms) 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2007 ms) 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (9032 ms total) 2024-09-21T13:41:49.371 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: 2024-09-21T13:41:49.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-21T13:41:49.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-21T13:41:49.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4034 ms) 2024-09-21T13:41:49.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-21T13:41:49.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4035 ms) 2024-09-21T13:41:49.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8069 ms total) 2024-09-21T13:41:49.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: 2024-09-21T13:41:49.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [----------] Global test environment tear-down 2024-09-21T13:41:49.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (55365 ms total) 2024-09-21T13:41:49.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-09-21T13:41:49.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:41:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:41:49.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"}]': finished 2024-09-21T13:41:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2965809673' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi002-76384-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[30076]: osdmap e121: 8 total, 8 up, 8 in 2024-09-21T13:41:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2234160474' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76797-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76797-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1333925549' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi002-76395-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi002-76395-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:49.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:49.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"}]': finished 2024-09-21T13:41:49.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2965809673' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi002-76384-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:49.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[40622]: osdmap e121: 8 total, 8 up, 8 in 2024-09-21T13:41:49.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2234160474' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76797-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76797-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1333925549' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi002-76395-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi002-76395-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:49 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi002-76731-15"}]': finished 2024-09-21T13:41:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2965809673' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi002-76384-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:49.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:49 smithi162 ceph-mon[33046]: osdmap e121: 8 total, 8 up, 8 in 2024-09-21T13:41:49.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2234160474' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76797-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76797-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1333925549' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi002-76395-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:49.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi002-76395-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:50.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:50 smithi002 ceph-mon[30076]: pgmap v132: 420 pgs: 96 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 44 KiB/s rd, 58 op/s 2024-09-21T13:41:50.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:50.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76797-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:50.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi002-76395-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:50 smithi002 ceph-mon[30076]: osdmap e122: 8 total, 8 up, 8 in 2024-09-21T13:41:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:50 smithi002 ceph-mon[40622]: pgmap v132: 420 pgs: 96 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 44 KiB/s rd, 58 op/s 2024-09-21T13:41:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76797-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi002-76395-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:50 smithi002 ceph-mon[40622]: osdmap e122: 8 total, 8 up, 8 in 2024-09-21T13:41:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:50 smithi162 ceph-mon[33046]: pgmap v132: 420 pgs: 96 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 44 KiB/s rd, 58 op/s 2024-09-21T13:41:50.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:50.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76797-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:50.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi002-76395-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:50.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:50 smithi162 ceph-mon[33046]: osdmap e122: 8 total, 8 up, 8 in 2024-09-21T13:41:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:51 smithi002 ceph-mon[30076]: osdmap e123: 8 total, 8 up, 8 in 2024-09-21T13:41:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1115986935' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76384-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:51 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76384-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:51 smithi002 ceph-mon[40622]: osdmap e123: 8 total, 8 up, 8 in 2024-09-21T13:41:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1115986935' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76384-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:51 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76384-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:51 smithi162 ceph-mon[33046]: osdmap e123: 8 total, 8 up, 8 in 2024-09-21T13:41:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1115986935' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76384-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:51 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76384-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:52.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:52 smithi002 ceph-mon[30076]: pgmap v135: 388 pgs: 96 unknown, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 46 KiB/s rd, 58 op/s 2024-09-21T13:41:52.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:52.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76384-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:52.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:52 smithi002 ceph-mon[30076]: osdmap e124: 8 total, 8 up, 8 in 2024-09-21T13:41:52.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1848250141' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi002-76395-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:52 smithi002 ceph-mon[40622]: pgmap v135: 388 pgs: 96 unknown, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 46 KiB/s rd, 58 op/s 2024-09-21T13:41:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76384-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:52 smithi002 ceph-mon[40622]: osdmap e124: 8 total, 8 up, 8 in 2024-09-21T13:41:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1848250141' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi002-76395-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:52 smithi162 ceph-mon[33046]: pgmap v135: 388 pgs: 96 unknown, 292 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 46 KiB/s rd, 58 op/s 2024-09-21T13:41:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76384-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:52 smithi162 ceph-mon[33046]: osdmap e124: 8 total, 8 up, 8 in 2024-09-21T13:41:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1848250141' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi002-76395-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:53.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:53.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:53.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1848250141' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi002-76395-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:53.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[30076]: osdmap e125: 8 total, 8 up, 8 in 2024-09-21T13:41:53.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:53.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:53.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:53.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:53.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1848250141' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi002-76395-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:53.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[40622]: osdmap e125: 8 total, 8 up, 8 in 2024-09-21T13:41:53.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:53.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:53 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1848250141' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi002-76395-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:53 smithi162 ceph-mon[33046]: osdmap e125: 8 total, 8 up, 8 in 2024-09-21T13:41:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:41:54.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[40622]: pgmap v138: 356 pgs: 24 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:41:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[40622]: osdmap e126: 8 total, 8 up, 8 in 2024-09-21T13:41:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi002-76797-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi002-76797-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1723272053' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi002-76384-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:54.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[30076]: pgmap v138: 356 pgs: 24 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:41:54.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:54.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:54.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[30076]: osdmap e126: 8 total, 8 up, 8 in 2024-09-21T13:41:54.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi002-76797-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:54.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi002-76797-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:54.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1723272053' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi002-76384-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:54 smithi162 ceph-mon[33046]: pgmap v138: 356 pgs: 24 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:41:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:41:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:54 smithi162 ceph-mon[33046]: osdmap e126: 8 total, 8 up, 8 in 2024-09-21T13:41:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi002-76797-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi002-76797-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:41:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1723272053' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi002-76384-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1723272053' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi002-76384-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:55 smithi162 ceph-mon[33046]: osdmap e127: 8 total, 8 up, 8 in 2024-09-21T13:41:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3426497454' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1723272053' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi002-76384-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:55 smithi002 ceph-mon[40622]: osdmap e127: 8 total, 8 up, 8 in 2024-09-21T13:41:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3426497454' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1723272053' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi002-76384-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:55 smithi002 ceph-mon[30076]: osdmap e127: 8 total, 8 up, 8 in 2024-09-21T13:41:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3426497454' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:56.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:56 smithi162 ceph-mon[33046]: pgmap v141: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:41:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi002-76797-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"}]': finished 2024-09-21T13:41:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:56 smithi162 ceph-mon[33046]: osdmap e128: 8 total, 8 up, 8 in 2024-09-21T13:41:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:56 smithi002 ceph-mon[40622]: pgmap v141: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:41:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi002-76797-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"}]': finished 2024-09-21T13:41:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:56 smithi002 ceph-mon[40622]: osdmap e128: 8 total, 8 up, 8 in 2024-09-21T13:41:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:56 smithi002 ceph-mon[30076]: pgmap v141: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:41:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi002-76797-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"}]': finished 2024-09-21T13:41:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:56 smithi002 ceph-mon[30076]: osdmap e128: 8 total, 8 up, 8 in 2024-09-21T13:41:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:57 smithi002 ceph-mon[30076]: osdmap e129: 8 total, 8 up, 8 in 2024-09-21T13:41:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2511729335' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi002-76384-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi002-76384-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:57 smithi002 ceph-mon[40622]: osdmap e129: 8 total, 8 up, 8 in 2024-09-21T13:41:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2511729335' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi002-76384-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi002-76384-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:57 smithi162 ceph-mon[33046]: osdmap e129: 8 total, 8 up, 8 in 2024-09-21T13:41:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2511729335' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi002-76384-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi002-76384-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:58.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:41:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:41:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:58 smithi162 ceph-mon[33046]: pgmap v144: 364 pgs: 40 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi002-76384-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:58 smithi162 ceph-mon[33046]: osdmap e130: 8 total, 8 up, 8 in 2024-09-21T13:41:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/426759536' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi002-76395-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi002-76395-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:58 smithi162 ceph-mon[33046]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[30076]: pgmap v144: 364 pgs: 40 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi002-76384-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[30076]: osdmap e130: 8 total, 8 up, 8 in 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/426759536' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi002-76395-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi002-76395-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[30076]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[40622]: pgmap v144: 364 pgs: 40 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi002-76384-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[40622]: osdmap e130: 8 total, 8 up, 8 in 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/426759536' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi002-76395-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi002-76395-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:58 smithi002 ceph-mon[40622]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:41:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:59 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:41:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:41:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T13:41:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:41:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi002-76395-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T13:41:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:59 smithi162 ceph-mon[33046]: osdmap e131: 8 total, 8 up, 8 in 2024-09-21T13:41:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app2"} : dispatch 2024-09-21T13:41:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:41:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:41:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:42:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T13:42:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi002-76395-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[40622]: osdmap e131: 8 total, 8 up, 8 in 2024-09-21T13:42:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app2"} : dispatch 2024-09-21T13:42:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T13:42:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi002-76395-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[30076]: osdmap e131: 8 total, 8 up, 8 in 2024-09-21T13:42:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app2"} : dispatch 2024-09-21T13:42:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:41:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:00 smithi162 ceph-mon[33046]: pgmap v147: 364 pgs: 32 creating+peering, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:00 smithi162 ceph-mon[33046]: osdmap e132: 8 total, 8 up, 8 in 2024-09-21T13:42:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"dne","key":"key1","value":"value1"} : dispatch 2024-09-21T13:42:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4155984656' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi002-76384-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T13:42:00.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi002-76384-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[30076]: pgmap v147: 364 pgs: 32 creating+peering, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[30076]: osdmap e132: 8 total, 8 up, 8 in 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"dne","key":"key1","value":"value1"} : dispatch 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4155984656' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi002-76384-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi002-76384-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[40622]: pgmap v147: 364 pgs: 32 creating+peering, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi002-76586-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[40622]: osdmap e132: 8 total, 8 up, 8 in 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"dne","key":"key1","value":"value1"} : dispatch 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4155984656' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi002-76384-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1","value":"value1"} : dispatch 2024-09-21T13:42:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_smithi002-76384-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:01.334 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2024-09-21T13:42:01.334 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-09-21T13:42:01.334 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-09-21T13:42:01.334 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-09-21T13:42:01.334 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: seed 76797 2024-09-21T13:42:01.334 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-21T13:42:01.334 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (2015 ms) 2024-09-21T13:42:01.334 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-21T13:42:01.334 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2036 ms) 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2020 ms) 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1575 ms) 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4040 ms) 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (11686 ms total) 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4127 ms) 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3876 ms) 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-21T13:42:01.335 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6019 ms) 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3982 ms) 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2114 ms) 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5104-g44178494/rpm/el9/BUILD/ceph-19.3.0-5104-g44178494/src/test/librados/snapshots_cxx.cc:460: Skipped 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi002-76797-7 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: waiting for snaps to purge 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17885 ms) 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (38003 ms total) 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-21T13:42:01.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-21T13:42:01.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (9 ms) 2024-09-21T13:42:01.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-21T13:42:01.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5052 ms) 2024-09-21T13:42:01.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5061 ms total) 2024-09-21T13:42:01.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: 2024-09-21T13:42:01.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-09-21T13:42:01.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-21T13:42:01.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (2933 ms) 2024-09-21T13:42:01.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-21T13:42:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T13:42:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi002-76384-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:01 smithi162 ceph-mon[33046]: osdmap e133: 8 total, 8 up, 8 in 2024-09-21T13:42:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T13:42:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3576671497' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi002-76395-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T13:42:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi002-76384-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[40622]: osdmap e133: 8 total, 8 up, 8 in 2024-09-21T13:42:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T13:42:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3576671497' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi002-76395-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-21T13:42:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi002-76384-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[30076]: osdmap e133: 8 total, 8 up, 8 in 2024-09-21T13:42:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key2","value":"value2"} : dispatch 2024-09-21T13:42:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3576671497' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi002-76395-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:02 smithi162 ceph-mon[33046]: pgmap v150: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T13:42:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3576671497' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi002-76395-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:02 smithi162 ceph-mon[33046]: osdmap e134: 8 total, 8 up, 8 in 2024-09-21T13:42:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1"} : dispatch 2024-09-21T13:42:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[30076]: pgmap v150: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T13:42:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3576671497' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi002-76395-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[30076]: osdmap e134: 8 total, 8 up, 8 in 2024-09-21T13:42:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1"} : dispatch 2024-09-21T13:42:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[40622]: pgmap v150: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-21T13:42:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3576671497' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi002-76395-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[40622]: osdmap e134: 8 total, 8 up, 8 in 2024-09-21T13:42:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1"} : dispatch 2024-09-21T13:42:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1"}]': finished 2024-09-21T13:42:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:03 smithi162 ceph-mon[33046]: osdmap e135: 8 total, 8 up, 8 in 2024-09-21T13:42:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/357430385' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClass_smithi002-76384-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClass_smithi002-76384-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1"}]': finished 2024-09-21T13:42:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:03 smithi002 ceph-mon[30076]: osdmap e135: 8 total, 8 up, 8 in 2024-09-21T13:42:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/357430385' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClass_smithi002-76384-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClass_smithi002-76384-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/985167689' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi002-76586-1","app":"app1","key":"key1"}]': finished 2024-09-21T13:42:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:03 smithi002 ceph-mon[40622]: osdmap e135: 8 total, 8 up, 8 in 2024-09-21T13:42:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/357430385' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClass_smithi002-76384-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClass_smithi002-76384-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:04.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosS api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-09-21T13:42:04.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: seed 76586 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (379 ms) 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (14 ms) 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-21T13:42:04.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (10 ms) 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (16 ms) 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (3 ms) 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (3 ms) 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (4 ms) 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (2 ms) 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (12 ms) 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (3 ms) 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-21T13:42:04.353 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (6 ms) 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (8 ms) 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: osd_max_attr_size = 0 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (1948 ms) 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (364 ms) 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: done waiting, doing copies 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: waiting for final deep scrubs... 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: done waiting 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60793 ms) 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-21T13:42:04.354 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (5 ms) 2024-09-21T13:42:04.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-21T13:42:04.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (2 ms) 2024-09-21T13:42:04.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-09-21T13:42:04.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4078 ms) 2024-09-21T13:42:04.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-21T13:42:04.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-21T13:42:04.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-21T13:42:04.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-21T13:42:04.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-09-21T13:42:04.355 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-21T13:42:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:04 smithi162 ceph-mon[33046]: pgmap v153: 364 pgs: 26 creating+peering, 6 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:42:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi002-76384-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:04 smithi162 ceph-mon[33046]: osdmap e136: 8 total, 8 up, 8 in 2024-09-21T13:42:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2872134377' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi002-76395-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76586-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[30076]: pgmap v153: 364 pgs: 26 creating+peering, 6 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:42:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi002-76384-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[30076]: osdmap e136: 8 total, 8 up, 8 in 2024-09-21T13:42:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2872134377' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi002-76395-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76586-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[40622]: pgmap v153: 364 pgs: 26 creating+peering, 6 unknown, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:42:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi002-76384-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[40622]: osdmap e136: 8 total, 8 up, 8 in 2024-09-21T13:42:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2872134377' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi002-76395-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:05.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76586-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2872134377' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi002-76395-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76586-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:05 smithi162 ceph-mon[33046]: osdmap e137: 8 total, 8 up, 8 in 2024-09-21T13:42:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76586-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2872134377' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi002-76395-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76586-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:05 smithi002 ceph-mon[30076]: osdmap e137: 8 total, 8 up, 8 in 2024-09-21T13:42:06.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76586-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2872134377' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi002-76395-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76586-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:05 smithi002 ceph-mon[40622]: osdmap e137: 8 total, 8 up, 8 in 2024-09-21T13:42:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76586-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:06 smithi162 ceph-mon[33046]: pgmap v156: 332 pgs: 32 unknown, 300 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:42:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:06 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:06 smithi162 ceph-mon[33046]: osdmap e138: 8 total, 8 up, 8 in 2024-09-21T13:42:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2317015042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWrite_smithi002-76384-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[40622]: pgmap v156: 332 pgs: 32 unknown, 300 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:42:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[40622]: osdmap e138: 8 total, 8 up, 8 in 2024-09-21T13:42:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:07.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2317015042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWrite_smithi002-76384-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:07.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:07.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[30076]: pgmap v156: 332 pgs: 32 unknown, 300 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:42:07.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:07.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:07.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[30076]: osdmap e138: 8 total, 8 up, 8 in 2024-09-21T13:42:07.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:07.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2317015042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWrite_smithi002-76384-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:07.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76586-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76586-24"}]': finished 2024-09-21T13:42:07.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2317015042' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi002-76384-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:07.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"}]': finished 2024-09-21T13:42:07.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:07 smithi162 ceph-mon[33046]: osdmap e139: 8 total, 8 up, 8 in 2024-09-21T13:42:07.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:07.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:07.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2871228484' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi002-76395-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:07.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi002-76395-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:08.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76586-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76586-24"}]': finished 2024-09-21T13:42:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2317015042' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi002-76384-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"}]': finished 2024-09-21T13:42:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[40622]: osdmap e139: 8 total, 8 up, 8 in 2024-09-21T13:42:08.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:08.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:08.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2871228484' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi002-76395-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:08.104 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi002-76395-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:08.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:08.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76586-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76586-24"}]': finished 2024-09-21T13:42:08.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2317015042' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi002-76384-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:08.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi002-76797-16"}]': finished 2024-09-21T13:42:08.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[30076]: osdmap e139: 8 total, 8 up, 8 in 2024-09-21T13:42:08.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/684996366' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:08.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"} : dispatch 2024-09-21T13:42:08.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2871228484' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi002-76395-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:08.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi002-76395-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:08.376 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP snapshots: Running main() from gmock_main.cc 2024-09-21T13:42:08.376 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-09-21T13:42:08.376 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [----------] Global test environment set-up. 2024-09-21T13:42:08.376 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-09-21T13:42:08.376 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-09-21T13:42:08.376 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (4358 ms) 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (4583 ms) 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (4040 ms) 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (4994 ms) 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (6988 ms) 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (24964 ms total) 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-09-21T13:42:08.377 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (5003 ms) 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (6093 ms) 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (7909 ms) 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6012 ms) 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4017 ms) 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi002-77780-11. 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: Waiting for snaps to purge. 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (20011 ms) 2024-09-21T13:42:08.378 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (49045 ms total) 2024-09-21T13:42:08.379 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: 2024-09-21T13:42:08.379 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [----------] Global test environment tear-down 2024-09-21T13:42:08.379 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (74009 ms total) 2024-09-21T13:42:08.379 INFO:tasks.workunit.client.0.smithi002.stdout: snapshots: [ PASSED ] 11 tests. 2024-09-21T13:42:08.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:42:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: pgmap v159: 364 pgs: 72 unknown, 292 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:42:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"}]': finished 2024-09-21T13:42:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi002-76395-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: osdmap e140: 8 total, 8 up, 8 in 2024-09-21T13:42:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:08.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:08.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:08.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:08.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:08.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: pgmap v159: 364 pgs: 72 unknown, 292 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:42:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"}]': finished 2024-09-21T13:42:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi002-76395-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:09.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: osdmap e140: 8 total, 8 up, 8 in 2024-09-21T13:42:09.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:09.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:09.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:09.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:09.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:09.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:09.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: pgmap v159: 364 pgs: 72 unknown, 292 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-21T13:42:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi002-76797-16"}]': finished 2024-09-21T13:42:09.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi002-76395-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:09.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: osdmap e140: 8 total, 8 up, 8 in 2024-09-21T13:42:09.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:09.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:09.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:09.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:09.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:09.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:09.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:09 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:09 smithi162 ceph-mon[33046]: osdmap e141: 8 total, 8 up, 8 in 2024-09-21T13:42:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3542034889' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi002-76384-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:09.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi002-76384-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:09.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:10.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:42:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:42:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[30076]: osdmap e141: 8 total, 8 up, 8 in 2024-09-21T13:42:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3542034889' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi002-76384-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi002-76384-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:10.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:10.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:10.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:10.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[40622]: osdmap e141: 8 total, 8 up, 8 in 2024-09-21T13:42:10.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3542034889' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi002-76384-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:10.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:10.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:10.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_smithi002-76384-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:10.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:10 smithi162 ceph-mon[33046]: pgmap v162: 332 pgs: 32 creating+peering, 32 unknown, 268 active+clean; 592 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:42:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi002-76384-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:10 smithi162 ceph-mon[33046]: osdmap e142: 8 total, 8 up, 8 in 2024-09-21T13:42:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2395151651' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76395-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76395-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[30076]: pgmap v162: 332 pgs: 32 creating+peering, 32 unknown, 268 active+clean; 592 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:42:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi002-76384-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[30076]: osdmap e142: 8 total, 8 up, 8 in 2024-09-21T13:42:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2395151651' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76395-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76395-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[40622]: pgmap v162: 332 pgs: 32 creating+peering, 32 unknown, 268 active+clean; 592 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:42:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi002-76384-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76586-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[40622]: osdmap e142: 8 total, 8 up, 8 in 2024-09-21T13:42:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2395151651' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76395-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76395-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:11.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:11.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"}]': finished 2024-09-21T13:42:11.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76395-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:11.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:11 smithi162 ceph-mon[33046]: osdmap e143: 8 total, 8 up, 8 in 2024-09-21T13:42:11.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:11.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:11.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi002-76384-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"}]': finished 2024-09-21T13:42:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76395-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[30076]: osdmap e143: 8 total, 8 up, 8 in 2024-09-21T13:42:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi002-76384-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:12.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:12.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"}]': finished 2024-09-21T13:42:12.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi002-76395-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:12.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[40622]: osdmap e143: 8 total, 8 up, 8 in 2024-09-21T13:42:12.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:12.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:12.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi002-76384-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:12 smithi162 ceph-mon[33046]: pgmap v165: 308 pgs: 40 unknown, 268 active+clean; 592 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:12 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi002-76384-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:12 smithi162 ceph-mon[33046]: osdmap e144: 8 total, 8 up, 8 in 2024-09-21T13:42:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWrite_smithi002-76384-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[30076]: pgmap v165: 308 pgs: 40 unknown, 268 active+clean; 592 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi002-76384-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[30076]: osdmap e144: 8 total, 8 up, 8 in 2024-09-21T13:42:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWrite_smithi002-76384-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[40622]: pgmap v165: 308 pgs: 40 unknown, 268 active+clean; 592 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi002-76384-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[40622]: osdmap e144: 8 total, 8 up, 8 in 2024-09-21T13:42:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWrite_smithi002-76384-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76586-24"}]': finished 2024-09-21T13:42:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:13 smithi162 ceph-mon[33046]: osdmap e145: 8 total, 8 up, 8 in 2024-09-21T13:42:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4177478050' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi002-76395-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi002-76395-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76586-24"}]': finished 2024-09-21T13:42:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[40622]: osdmap e145: 8 total, 8 up, 8 in 2024-09-21T13:42:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4177478050' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi002-76395-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi002-76395-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76586-24"}]': finished 2024-09-21T13:42:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[30076]: osdmap e145: 8 total, 8 up, 8 in 2024-09-21T13:42:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76586-24"} : dispatch 2024-09-21T13:42:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4177478050' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi002-76395-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_smithi002-76395-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:14.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:14 smithi162 ceph-mon[33046]: pgmap v168: 300 pgs: 22 creating+peering, 13 unknown, 265 active+clean; 592 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:14.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:14.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi002-76384-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi002-76384-27"}]': finished 2024-09-21T13:42:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76586-24"}]': finished 2024-09-21T13:42:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi002-76395-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:14 smithi162 ceph-mon[33046]: osdmap e146: 8 total, 8 up, 8 in 2024-09-21T13:42:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[30076]: pgmap v168: 300 pgs: 22 creating+peering, 13 unknown, 265 active+clean; 592 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi002-76384-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi002-76384-27"}]': finished 2024-09-21T13:42:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76586-24"}]': finished 2024-09-21T13:42:15.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi002-76395-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:15.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[30076]: osdmap e146: 8 total, 8 up, 8 in 2024-09-21T13:42:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[40622]: pgmap v168: 300 pgs: 22 creating+peering, 13 unknown, 265 active+clean; 592 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi002-76384-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi002-76384-27"}]': finished 2024-09-21T13:42:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2573435306' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76586-24"}]': finished 2024-09-21T13:42:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi002-76395-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:14 smithi002 ceph-mon[40622]: osdmap e146: 8 total, 8 up, 8 in 2024-09-21T13:42:15.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:15 smithi162 ceph-mon[33046]: osdmap e147: 8 total, 8 up, 8 in 2024-09-21T13:42:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2975021651' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi002-76586-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:16.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:16.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:15 smithi002 ceph-mon[30076]: osdmap e147: 8 total, 8 up, 8 in 2024-09-21T13:42:16.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2975021651' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi002-76586-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:16.001 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:16.002 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:15 smithi002 ceph-mon[40622]: osdmap e147: 8 total, 8 up, 8 in 2024-09-21T13:42:16.002 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2975021651' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi002-76586-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:16 smithi162 ceph-mon[33046]: pgmap v171: 308 pgs: 40 unknown, 268 active+clean; 608 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-09-21T13:42:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2975021651' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi002-76586-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:16 smithi162 ceph-mon[33046]: osdmap e148: 8 total, 8 up, 8 in 2024-09-21T13:42:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2853265238' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemovePP_smithi002-76395-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[30076]: pgmap v171: 308 pgs: 40 unknown, 268 active+clean; 608 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-09-21T13:42:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2975021651' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi002-76586-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[30076]: osdmap e148: 8 total, 8 up, 8 in 2024-09-21T13:42:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2853265238' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemovePP_smithi002-76395-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[40622]: pgmap v171: 308 pgs: 40 unknown, 268 active+clean; 608 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-09-21T13:42:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2975021651' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi002-76586-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[40622]: osdmap e148: 8 total, 8 up, 8 in 2024-09-21T13:42:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2853265238' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemovePP_smithi002-76395-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2853265238' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi002-76395-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi002-76384-27"}]': finished 2024-09-21T13:42:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:17 smithi162 ceph-mon[33046]: osdmap e149: 8 total, 8 up, 8 in 2024-09-21T13:42:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2853265238' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi002-76395-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi002-76384-27"}]': finished 2024-09-21T13:42:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[30076]: osdmap e149: 8 total, 8 up, 8 in 2024-09-21T13:42:18.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:18.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:18.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:18.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:18.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2853265238' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi002-76395-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:18.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi002-76384-27"}]': finished 2024-09-21T13:42:18.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[40622]: osdmap e149: 8 total, 8 up, 8 in 2024-09-21T13:42:18.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi002-76384-27"} : dispatch 2024-09-21T13:42:18.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:18.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:18.425 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: Running main() from gmock_main.cc 2024-09-21T13:42:18.425 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-09-21T13:42:18.425 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [----------] Global test environment set-up. 2024-09-21T13:42:18.425 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-09-21T13:42:18.425 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-09-21T13:42:18.425 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.TooBig (2795 ms) 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (3033 ms) 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (3040 ms) 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (2566 ms) 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (3039 ms) 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (2983 ms) 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3015 ms) 2024-09-21T13:42:18.426 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (3058 ms) 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (2954 ms) 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (2974 ms) 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3005 ms) 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3042 ms) 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3026 ms) 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2925 ms) 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-09-21T13:42:18.427 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.Flush (2990 ms) 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3007 ms) 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3017 ms) 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3010 ms) 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3014 ms) 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3009 ms) 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3017 ms) 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-09-21T13:42:18.428 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (2932 ms) 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3012 ms) 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3014 ms) 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3019 ms) 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3007 ms) 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [----------] 26 tests from LibRadosAio (77504 ms total) 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-09-21T13:42:18.429 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2024-09-21T13:42:18.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:42:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: pgmap v174: 300 pgs: 32 unknown, 268 active+clean; 608 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 4.0 KiB/s wr, 0 op/s 2024-09-21T13:42:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi002-76384-27"}]': finished 2024-09-21T13:42:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: osdmap e150: 8 total, 8 up, 8 in 2024-09-21T13:42:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:42:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3442117636' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi002-76586-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:18.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:42:18.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi002-76586-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:18.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:18.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:18.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:18.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:18.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi002-76384-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:18.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi002-76384-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: pgmap v174: 300 pgs: 32 unknown, 268 active+clean; 608 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 4.0 KiB/s wr, 0 op/s 2024-09-21T13:42:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi002-76384-27"}]': finished 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: osdmap e150: 8 total, 8 up, 8 in 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3442117636' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi002-76586-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi002-76586-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi002-76384-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:19.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi002-76384-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: pgmap v174: 300 pgs: 32 unknown, 268 active+clean; 608 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 4.0 KiB/s wr, 0 op/s 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/47455948' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi002-76384-27"}]': finished 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: osdmap e150: 8 total, 8 up, 8 in 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3442117636' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi002-76586-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13"} : dispatch 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi002-76586-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:19.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:19.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:19.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:19.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi002-76384-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:19.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi002-76384-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:19 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:19 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13"}]': finished 2024-09-21T13:42:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi002-76586-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi002-76384-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:19 smithi162 ceph-mon[33046]: osdmap e151: 8 total, 8 up, 8 in 2024-09-21T13:42:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi002-76384-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/565206574' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi002-76395-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi002-76395-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:19.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi002-76384-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:20.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:42:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:42:20.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:20.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13"}]': finished 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi002-76586-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi002-76384-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[40622]: osdmap e151: 8 total, 8 up, 8 in 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi002-76384-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/565206574' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi002-76395-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi002-76395-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi002-76384-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:20.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-13"}]': finished 2024-09-21T13:42:20.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi002-76586-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:20.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi002-76384-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:20.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[30076]: osdmap e151: 8 total, 8 up, 8 in 2024-09-21T13:42:20.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi002-76384-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:20.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/565206574' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi002-76395-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:20.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi002-76395-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:20.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForComplete_smithi002-76384-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:20 smithi162 ceph-mon[33046]: pgmap v177: 332 pgs: 32 unknown, 32 creating+peering, 268 active+clean; 610 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2024-09-21T13:42:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi002-76395-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:20 smithi162 ceph-mon[33046]: osdmap e152: 8 total, 8 up, 8 in 2024-09-21T13:42:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:20 smithi002 ceph-mon[40622]: pgmap v177: 332 pgs: 32 unknown, 32 creating+peering, 268 active+clean; 610 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2024-09-21T13:42:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi002-76395-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:20 smithi002 ceph-mon[40622]: osdmap e152: 8 total, 8 up, 8 in 2024-09-21T13:42:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:20 smithi002 ceph-mon[30076]: pgmap v177: 332 pgs: 32 unknown, 32 creating+peering, 268 active+clean; 610 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2024-09-21T13:42:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi002-76395-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:20 smithi002 ceph-mon[30076]: osdmap e152: 8 total, 8 up, 8 in 2024-09-21T13:42:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi002-76384-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi002-76384-28"}]': finished 2024-09-21T13:42:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:21 smithi162 ceph-mon[33046]: osdmap e153: 8 total, 8 up, 8 in 2024-09-21T13:42:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2303082544' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi002-76586-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi002-76586-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:22.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:22.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi002-76384-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi002-76384-28"}]': finished 2024-09-21T13:42:22.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[30076]: osdmap e153: 8 total, 8 up, 8 in 2024-09-21T13:42:22.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:22.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:22.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2303082544' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi002-76586-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:22.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi002-76586-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi002-76384-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi002-76384-28"}]': finished 2024-09-21T13:42:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[40622]: osdmap e153: 8 total, 8 up, 8 in 2024-09-21T13:42:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2303082544' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi002-76586-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:22.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi002-76586-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:22 smithi162 ceph-mon[33046]: pgmap v180: 308 pgs: 72 unknown, 236 active+clean; 610 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s wr, 1 op/s 2024-09-21T13:42:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi002-76586-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:22 smithi162 ceph-mon[33046]: osdmap e154: 8 total, 8 up, 8 in 2024-09-21T13:42:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2655519165' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OmapPP_smithi002-76395-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OmapPP_smithi002-76395-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[40622]: pgmap v180: 308 pgs: 72 unknown, 236 active+clean; 610 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s wr, 1 op/s 2024-09-21T13:42:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi002-76586-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[40622]: osdmap e154: 8 total, 8 up, 8 in 2024-09-21T13:42:23.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2655519165' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OmapPP_smithi002-76395-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:23.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OmapPP_smithi002-76395-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[30076]: pgmap v180: 308 pgs: 72 unknown, 236 active+clean; 610 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s wr, 1 op/s 2024-09-21T13:42:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi002-76586-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[30076]: osdmap e154: 8 total, 8 up, 8 in 2024-09-21T13:42:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2655519165' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OmapPP_smithi002-76395-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OmapPP_smithi002-76395-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi002-76395-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: osdmap e155: 8 total, 8 up, 8 in 2024-09-21T13:42:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:23.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:23.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:23.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:23.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi002-76395-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: osdmap e155: 8 total, 8 up, 8 in 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:24.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi002-76395-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: osdmap e155: 8 total, 8 up, 8 in 2024-09-21T13:42:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:24.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: pgmap v183: 300 pgs: 21 unknown, 279 active+clean; 610 KiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"}]': finished 2024-09-21T13:42:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi002-76586-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: osdmap e156: 8 total, 8 up, 8 in 2024-09-21T13:42:24.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:24.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:24.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi002-76586-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:24.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:24.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:24.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: pgmap v183: 300 pgs: 21 unknown, 279 active+clean; 610 KiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"}]': finished 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi002-76586-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: osdmap e156: 8 total, 8 up, 8 in 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi002-76586-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:25.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: pgmap v183: 300 pgs: 21 unknown, 279 active+clean; 610 KiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi002-76384-28"}]': finished 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4110478048' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi002-76586-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: osdmap e156: 8 total, 8 up, 8 in 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"} : dispatch 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi002-76586-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:25.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:25.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"}]': finished 2024-09-21T13:42:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-15"}]': finished 2024-09-21T13:42:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"}]': finished 2024-09-21T13:42:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-15", "mode": "writeback"} : dispatch 2024-09-21T13:42:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: osdmap e157: 8 total, 8 up, 8 in 2024-09-21T13:42:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:25.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-15", "mode": "writeback"} : dispatch 2024-09-21T13:42:25.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/41961106' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi002-76395-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:25.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi002-76395-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:25.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:25.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:25.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi002-76384-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:26.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:26.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"}]': finished 2024-09-21T13:42:26.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-15"}]': finished 2024-09-21T13:42:26.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"}]': finished 2024-09-21T13:42:26.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:26.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-15", "mode": "writeback"} : dispatch 2024-09-21T13:42:26.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: osdmap e157: 8 total, 8 up, 8 in 2024-09-21T13:42:26.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:26.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-15", "mode": "writeback"} : dispatch 2024-09-21T13:42:26.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/41961106' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi002-76395-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:26.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi002-76395-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:26.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:26.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:26.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi002-76384-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:26.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:26.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi002-76384-28"}]': finished 2024-09-21T13:42:26.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-15"}]': finished 2024-09-21T13:42:26.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"}]': finished 2024-09-21T13:42:26.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3342153179' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:26.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-15", "mode": "writeback"} : dispatch 2024-09-21T13:42:26.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: osdmap e157: 8 total, 8 up, 8 in 2024-09-21T13:42:26.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"} : dispatch 2024-09-21T13:42:26.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-15", "mode": "writeback"} : dispatch 2024-09-21T13:42:26.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/41961106' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi002-76395-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:26.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_smithi002-76395-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:26.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:26.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:26.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi002-76384-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:26.350 INFO:tasks.workunit.client.0.smithi002.stdout: napshotsECPP.SnapRemovePP (2010 ms) 2024-09-21T13:42:26.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-21T13:42:26.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2011 ms) 2024-09-21T13:42:26.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-21T13:42:26.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2006 ms) 2024-09-21T13:42:26.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8960 ms total) 2024-09-21T13:42:26.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: 2024-09-21T13:42:26.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-21T13:42:26.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-21T13:42:26.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4043 ms) 2024-09-21T13:42:26.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-21T13:42:26.351 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3990 ms) 2024-09-21T13:42:26.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-21T13:42:26.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3917 ms) 2024-09-21T13:42:26.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11950 ms total) 2024-09-21T13:42:26.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: 2024-09-21T13:42:26.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-09-21T13:42:26.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (92320 ms total) 2024-09-21T13:42:26.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-09-21T13:42:26.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-09-21T13:42:26.352 INFO:tasks.workunit.client.0.smithi002.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-21T13:42:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:26 smithi162 ceph-mon[33046]: pgmap v186: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:26 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi002-76586-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi002-76586-36"}]': finished 2024-09-21T13:42:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"}]': finished 2024-09-21T13:42:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-15", "mode": "writeback"}]': finished 2024-09-21T13:42:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi002-76395-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi002-76384-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:26 smithi162 ceph-mon[33046]: osdmap e158: 8 total, 8 up, 8 in 2024-09-21T13:42:26.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip_smithi002-76384-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[30076]: pgmap v186: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi002-76586-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi002-76586-36"}]': finished 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"}]': finished 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-15", "mode": "writeback"}]': finished 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi002-76395-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi002-76384-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[30076]: osdmap e158: 8 total, 8 up, 8 in 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip_smithi002-76384-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[40622]: pgmap v186: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi002-76586-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi002-76586-36"}]': finished 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi002-76797-21"}]': finished 2024-09-21T13:42:27.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-15", "mode": "writeback"}]': finished 2024-09-21T13:42:27.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi002-76395-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:27.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi002-76384-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:27.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[40622]: osdmap e158: 8 total, 8 up, 8 in 2024-09-21T13:42:27.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip_smithi002-76384-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:27 smithi162 ceph-mon[33046]: osdmap e159: 8 total, 8 up, 8 in 2024-09-21T13:42:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:27 smithi002 ceph-mon[30076]: osdmap e159: 8 total, 8 up, 8 in 2024-09-21T13:42:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:28.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:28.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:27 smithi002 ceph-mon[40622]: osdmap e159: 8 total, 8 up, 8 in 2024-09-21T13:42:28.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:28.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:28.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:42:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: pgmap v189: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi002-76384-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi002-76384-29"}]': finished 2024-09-21T13:42:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: osdmap e160: 8 total, 8 up, 8 in 2024-09-21T13:42:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/876662023' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi002-76395-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: pgmap v189: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi002-76384-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi002-76384-29"}]': finished 2024-09-21T13:42:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: osdmap e160: 8 total, 8 up, 8 in 2024-09-21T13:42:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/876662023' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi002-76395-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: pgmap v189: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi002-76384-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi002-76384-29"}]': finished 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: osdmap e160: 8 total, 8 up, 8 in 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15"} : dispatch 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/876662023' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi002-76395-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:29 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:29 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15"}]': finished 2024-09-21T13:42:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/876662023' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi002-76395-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"}]': finished 2024-09-21T13:42:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:29 smithi162 ceph-mon[33046]: osdmap e161: 8 total, 8 up, 8 in 2024-09-21T13:42:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:30.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:42:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:42:30.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15"}]': finished 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/876662023' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi002-76395-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"}]': finished 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[40622]: osdmap e161: 8 total, 8 up, 8 in 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-15"}]': finished 2024-09-21T13:42:30.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/876662023' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi002-76395-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:30.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi002-76586-36"}]': finished 2024-09-21T13:42:30.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[30076]: osdmap e161: 8 total, 8 up, 8 in 2024-09-21T13:42:30.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3364920533' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:30.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"} : dispatch 2024-09-21T13:42:30.372 INFO:tasks.workunit.client.0.smithi002.stdout: (67651 ms total) 2024-09-21T13:42:30.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: 2024-09-21T13:42:30.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-09-21T13:42:30.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-21T13:42:30.372 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (105 ms) 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (105 ms total) 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (32 ms) 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (8 ms) 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (40 ms total) 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (16 ms) 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-09-21T13:42:30.373 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (4 ms) 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (21 ms total) 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (38 ms) 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (7 ms) 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (45 ms total) 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1041 ms) 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1041 ms total) 2024-09-21T13:42:30.374 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: 2024-09-21T13:42:30.375 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-09-21T13:42:30.375 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (96390 ms total) 2024-09-21T13:42:30.375 INFO:tasks.workunit.client.0.smithi002.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-09-21T13:42:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:30 smithi162 ceph-mon[33046]: pgmap v192: 300 pgs: 40 creating+peering, 260 active+clean; 586 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:42:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:30 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"}]': finished 2024-09-21T13:42:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:30 smithi162 ceph-mon[33046]: osdmap e162: 8 total, 8 up, 8 in 2024-09-21T13:42:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:30 smithi002 ceph-mon[30076]: pgmap v192: 300 pgs: 40 creating+peering, 260 active+clean; 586 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:42:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:30 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"}]': finished 2024-09-21T13:42:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:30 smithi002 ceph-mon[30076]: osdmap e162: 8 total, 8 up, 8 in 2024-09-21T13:42:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:30 smithi002 ceph-mon[40622]: pgmap v192: 300 pgs: 40 creating+peering, 260 active+clean; 586 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:42:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:30 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi002-76586-36"}]': finished 2024-09-21T13:42:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:30 smithi002 ceph-mon[40622]: osdmap e162: 8 total, 8 up, 8 in 2024-09-21T13:42:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi002-76384-29"}]': finished 2024-09-21T13:42:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:31 smithi162 ceph-mon[33046]: osdmap e163: 8 total, 8 up, 8 in 2024-09-21T13:42:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1990851584' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi002-76395-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:31 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:31 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi002-76395-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:32.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:32.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi002-76384-29"}]': finished 2024-09-21T13:42:32.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[30076]: osdmap e163: 8 total, 8 up, 8 in 2024-09-21T13:42:32.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:32.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1990851584' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi002-76395-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:32.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:32.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:32.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi002-76395-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:32.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:32.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi002-76384-29"}]': finished 2024-09-21T13:42:32.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[40622]: osdmap e163: 8 total, 8 up, 8 in 2024-09-21T13:42:32.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:32.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1990851584' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi002-76395-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:32.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip_smithi002-76384-29"} : dispatch 2024-09-21T13:42:32.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:32.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:31 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi002-76395-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:32 smithi162 ceph-mon[33046]: pgmap v195: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi002-76384-29"}]': finished 2024-09-21T13:42:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi002-76395-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:32 smithi162 ceph-mon[33046]: osdmap e164: 8 total, 8 up, 8 in 2024-09-21T13:42:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:32.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:32.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:32.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi002-76384-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[30076]: pgmap v195: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi002-76384-29"}]': finished 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi002-76395-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[30076]: osdmap e164: 8 total, 8 up, 8 in 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi002-76384-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[40622]: pgmap v195: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4152632858' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi002-76384-29"}]': finished 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:33.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi002-76395-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:33.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[40622]: osdmap e164: 8 total, 8 up, 8 in 2024-09-21T13:42:33.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:33.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:33.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:33.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:33.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi002-76384-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:33.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-09-21T13:42:33.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-09-21T13:42:33.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-09-21T13:42:33.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-09-21T13:42:33.336 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (2807 ms) 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (18665 ms) 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (5999 ms) 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (2978 ms) 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (3058 ms) 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (3019 ms) 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (2914 ms) 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-21T13:42:33.337 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3025 ms) 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2982 ms) 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3012 ms) 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3008 ms) 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3012 ms) 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3011 ms) 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3018 ms) 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3013 ms) 2024-09-21T13:42:33.338 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2933 ms) 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3011 ms) 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3027 ms) 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3002 ms) 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3015 ms) 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3008 ms) 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3016 ms) 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3011 ms) 2024-09-21T13:42:33.339 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-09-21T13:42:33.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (2914 ms) 2024-09-21T13:42:33.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-09-21T13:42:33.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3018 ms) 2024-09-21T13:42:33.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-09-21T13:42:33.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3007 ms) 2024-09-21T13:42:33.340 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-21T13:42:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:33 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi002-76384-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:33 smithi162 ceph-mon[33046]: osdmap e165: 8 total, 8 up, 8 in 2024-09-21T13:42:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip2_smithi002-76384-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:34.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi002-76384-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:34.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[30076]: osdmap e165: 8 total, 8 up, 8 in 2024-09-21T13:42:34.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:34.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip2_smithi002-76384-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:34.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi002-76384-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[40622]: osdmap e165: 8 total, 8 up, 8 in 2024-09-21T13:42:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:34.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTrip2_smithi002-76384-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:34.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:34 smithi162 ceph-mon[33046]: pgmap v198: 260 pgs: 9 unknown, 251 active+clean; 586 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-17"}]': finished 2024-09-21T13:42:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-17", "mode": "writeback"} : dispatch 2024-09-21T13:42:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:34 smithi162 ceph-mon[33046]: osdmap e166: 8 total, 8 up, 8 in 2024-09-21T13:42:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/858812022' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi002-76395-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-17", "mode": "writeback"} : dispatch 2024-09-21T13:42:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi002-76395-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[30076]: pgmap v198: 260 pgs: 9 unknown, 251 active+clean; 586 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-17"}]': finished 2024-09-21T13:42:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-17", "mode": "writeback"} : dispatch 2024-09-21T13:42:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[30076]: osdmap e166: 8 total, 8 up, 8 in 2024-09-21T13:42:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/858812022' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi002-76395-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:35.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-17", "mode": "writeback"} : dispatch 2024-09-21T13:42:35.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi002-76395-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[40622]: pgmap v198: 260 pgs: 9 unknown, 251 active+clean; 586 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:42:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-17"}]': finished 2024-09-21T13:42:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-17", "mode": "writeback"} : dispatch 2024-09-21T13:42:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[40622]: osdmap e166: 8 total, 8 up, 8 in 2024-09-21T13:42:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/858812022' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi002-76395-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-17", "mode": "writeback"} : dispatch 2024-09-21T13:42:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi002-76395-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:35 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi002-76384-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi002-76384-30"}]': finished 2024-09-21T13:42:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-17", "mode": "writeback"}]': finished 2024-09-21T13:42:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi002-76395-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:35 smithi162 ceph-mon[33046]: osdmap e167: 8 total, 8 up, 8 in 2024-09-21T13:42:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi002-76384-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi002-76384-30"}]': finished 2024-09-21T13:42:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-17", "mode": "writeback"}]': finished 2024-09-21T13:42:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi002-76395-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[40622]: osdmap e167: 8 total, 8 up, 8 in 2024-09-21T13:42:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:36.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi002-76384-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi002-76384-30"}]': finished 2024-09-21T13:42:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-17", "mode": "writeback"}]': finished 2024-09-21T13:42:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi002-76395-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[30076]: osdmap e167: 8 total, 8 up, 8 in 2024-09-21T13:42:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:36 smithi162 ceph-mon[33046]: pgmap v201: 300 pgs: 40 unknown, 260 active+clean; 586 KiB data, 555 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:36 smithi162 ceph-mon[33046]: osdmap e168: 8 total, 8 up, 8 in 2024-09-21T13:42:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[30076]: pgmap v201: 300 pgs: 40 unknown, 260 active+clean; 586 KiB data, 555 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[30076]: osdmap e168: 8 total, 8 up, 8 in 2024-09-21T13:42:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:37.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[40622]: pgmap v201: 300 pgs: 40 unknown, 260 active+clean; 586 KiB data, 555 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[40622]: osdmap e168: 8 total, 8 up, 8 in 2024-09-21T13:42:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17"} : dispatch 2024-09-21T13:42:37.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:37.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:37 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:37.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17"}]': finished 2024-09-21T13:42:37.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:37 smithi162 ceph-mon[33046]: osdmap e169: 8 total, 8 up, 8 in 2024-09-21T13:42:37.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:37.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3116226623' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi002-76395-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:37.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi002-76395-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:38.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:38.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:38.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17"}]': finished 2024-09-21T13:42:38.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[40622]: osdmap e169: 8 total, 8 up, 8 in 2024-09-21T13:42:38.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:38.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3116226623' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi002-76395-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:38.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi002-76395-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:38.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:38.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:38.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-17"}]': finished 2024-09-21T13:42:38.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[30076]: osdmap e169: 8 total, 8 up, 8 in 2024-09-21T13:42:38.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:38.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3116226623' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi002-76395-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:38.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi002-76395-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:38.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:42:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:42:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:38 smithi162 ceph-mon[33046]: pgmap v204: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 555 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:38 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi002-76384-30"}]': finished 2024-09-21T13:42:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi002-76395-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:38 smithi162 ceph-mon[33046]: osdmap e170: 8 total, 8 up, 8 in 2024-09-21T13:42:38.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[40622]: pgmap v204: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 555 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi002-76384-30"}]': finished 2024-09-21T13:42:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi002-76395-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[40622]: osdmap e170: 8 total, 8 up, 8 in 2024-09-21T13:42:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:39.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[30076]: pgmap v204: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 555 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:39.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:39.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:39.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi002-76384-30"}]': finished 2024-09-21T13:42:39.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi002-76395-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:39.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[30076]: osdmap e170: 8 total, 8 up, 8 in 2024-09-21T13:42:39.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi002-76384-30"} : dispatch 2024-09-21T13:42:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:39 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi002-76384-30"}]': finished 2024-09-21T13:42:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:39 smithi162 ceph-mon[33046]: osdmap e171: 8 total, 8 up, 8 in 2024-09-21T13:42:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:39.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:39.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:39.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:39.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi002-76384-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:39.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:39 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:42:40.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:42:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:42:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi002-76384-30"}]': finished 2024-09-21T13:42:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[30076]: osdmap e171: 8 total, 8 up, 8 in 2024-09-21T13:42:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:40.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:40.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:40.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:40.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi002-76384-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:40.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:42:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2318127242' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi002-76384-30"}]': finished 2024-09-21T13:42:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[40622]: osdmap e171: 8 total, 8 up, 8 in 2024-09-21T13:42:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:40.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:40.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:40.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi002-76384-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:40.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:39 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:42:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: pgmap v207: 260 pgs: 32 unknown, 228 active+clean; 586 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:42:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:42:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:42:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi002-76384-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: osdmap e172: 8 total, 8 up, 8 in 2024-09-21T13:42:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppend_smithi002-76384-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:40.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/340381576' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi002-76395-32","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:40.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: pgmap v207: 260 pgs: 32 unknown, 228 active+clean; 586 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi002-76384-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: osdmap e172: 8 total, 8 up, 8 in 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppend_smithi002-76384-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/340381576' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi002-76395-32","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: pgmap v207: 260 pgs: 32 unknown, 228 active+clean; 586 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:42:41.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:42:41.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:42:41.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:41.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi002-76384-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:41.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: osdmap e172: 8 total, 8 up, 8 in 2024-09-21T13:42:41.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppend_smithi002-76384-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:41.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:41.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/340381576' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi002-76395-32","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:41.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/340381576' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi002-76395-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:41 smithi162 ceph-mon[33046]: osdmap e173: 8 total, 8 up, 8 in 2024-09-21T13:42:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/340381576' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi002-76395-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[30076]: osdmap e173: 8 total, 8 up, 8 in 2024-09-21T13:42:42.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/340381576' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi002-76395-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[40622]: osdmap e173: 8 total, 8 up, 8 in 2024-09-21T13:42:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:42 smithi162 ceph-mon[33046]: pgmap v210: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi002-76384-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi002-76384-31"}]': finished 2024-09-21T13:42:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-19"}]': finished 2024-09-21T13:42:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:42 smithi162 ceph-mon[33046]: osdmap e174: 8 total, 8 up, 8 in 2024-09-21T13:42:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-19", "mode": "writeback"} : dispatch 2024-09-21T13:42:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-19", "mode": "writeback"} : dispatch 2024-09-21T13:42:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[30076]: pgmap v210: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi002-76384-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi002-76384-31"}]': finished 2024-09-21T13:42:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-19"}]': finished 2024-09-21T13:42:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[30076]: osdmap e174: 8 total, 8 up, 8 in 2024-09-21T13:42:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-19", "mode": "writeback"} : dispatch 2024-09-21T13:42:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-19", "mode": "writeback"} : dispatch 2024-09-21T13:42:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[40622]: pgmap v210: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi002-76384-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi002-76384-31"}]': finished 2024-09-21T13:42:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-19"}]': finished 2024-09-21T13:42:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[40622]: osdmap e174: 8 total, 8 up, 8 in 2024-09-21T13:42:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-19", "mode": "writeback"} : dispatch 2024-09-21T13:42:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-19", "mode": "writeback"} : dispatch 2024-09-21T13:42:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:42:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:43 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:43 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-19", "mode": "writeback"}]': finished 2024-09-21T13:42:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:43 smithi162 ceph-mon[33046]: osdmap e175: 8 total, 8 up, 8 in 2024-09-21T13:42:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi002-76395-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:43.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:42:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-19", "mode": "writeback"}]': finished 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[30076]: osdmap e175: 8 total, 8 up, 8 in 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi002-76395-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-19", "mode": "writeback"}]': finished 2024-09-21T13:42:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[40622]: osdmap e175: 8 total, 8 up, 8 in 2024-09-21T13:42:44.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi002-76395-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:44.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:44.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:44 smithi162 ceph-mon[33046]: pgmap v213: 300 pgs: 22 creating+peering, 24 unknown, 254 active+clean; 598 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-21T13:42:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi002-76395-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:44 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:44 smithi162 ceph-mon[33046]: osdmap e176: 8 total, 8 up, 8 in 2024-09-21T13:42:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:44 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[40622]: pgmap v213: 300 pgs: 22 creating+peering, 24 unknown, 254 active+clean; 598 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-21T13:42:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi002-76395-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[40622]: osdmap e176: 8 total, 8 up, 8 in 2024-09-21T13:42:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:45.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:45.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:45.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[30076]: pgmap v213: 300 pgs: 22 creating+peering, 24 unknown, 254 active+clean; 598 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-21T13:42:45.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:45.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi002-76395-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:45.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:45.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[30076]: osdmap e176: 8 total, 8 up, 8 in 2024-09-21T13:42:45.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:45.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:45.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:44 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19"} : dispatch 2024-09-21T13:42:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd={ 2024-09-21T13:42:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: "prefix": "osd pool set", 2024-09-21T13:42:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: "pool": "PoolEIOFlag_smithi002-76395-33", 2024-09-21T13:42:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: "var": "eio", 2024-09-21T13:42:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: "val": "true" 2024-09-21T13:42:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: } : dispatch 2024-09-21T13:42:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi002-76384-31"}]': finished 2024-09-21T13:42:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19"}]': finished 2024-09-21T13:42:45.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd='[{ 2024-09-21T13:42:45.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: "prefix": "osd pool set", 2024-09-21T13:42:45.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: "pool": "PoolEIOFlag_smithi002-76395-33", 2024-09-21T13:42:45.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: "var": "eio", 2024-09-21T13:42:45.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: "val": "true" 2024-09-21T13:42:45.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: }]': finished 2024-09-21T13:42:45.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: osdmap e177: 8 total, 8 up, 8 in 2024-09-21T13:42:45.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:45 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:46.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd={ 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: "prefix": "osd pool set", 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: "pool": "PoolEIOFlag_smithi002-76395-33", 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: "var": "eio", 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: "val": "true" 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: } : dispatch 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi002-76384-31"}]': finished 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19"}]': finished 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd='[{ 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: "prefix": "osd pool set", 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: "pool": "PoolEIOFlag_smithi002-76395-33", 2024-09-21T13:42:46.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: "var": "eio", 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: "val": "true" 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: }]': finished 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: osdmap e177: 8 total, 8 up, 8 in 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd={ 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: "prefix": "osd pool set", 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: "pool": "PoolEIOFlag_smithi002-76395-33", 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: "var": "eio", 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: "val": "true" 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: } : dispatch 2024-09-21T13:42:46.003 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:46.004 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi002-76384-31"}]': finished 2024-09-21T13:42:46.004 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-19"}]': finished 2024-09-21T13:42:46.004 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3923961838' entity='client.admin' cmd='[{ 2024-09-21T13:42:46.004 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: "prefix": "osd pool set", 2024-09-21T13:42:46.004 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: "pool": "PoolEIOFlag_smithi002-76395-33", 2024-09-21T13:42:46.004 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: "var": "eio", 2024-09-21T13:42:46.004 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: "val": "true" 2024-09-21T13:42:46.004 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: }]': finished 2024-09-21T13:42:46.004 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: osdmap e177: 8 total, 8 up, 8 in 2024-09-21T13:42:46.004 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:45 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi002-76384-31"} : dispatch 2024-09-21T13:42:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:46 smithi162 ceph-mon[33046]: pgmap v216: 292 pgs: 32 creating+peering, 260 active+clean; 586 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:42:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi002-76384-31"}]': finished 2024-09-21T13:42:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:46 smithi162 ceph-mon[33046]: osdmap e178: 8 total, 8 up, 8 in 2024-09-21T13:42:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:46 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:46 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi002-76384-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:46 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi002-76384-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[30076]: pgmap v216: 292 pgs: 32 creating+peering, 260 active+clean; 586 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:42:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi002-76384-31"}]': finished 2024-09-21T13:42:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[30076]: osdmap e178: 8 total, 8 up, 8 in 2024-09-21T13:42:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi002-76384-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi002-76384-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[40622]: pgmap v216: 292 pgs: 32 creating+peering, 260 active+clean; 586 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3719181380' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi002-76384-31"}]': finished 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[40622]: osdmap e178: 8 total, 8 up, 8 in 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:47.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:47.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi002-76384-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:47.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:46 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi002-76384-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:47 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi002-76384-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:47 smithi162 ceph-mon[33046]: osdmap e179: 8 total, 8 up, 8 in 2024-09-21T13:42:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi002-76384-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3710016154' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi002-76395-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:47 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi002-76384-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:47 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi002-76395-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:47.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:47 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi002-76384-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[40622]: osdmap e179: 8 total, 8 up, 8 in 2024-09-21T13:42:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi002-76384-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3710016154' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi002-76395-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi002-76384-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi002-76395-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi002-76384-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[30076]: osdmap e179: 8 total, 8 up, 8 in 2024-09-21T13:42:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi002-76384-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3710016154' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi002-76395-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:48.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsComplete_smithi002-76384-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:48.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiReads_smithi002-76395-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:48.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:47 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:48.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:42:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:42:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:48 smithi162 ceph-mon[33046]: pgmap v219: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:48 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:48 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi002-76395-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:48 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:48 smithi162 ceph-mon[33046]: osdmap e180: 8 total, 8 up, 8 in 2024-09-21T13:42:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:48.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:48 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[40622]: pgmap v219: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi002-76395-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:49.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[40622]: osdmap e180: 8 total, 8 up, 8 in 2024-09-21T13:42:49.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:49.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[30076]: pgmap v219: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi002-76395-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[30076]: osdmap e180: 8 total, 8 up, 8 in 2024-09-21T13:42:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:49.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:48 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:49 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi002-76384-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi002-76384-32"}]': finished 2024-09-21T13:42:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:49 smithi162 ceph-mon[33046]: osdmap e181: 8 total, 8 up, 8 in 2024-09-21T13:42:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:50.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:42:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:42:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi002-76384-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi002-76384-32"}]': finished 2024-09-21T13:42:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[40622]: osdmap e181: 8 total, 8 up, 8 in 2024-09-21T13:42:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:50.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:50.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:50.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi002-76384-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi002-76384-32"}]': finished 2024-09-21T13:42:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[30076]: osdmap e181: 8 total, 8 up, 8 in 2024-09-21T13:42:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:50.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:50 smithi162 ceph-mon[33046]: pgmap v222: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:42:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-21"}]': finished 2024-09-21T13:42:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:50 smithi162 ceph-mon[33046]: osdmap e182: 8 total, 8 up, 8 in 2024-09-21T13:42:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3685942873' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi002-76395-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:50.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-21", "mode": "writeback"} : dispatch 2024-09-21T13:42:50.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-21", "mode": "writeback"} : dispatch 2024-09-21T13:42:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[30076]: pgmap v222: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:42:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:51.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-21"}]': finished 2024-09-21T13:42:51.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[30076]: osdmap e182: 8 total, 8 up, 8 in 2024-09-21T13:42:51.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3685942873' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi002-76395-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:51.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-21", "mode": "writeback"} : dispatch 2024-09-21T13:42:51.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-21", "mode": "writeback"} : dispatch 2024-09-21T13:42:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[40622]: pgmap v222: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:42:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:51.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-21"}]': finished 2024-09-21T13:42:51.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[40622]: osdmap e182: 8 total, 8 up, 8 in 2024-09-21T13:42:51.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3685942873' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi002-76395-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:51.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-21", "mode": "writeback"} : dispatch 2024-09-21T13:42:51.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-21", "mode": "writeback"} : dispatch 2024-09-21T13:42:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:51 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3685942873' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi002-76395-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:51 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-21", "mode": "writeback"}]': finished 2024-09-21T13:42:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:51 smithi162 ceph-mon[33046]: osdmap e183: 8 total, 8 up, 8 in 2024-09-21T13:42:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:51 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:51 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3685942873' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi002-76395-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-21", "mode": "writeback"}]': finished 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[30076]: osdmap e183: 8 total, 8 up, 8 in 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3685942873' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi002-76395-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-21", "mode": "writeback"}]': finished 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[40622]: osdmap e183: 8 total, 8 up, 8 in 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:52.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:52.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:51 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:42:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:52 smithi162 ceph-mon[33046]: pgmap v225: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"}]': finished 2024-09-21T13:42:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:52 smithi162 ceph-mon[33046]: osdmap e184: 8 total, 8 up, 8 in 2024-09-21T13:42:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:52.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[30076]: pgmap v225: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"}]': finished 2024-09-21T13:42:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[30076]: osdmap e184: 8 total, 8 up, 8 in 2024-09-21T13:42:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:53.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:53.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:53.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[40622]: pgmap v225: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi002-76384-32"}]': finished 2024-09-21T13:42:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:42:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[40622]: osdmap e184: 8 total, 8 up, 8 in 2024-09-21T13:42:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/265988424' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"} : dispatch 2024-09-21T13:42:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:53.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21"} : dispatch 2024-09-21T13:42:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"}]': finished 2024-09-21T13:42:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21"}]': finished 2024-09-21T13:42:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: osdmap e185: 8 total, 8 up, 8 in 2024-09-21T13:42:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/257462042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:53.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:53.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:53.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:53.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:53.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi002-76384-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:53.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi002-76384-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"}]': finished 2024-09-21T13:42:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21"}]': finished 2024-09-21T13:42:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: osdmap e185: 8 total, 8 up, 8 in 2024-09-21T13:42:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/257462042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi002-76384-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi002-76384-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:42:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi002-76384-32"}]': finished 2024-09-21T13:42:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-21"}]': finished 2024-09-21T13:42:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: osdmap e185: 8 total, 8 up, 8 in 2024-09-21T13:42:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/257462042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi002-76384-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:54.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi002-76384-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:42:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:54 smithi162 ceph-mon[33046]: pgmap v228: 292 pgs: 26 creating+peering, 6 unknown, 260 active+clean; 586 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:42:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:54 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi002-76384-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:54 smithi162 ceph-mon[33046]: osdmap e186: 8 total, 8 up, 8 in 2024-09-21T13:42:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi002-76384-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi002-76384-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[30076]: pgmap v228: 292 pgs: 26 creating+peering, 6 unknown, 260 active+clean; 586 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:42:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi002-76384-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[30076]: osdmap e186: 8 total, 8 up, 8 in 2024-09-21T13:42:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi002-76384-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:55.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi002-76384-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[40622]: pgmap v228: 292 pgs: 26 creating+peering, 6 unknown, 260 active+clean; 586 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:42:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:42:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi002-76384-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:42:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[40622]: osdmap e186: 8 total, 8 up, 8 in 2024-09-21T13:42:55.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi002-76384-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:55.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafe_smithi002-76384-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:55 smithi162 ceph-mon[33046]: osdmap e187: 8 total, 8 up, 8 in 2024-09-21T13:42:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/346303254' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[30076]: osdmap e187: 8 total, 8 up, 8 in 2024-09-21T13:42:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/346303254' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:56.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:56.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[40622]: osdmap e187: 8 total, 8 up, 8 in 2024-09-21T13:42:56.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:56.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/346303254' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:56.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:56.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:56 smithi162 ceph-mon[33046]: pgmap v231: 324 pgs: 64 unknown, 32 creating+peering, 228 active+clean; 586 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi002-76384-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi002-76384-33"}]': finished 2024-09-21T13:42:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:56 smithi162 ceph-mon[33046]: osdmap e188: 8 total, 8 up, 8 in 2024-09-21T13:42:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[40622]: pgmap v231: 324 pgs: 64 unknown, 32 creating+peering, 228 active+clean; 586 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi002-76384-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi002-76384-33"}]': finished 2024-09-21T13:42:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[40622]: osdmap e188: 8 total, 8 up, 8 in 2024-09-21T13:42:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[30076]: pgmap v231: 324 pgs: 64 unknown, 32 creating+peering, 228 active+clean; 586 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:42:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi002-76384-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi002-76384-33"}]': finished 2024-09-21T13:42:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:56 smithi002 ceph-mon[30076]: osdmap e188: 8 total, 8 up, 8 in 2024-09-21T13:42:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:57 smithi162 ceph-mon[33046]: osdmap e189: 8 total, 8 up, 8 in 2024-09-21T13:42:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3626327604' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-38","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:57 smithi002 ceph-mon[30076]: osdmap e189: 8 total, 8 up, 8 in 2024-09-21T13:42:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3626327604' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-38","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:58.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:58.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:57 smithi002 ceph-mon[40622]: osdmap e189: 8 total, 8 up, 8 in 2024-09-21T13:42:58.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3626327604' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-38","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:42:58.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:58.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:42:58.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:42:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:42:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:58 smithi162 ceph-mon[33046]: pgmap v234: 364 pgs: 104 unknown, 32 creating+peering, 228 active+clean; 586 KiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3626327604' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:58 smithi162 ceph-mon[33046]: osdmap e190: 8 total, 8 up, 8 in 2024-09-21T13:42:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:42:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:42:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[30076]: pgmap v234: 364 pgs: 104 unknown, 32 creating+peering, 228 active+clean; 586 KiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3626327604' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[30076]: osdmap e190: 8 total, 8 up, 8 in 2024-09-21T13:42:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:42:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:42:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[40622]: pgmap v234: 364 pgs: 104 unknown, 32 creating+peering, 228 active+clean; 586 KiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:42:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:42:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3626327604' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi002-76395-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:42:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:42:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[40622]: osdmap e190: 8 total, 8 up, 8 in 2024-09-21T13:42:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:42:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:42:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:59.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:59 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:42:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:42:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-23"}]': finished 2024-09-21T13:42:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"}]': finished 2024-09-21T13:42:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:59 smithi162 ceph-mon[33046]: osdmap e191: 8 total, 8 up, 8 in 2024-09-21T13:42:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-23", "mode": "writeback"} : dispatch 2024-09-21T13:42:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:42:59.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:42:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-23", "mode": "writeback"} : dispatch 2024-09-21T13:43:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:42:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:43:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-23"}]': finished 2024-09-21T13:43:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"}]': finished 2024-09-21T13:43:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[30076]: osdmap e191: 8 total, 8 up, 8 in 2024-09-21T13:43:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:43:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-23", "mode": "writeback"} : dispatch 2024-09-21T13:43:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:43:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-23", "mode": "writeback"} : dispatch 2024-09-21T13:43:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-23"}]': finished 2024-09-21T13:43:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi002-76384-33"}]': finished 2024-09-21T13:43:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[40622]: osdmap e191: 8 total, 8 up, 8 in 2024-09-21T13:43:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1711405253' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:43:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-23", "mode": "writeback"} : dispatch 2024-09-21T13:43:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"} : dispatch 2024-09-21T13:43:00.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:42:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-23", "mode": "writeback"} : dispatch 2024-09-21T13:43:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:00 smithi162 ceph-mon[33046]: pgmap v237: 324 pgs: 324 active+clean; 586 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-21T13:43:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:00 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:00 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"}]': finished 2024-09-21T13:43:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-23", "mode": "writeback"}]': finished 2024-09-21T13:43:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:00 smithi162 ceph-mon[33046]: osdmap e192: 8 total, 8 up, 8 in 2024-09-21T13:43:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi002-76384-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[30076]: pgmap v237: 324 pgs: 324 active+clean; 586 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-21T13:43:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"}]': finished 2024-09-21T13:43:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-23", "mode": "writeback"}]': finished 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[30076]: osdmap e192: 8 total, 8 up, 8 in 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi002-76384-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[40622]: pgmap v237: 324 pgs: 324 active+clean; 586 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi002-76384-33"}]': finished 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-23", "mode": "writeback"}]': finished 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[40622]: osdmap e192: 8 total, 8 up, 8 in 2024-09-21T13:43:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:01.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:01.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi002-76384-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:01.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:01.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi002-76384-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:01.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"}]': finished 2024-09-21T13:43:01.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:01.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: osdmap e193: 8 total, 8 up, 8 in 2024-09-21T13:43:01.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:01.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:01.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValue_smithi002-76384-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:01.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:01.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:01.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "31"} : dispatch 2024-09-21T13:43:01.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi002-76384-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"}]': finished 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: osdmap e193: 8 total, 8 up, 8 in 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValue_smithi002-76384-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "31"} : dispatch 2024-09-21T13:43:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi002-76384-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"}]': finished 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: osdmap e193: 8 total, 8 up, 8 in 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValue_smithi002-76384-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:02.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "31"} : dispatch 2024-09-21T13:43:02.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:02 smithi162 ceph-mon[33046]: pgmap v240: 260 pgs: 260 active+clean; 586 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:43:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T13:43:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:02 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-21T13:43:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:43:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:02 smithi162 ceph-mon[33046]: osdmap e194: 8 total, 8 up, 8 in 2024-09-21T13:43:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/642943677' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:43:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[30076]: pgmap v240: 260 pgs: 260 active+clean; 586 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:43:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T13:43:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[30076]: osdmap e194: 8 total, 8 up, 8 in 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/642943677' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[40622]: pgmap v240: 260 pgs: 260 active+clean; 586 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:03.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:43:03.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[40622]: osdmap e194: 8 total, 8 up, 8 in 2024-09-21T13:43:03.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/642943677' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:03.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23"} : dispatch 2024-09-21T13:43:03.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:04.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:04.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi002-76384-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi002-76384-34"}]': finished 2024-09-21T13:43:04.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23"}]': finished 2024-09-21T13:43:04.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:04.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[40622]: osdmap e195: 8 total, 8 up, 8 in 2024-09-21T13:43:04.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[40622]: pgmap v243: 300 pgs: 6 creating+peering, 13 creating+activating, 1 activating+degraded, 10 unknown, 270 active+clean; 586 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s; 3/987 objects degraded (0.304%) 2024-09-21T13:43:04.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:04.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:04.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:04.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:04.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi002-76384-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi002-76384-34"}]': finished 2024-09-21T13:43:04.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23"}]': finished 2024-09-21T13:43:04.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:04.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[30076]: osdmap e195: 8 total, 8 up, 8 in 2024-09-21T13:43:04.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[30076]: pgmap v243: 300 pgs: 6 creating+peering, 13 creating+activating, 1 activating+degraded, 10 unknown, 270 active+clean; 586 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s; 3/987 objects degraded (0.304%) 2024-09-21T13:43:04.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:04.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:04.602 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:04 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi002-76384-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi002-76384-34"}]': finished 2024-09-21T13:43:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-23"}]': finished 2024-09-21T13:43:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:04 smithi162 ceph-mon[33046]: osdmap e195: 8 total, 8 up, 8 in 2024-09-21T13:43:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:04 smithi162 ceph-mon[33046]: pgmap v243: 300 pgs: 6 creating+peering, 13 creating+activating, 1 activating+degraded, 10 unknown, 270 active+clean; 586 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s; 3/987 objects degraded (0.304%) 2024-09-21T13:43:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"} : dispatch 2024-09-21T13:43:05.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:05 smithi002 ceph-mon[30076]: Health check failed: Degraded data redundancy: 3/987 objects degraded (0.304%), 1 pg degraded (PG_DEGRADED) 2024-09-21T13:43:05.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"}]': finished 2024-09-21T13:43:05.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:05 smithi002 ceph-mon[30076]: osdmap e196: 8 total, 8 up, 8 in 2024-09-21T13:43:05.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:05.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/988344445' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-40","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:05.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:05 smithi002 ceph-mon[40622]: Health check failed: Degraded data redundancy: 3/987 objects degraded (0.304%), 1 pg degraded (PG_DEGRADED) 2024-09-21T13:43:05.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"}]': finished 2024-09-21T13:43:05.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:05 smithi002 ceph-mon[40622]: osdmap e196: 8 total, 8 up, 8 in 2024-09-21T13:43:05.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:05.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/988344445' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-40","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:05.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:05 smithi162 ceph-mon[33046]: Health check failed: Degraded data redundancy: 3/987 objects degraded (0.304%), 1 pg degraded (PG_DEGRADED) 2024-09-21T13:43:05.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pg_num","val":"11"}]': finished 2024-09-21T13:43:05.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:05 smithi162 ceph-mon[33046]: osdmap e196: 8 total, 8 up, 8 in 2024-09-21T13:43:05.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:05.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/988344445' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-40","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/988344445' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:06 smithi162 ceph-mon[33046]: osdmap e197: 8 total, 8 up, 8 in 2024-09-21T13:43:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:06 smithi162 ceph-mon[33046]: pgmap v246: 324 pgs: 64 unknown, 13 creating+activating, 1 activating+degraded, 246 active+clean; 586 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s; 3/984 objects degraded (0.305%) 2024-09-21T13:43:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/988344445' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[30076]: osdmap e197: 8 total, 8 up, 8 in 2024-09-21T13:43:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:06.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:06.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:06.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:06.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[30076]: pgmap v246: 324 pgs: 64 unknown, 13 creating+activating, 1 activating+degraded, 246 active+clean; 586 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s; 3/984 objects degraded (0.305%) 2024-09-21T13:43:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/988344445' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:06.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[40622]: osdmap e197: 8 total, 8 up, 8 in 2024-09-21T13:43:06.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:06.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:06.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:06.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:06.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:06 smithi002 ceph-mon[40622]: pgmap v246: 324 pgs: 64 unknown, 13 creating+activating, 1 activating+degraded, 246 active+clean; 586 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s; 3/984 objects degraded (0.305%) 2024-09-21T13:43:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi002-76384-34"}]': finished 2024-09-21T13:43:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:07 smithi162 ceph-mon[33046]: osdmap e198: 8 total, 8 up, 8 in 2024-09-21T13:43:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3260858075' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi002-76384-34"}]': finished 2024-09-21T13:43:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[30076]: osdmap e198: 8 total, 8 up, 8 in 2024-09-21T13:43:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3260858075' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi002-76384-34"}]': finished 2024-09-21T13:43:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[40622]: osdmap e198: 8 total, 8 up, 8 in 2024-09-21T13:43:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValue_smithi002-76384-34"} : dispatch 2024-09-21T13:43:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3260858075' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:08.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:43:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi002-76384-34"}]': finished 2024-09-21T13:43:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: osdmap e199: 8 total, 8 up, 8 in 2024-09-21T13:43:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: pgmap v249: 356 pgs: 96 unknown, 13 creating+activating, 1 activating+degraded, 246 active+clean; 586 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 3/984 objects degraded (0.305%) 2024-09-21T13:43:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi002-76384-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi002-76384-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: osdmap e200: 8 total, 8 up, 8 in 2024-09-21T13:43:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "Flush_smithi002-76384-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:08.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3931896981' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-42","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:08.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:08.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi002-76384-34"}]': finished 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: osdmap e199: 8 total, 8 up, 8 in 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: pgmap v249: 356 pgs: 96 unknown, 13 creating+activating, 1 activating+degraded, 246 active+clean; 586 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 3/984 objects degraded (0.305%) 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi002-76384-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi002-76384-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: osdmap e200: 8 total, 8 up, 8 in 2024-09-21T13:43:08.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "Flush_smithi002-76384-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3931896981' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-42","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1307970016' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi002-76384-34"}]': finished 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: osdmap e199: 8 total, 8 up, 8 in 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: pgmap v249: 356 pgs: 96 unknown, 13 creating+activating, 1 activating+degraded, 246 active+clean; 586 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 3/984 objects degraded (0.305%) 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:08.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi002-76384-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:08.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:08.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:08.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi002-76384-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:08.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: osdmap e200: 8 total, 8 up, 8 in 2024-09-21T13:43:08.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:08.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "Flush_smithi002-76384-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:08.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:08.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3931896981' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-42","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:09 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-25"}]': finished 2024-09-21T13:43:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3931896981' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-25", "mode": "writeback"} : dispatch 2024-09-21T13:43:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:09 smithi162 ceph-mon[33046]: osdmap e201: 8 total, 8 up, 8 in 2024-09-21T13:43:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-25", "mode": "writeback"} : dispatch 2024-09-21T13:43:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:09.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:43:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:43:09.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:09.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:09.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-25"}]': finished 2024-09-21T13:43:09.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3931896981' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:09.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-25", "mode": "writeback"} : dispatch 2024-09-21T13:43:09.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[30076]: osdmap e201: 8 total, 8 up, 8 in 2024-09-21T13:43:09.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-25", "mode": "writeback"} : dispatch 2024-09-21T13:43:09.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:09.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:09.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-25"}]': finished 2024-09-21T13:43:09.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3931896981' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:09.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-25", "mode": "writeback"} : dispatch 2024-09-21T13:43:09.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[40622]: osdmap e201: 8 total, 8 up, 8 in 2024-09-21T13:43:09.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-25", "mode": "writeback"} : dispatch 2024-09-21T13:43:09.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: pgmap v252: 388 pgs: 32 creating+peering, 356 active+clean; 586 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 10 op/s; 31 B/s, 0 objects/s recovering 2024-09-21T13:43:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pg_num_actual", "val": "31"} : dispatch 2024-09-21T13:43:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi002-76384-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi002-76384-35"}]': finished 2024-09-21T13:43:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-25", "mode": "writeback"}]': finished 2024-09-21T13:43:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-21T13:43:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: osdmap e202: 8 total, 8 up, 8 in 2024-09-21T13:43:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/124821807' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:10.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:10.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: pgmap v252: 388 pgs: 32 creating+peering, 356 active+clean; 586 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 10 op/s; 31 B/s, 0 objects/s recovering 2024-09-21T13:43:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pg_num_actual", "val": "31"} : dispatch 2024-09-21T13:43:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi002-76384-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi002-76384-35"}]': finished 2024-09-21T13:43:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-25", "mode": "writeback"}]': finished 2024-09-21T13:43:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-21T13:43:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: osdmap e202: 8 total, 8 up, 8 in 2024-09-21T13:43:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/124821807' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:10.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: pgmap v252: 388 pgs: 32 creating+peering, 356 active+clean; 586 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 10 op/s; 31 B/s, 0 objects/s recovering 2024-09-21T13:43:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pg_num_actual", "val": "31"} : dispatch 2024-09-21T13:43:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi002-76384-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi002-76384-35"}]': finished 2024-09-21T13:43:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-25", "mode": "writeback"}]': finished 2024-09-21T13:43:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-21T13:43:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: osdmap e202: 8 total, 8 up, 8 in 2024-09-21T13:43:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/124821807' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:10.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:11 smithi162 ceph-mon[33046]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/984 objects degraded (0.305%), 1 pg degraded) 2024-09-21T13:43:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:11 smithi162 ceph-mon[33046]: osdmap e203: 8 total, 8 up, 8 in 2024-09-21T13:43:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:11.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[30076]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/984 objects degraded (0.305%), 1 pg degraded) 2024-09-21T13:43:11.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:11.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:11.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[30076]: osdmap e203: 8 total, 8 up, 8 in 2024-09-21T13:43:11.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:11.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:11.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[40622]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/984 objects degraded (0.305%), 1 pg degraded) 2024-09-21T13:43:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi002-76395-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[40622]: osdmap e203: 8 total, 8 up, 8 in 2024-09-21T13:43:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25"} : dispatch 2024-09-21T13:43:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:12 smithi162 ceph-mon[33046]: pgmap v255: 428 pgs: 40 unknown, 32 creating+peering, 356 active+clean; 586 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 10 op/s; 31 B/s, 0 objects/s recovering 2024-09-21T13:43:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:12 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25"}]': finished 2024-09-21T13:43:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:12 smithi162 ceph-mon[33046]: osdmap e204: 8 total, 8 up, 8 in 2024-09-21T13:43:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:12.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[30076]: pgmap v255: 428 pgs: 40 unknown, 32 creating+peering, 356 active+clean; 586 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 10 op/s; 31 B/s, 0 objects/s recovering 2024-09-21T13:43:12.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:12.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25"}]': finished 2024-09-21T13:43:12.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[30076]: osdmap e204: 8 total, 8 up, 8 in 2024-09-21T13:43:12.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:12.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[40622]: pgmap v255: 428 pgs: 40 unknown, 32 creating+peering, 356 active+clean; 586 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 10 op/s; 31 B/s, 0 objects/s recovering 2024-09-21T13:43:12.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:12.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-25"}]': finished 2024-09-21T13:43:12.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[40622]: osdmap e204: 8 total, 8 up, 8 in 2024-09-21T13:43:12.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:12.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:13.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:13.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi002-76384-35"}]': finished 2024-09-21T13:43:13.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:13 smithi002 ceph-mon[30076]: osdmap e205: 8 total, 8 up, 8 in 2024-09-21T13:43:13.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:13.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:13.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi002-76384-35"}]': finished 2024-09-21T13:43:13.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:13 smithi002 ceph-mon[40622]: osdmap e205: 8 total, 8 up, 8 in 2024-09-21T13:43:13.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:13.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi002-76384-35"}]': finished 2024-09-21T13:43:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:13 smithi162 ceph-mon[33046]: osdmap e205: 8 total, 8 up, 8 in 2024-09-21T13:43:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"Flush_smithi002-76384-35"} : dispatch 2024-09-21T13:43:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:14.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: pgmap v258: 323 pgs: 323 active+clean; 586 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:43:14.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "30"} : dispatch 2024-09-21T13:43:14.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi002-76384-35"}]': finished 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: osdmap e206: 8 total, 8 up, 8 in 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi002-76384-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi002-76384-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:14.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: pgmap v258: 323 pgs: 323 active+clean; 586 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "30"} : dispatch 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi002-76384-35"}]': finished 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: osdmap e206: 8 total, 8 up, 8 in 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi002-76384-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi002-76384-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:14.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:14.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: pgmap v258: 323 pgs: 323 active+clean; 586 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "30"} : dispatch 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/814907140' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi002-76384-35"}]': finished 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi002-76491-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: osdmap e206: 8 total, 8 up, 8 in 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi002-76384-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi002-76384-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:14.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi002-76384-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[40622]: osdmap e207: 8 total, 8 up, 8 in 2024-09-21T13:43:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi002-76384-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi002-76384-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi002-76384-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:15.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[30076]: osdmap e207: 8 total, 8 up, 8 in 2024-09-21T13:43:15.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi002-76384-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:15.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi002-76384-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:15.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:15.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:15.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:15.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:15 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi002-76384-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:15 smithi162 ceph-mon[33046]: osdmap e207: 8 total, 8 up, 8 in 2024-09-21T13:43:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi002-76384-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsync_smithi002-76384-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:15.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"} : dispatch 2024-09-21T13:43:16.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[30076]: pgmap v261: 291 pgs: 32 unknown, 259 active+clean; 586 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:43:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T13:43:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[30076]: osdmap e208: 8 total, 8 up, 8 in 2024-09-21T13:43:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[40622]: pgmap v261: 291 pgs: 32 unknown, 259 active+clean; 586 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:43:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T13:43:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[40622]: osdmap e208: 8 total, 8 up, 8 in 2024-09-21T13:43:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:16 smithi162 ceph-mon[33046]: pgmap v261: 291 pgs: 32 unknown, 259 active+clean; 586 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:43:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi002-76491-1","var":"pgp_num","val":"11"}]': finished 2024-09-21T13:43:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1119918532' entity='client.admin' cmd={"prefix":"status","format":"json"} : dispatch 2024-09-21T13:43:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:16 smithi162 ceph-mon[33046]: osdmap e208: 8 total, 8 up, 8 in 2024-09-21T13:43:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:18.707 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi002-76384-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi002-76384-36"}]': finished 2024-09-21T13:43:18.707 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:18.707 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:18.707 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-mon[33046]: osdmap e209: 8 total, 8 up, 8 in 2024-09-21T13:43:18.707 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4258388817' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi002-76395-44","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:18.707 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:18.708 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi002-76395-44","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:18.708 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:18.708 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:18.708 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi002-76491-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:18.708 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-mon[33046]: pgmap v264: 268 pgs: 72 unknown, 196 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi002-76384-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi002-76384-36"}]': finished 2024-09-21T13:43:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[30076]: osdmap e209: 8 total, 8 up, 8 in 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4258388817' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi002-76395-44","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi002-76395-44","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi002-76491-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[30076]: pgmap v264: 268 pgs: 72 unknown, 196 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi002-76384-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi002-76384-36"}]': finished 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[40622]: osdmap e209: 8 total, 8 up, 8 in 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4258388817' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi002-76395-44","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:18.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi002-76395-44","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:18.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:18.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:18.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi002-76491-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:18.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:18 smithi002 ceph-mon[40622]: pgmap v264: 268 pgs: 72 unknown, 196 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:18.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:43:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:43:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-27"}]': finished 2024-09-21T13:43:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi002-76395-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi002-76491-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[40622]: osdmap e210: 8 total, 8 up, 8 in 2024-09-21T13:43:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosListEC_smithi002-76491-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-27", "mode": "writeback"} : dispatch 2024-09-21T13:43:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-27", "mode": "writeback"} : dispatch 2024-09-21T13:43:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:19.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-27"}]': finished 2024-09-21T13:43:19.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi002-76395-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:19.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi002-76491-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:19.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[30076]: osdmap e210: 8 total, 8 up, 8 in 2024-09-21T13:43:19.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosListEC_smithi002-76491-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:19.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-27", "mode": "writeback"} : dispatch 2024-09-21T13:43:19.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-27", "mode": "writeback"} : dispatch 2024-09-21T13:43:19.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-27"}]': finished 2024-09-21T13:43:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi002-76395-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi002-76491-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:19 smithi162 ceph-mon[33046]: osdmap e210: 8 total, 8 up, 8 in 2024-09-21T13:43:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosListEC_smithi002-76491-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-27", "mode": "writeback"} : dispatch 2024-09-21T13:43:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-27", "mode": "writeback"} : dispatch 2024-09-21T13:43:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:19 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:20.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:43:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:43:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:43:20.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:20 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:20.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-27", "mode": "writeback"}]': finished 2024-09-21T13:43:20.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:20 smithi162 ceph-mon[33046]: osdmap e211: 8 total, 8 up, 8 in 2024-09-21T13:43:20.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:20.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:20.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:20 smithi162 ceph-mon[33046]: pgmap v267: 228 pgs: 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-27", "mode": "writeback"}]': finished 2024-09-21T13:43:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[30076]: osdmap e211: 8 total, 8 up, 8 in 2024-09-21T13:43:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[30076]: pgmap v267: 228 pgs: 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-27", "mode": "writeback"}]': finished 2024-09-21T13:43:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[40622]: osdmap e211: 8 total, 8 up, 8 in 2024-09-21T13:43:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:20 smithi002 ceph-mon[40622]: pgmap v267: 228 pgs: 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:21.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioexpected=0 2024-09-21T13:43:21.452 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:62a1935d:::14:head 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:62a1935d:::14:head expected=14:62a1935d:::14:head 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:62a1935d:::14:head -> 14 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=14 expected=14 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:52ea6a34:::10:head 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:52ea6a34:::10:head expected=14:52ea6a34:::10:head 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:52ea6a34:::10:head -> 10 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=10 expected=10 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:f905c69b:::2:head 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:f905c69b:::2:head expected=14:f905c69b:::2:head 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:f905c69b:::2:head -> 2 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=2 expected=2 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:e960b815:::9:head 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:e960b815:::9:head expected=14:e960b815:::9:head 2024-09-21T13:43:21.453 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:e960b815:::9:head -> 9 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=9 expected=9 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:de5d7c5f:::12:head 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:de5d7c5f:::12:head expected=14:de5d7c5f:::12:head 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:de5d7c5f:::12:head -> 12 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=12 expected=12 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:5c6b0b28:::7:head 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:5c6b0b28:::7:head expected=14:5c6b0b28:::7:head 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:5c6b0b28:::7:head -> 7 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=7 expected=7 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:566253c9:::13:head 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:566253c9:::13:head expected=14:566253c9:::13:head 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:566253c9:::13:head -> 13 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=13 expected=13 2024-09-21T13:43:21.454 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : seek to 14:02547ec2:::1:head 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : cursor()=14:02547ec2:::1:head expected=14:02547ec2:::1:head 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: > 14:02547ec2:::1:head -> 1 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: : entry=1 expected=1 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (232 ms) 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (126943 ms) 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: split 0/5 -> MIN 14:33333333::::head 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: split 1/5 -> 14:33333333::::head 14:66666666::::head 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: split 2/5 -> 14:66666666::::head 14:99999999::::head 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: split 3/5 -> 14:99999999::::head 14:cccccccc::::head 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: split 4/5 -> 14:cccccccc::::head MAX 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (12922 ms) 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [----------] 7 tests from LibRadosList (140773 ms total) 2024-09-21T13:43:21.455 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1043 ms) 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: myset foo1,foo2,foo3 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo1 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo2 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo3 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: myset foo1,foo4,foo5 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo4 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo5 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo1 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: myset foo6,foo7 2024-09-21T13:43:21.456 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo7 2024-09-21T13:43:21.457 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: foo6 2024-09-21T13:43:21.457 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-21T13:43:21.457 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: ns1:foo4 2024-09-21T13:43:21.457 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: ns1:foo5 2024-09-21T13:43:21.457 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: ns2:foo7 2024-09-21T13:43:21.457 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: ns2:foo6 2024-09-21T13:43:21.457 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: ns1:foo1 2024-09-21T13:43:21.457 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: :foo1 2024-09-21T13:43:21.457 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: :foo2 2024-09-21T13:43:21.457 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: :foo3 2024-09-21T13:43:21.457 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (29 ms) 2024-09-21T13:43:21.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:21 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:21.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi002-76491-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi002-76491-2"}]': finished 2024-09-21T13:43:21.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"}]': finished 2024-09-21T13:43:21.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:21 smithi162 ceph-mon[33046]: osdmap e212: 8 total, 8 up, 8 in 2024-09-21T13:43:21.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:21.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:21.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/65301082' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi002-76395-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:21.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi002-76395-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:21.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:21.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:21.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:21.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi002-76491-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi002-76491-2"}]': finished 2024-09-21T13:43:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"}]': finished 2024-09-21T13:43:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[30076]: osdmap e212: 8 total, 8 up, 8 in 2024-09-21T13:43:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:21.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/65301082' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi002-76395-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:21.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi002-76395-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:21.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:21.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:21.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:21.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi002-76491-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi002-76491-2"}]': finished 2024-09-21T13:43:21.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi002-76384-36"}]': finished 2024-09-21T13:43:21.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[40622]: osdmap e212: 8 total, 8 up, 8 in 2024-09-21T13:43:21.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1021660993' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:21.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"} : dispatch 2024-09-21T13:43:21.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/65301082' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi002-76395-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:21.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_smithi002-76395-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:21.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:21.854 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"}]': finished 2024-09-21T13:43:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi002-76395-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:22 smithi162 ceph-mon[33046]: osdmap e213: 8 total, 8 up, 8 in 2024-09-21T13:43:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:22.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:22 smithi162 ceph-mon[33046]: pgmap v270: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:43:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"}]': finished 2024-09-21T13:43:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi002-76395-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[30076]: osdmap e213: 8 total, 8 up, 8 in 2024-09-21T13:43:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[30076]: pgmap v270: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:43:22.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi002-76384-36"}]': finished 2024-09-21T13:43:22.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi002-76395-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:22.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:22.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[40622]: osdmap e213: 8 total, 8 up, 8 in 2024-09-21T13:43:22.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:22.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27"} : dispatch 2024-09-21T13:43:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:22 smithi002 ceph-mon[40622]: pgmap v270: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:43:23.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:23.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27"}]': finished 2024-09-21T13:43:23.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:23.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: osdmap e214: 8 total, 8 up, 8 in 2024-09-21T13:43:23.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi002-76384-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:23.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:23.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:23.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:23.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:23.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27"}]': finished 2024-09-21T13:43:23.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:23.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: osdmap e214: 8 total, 8 up, 8 in 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi002-76384-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-27"}]': finished 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: osdmap e214: 8 total, 8 up, 8 in 2024-09-21T13:43:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi002-76384-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi002-76491-2"}]': finished 2024-09-21T13:43:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:24 smithi162 ceph-mon[33046]: osdmap e215: 8 total, 8 up, 8 in 2024-09-21T13:43:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:24 smithi162 ceph-mon[33046]: pgmap v273: 196 pgs: 196 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi002-76491-2"}]': finished 2024-09-21T13:43:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[30076]: osdmap e215: 8 total, 8 up, 8 in 2024-09-21T13:43:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:24.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:24.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[30076]: pgmap v273: 196 pgs: 196 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi002-76491-2"}]': finished 2024-09-21T13:43:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[40622]: osdmap e215: 8 total, 8 up, 8 in 2024-09-21T13:43:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi002-76491-2"} : dispatch 2024-09-21T13:43:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:24 smithi002 ceph-mon[40622]: pgmap v273: 196 pgs: 196 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:25.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi002-76384-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi002-76384-37"}]': finished 2024-09-21T13:43:25.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi002-76491-2"}]': finished 2024-09-21T13:43:25.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:25 smithi162 ceph-mon[33046]: osdmap e216: 8 total, 8 up, 8 in 2024-09-21T13:43:25.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:25.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:25.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi002-76384-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi002-76384-37"}]': finished 2024-09-21T13:43:25.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi002-76491-2"}]': finished 2024-09-21T13:43:25.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:25 smithi002 ceph-mon[30076]: osdmap e216: 8 total, 8 up, 8 in 2024-09-21T13:43:25.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:25.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:25.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi002-76384-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi002-76384-37"}]': finished 2024-09-21T13:43:25.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2905794980' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi002-76491-2"}]': finished 2024-09-21T13:43:25.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:25 smithi002 ceph-mon[40622]: osdmap e216: 8 total, 8 up, 8 in 2024-09-21T13:43:25.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:25.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-46"}]': finished 2024-09-21T13:43:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:26 smithi162 ceph-mon[33046]: osdmap e217: 8 total, 8 up, 8 in 2024-09-21T13:43:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4132478520' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76491-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76491-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:26 smithi162 ceph-mon[33046]: pgmap v276: 276 pgs: 80 unknown, 196 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76491-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:26 smithi162 ceph-mon[33046]: osdmap e218: 8 total, 8 up, 8 in 2024-09-21T13:43:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:26.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-46"}]': finished 2024-09-21T13:43:26.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:26.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[40622]: osdmap e217: 8 total, 8 up, 8 in 2024-09-21T13:43:26.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4132478520' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76491-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:26.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76491-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:26.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[40622]: pgmap v276: 276 pgs: 80 unknown, 196 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76491-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[40622]: osdmap e218: 8 total, 8 up, 8 in 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-46"}]': finished 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[30076]: osdmap e217: 8 total, 8 up, 8 in 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4132478520' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76491-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76491-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[30076]: pgmap v276: 276 pgs: 80 unknown, 196 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76491-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[30076]: osdmap e218: 8 total, 8 up, 8 in 2024-09-21T13:43:26.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:27.417 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-09-21T13:43:27.417 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 1 0 2024-09-21T13:43:27.417 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 10 0 2024-09-21T13:43:27.417 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 13 0 2024-09-21T13:43:27.417 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 7 0 2024-09-21T13:43:27.417 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 14 0 2024-09-21T13:43:27.417 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 0 0 2024-09-21T13:43:27.417 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 15 0 2024-09-21T13:43:27.417 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 11 0 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 5 0 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 8 0 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 6 0 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 3 0 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 4 0 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 12 0 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 9 0 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 2 0 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (43 ms) 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [----------] 3 tests from LibRadosListEC (1115 ms total) 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 2024-09-21T13:43:27.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-09-21T13:43:27.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-09-21T13:43:27.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (2996 ms) 2024-09-21T13:43:27.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [----------] 1 test from LibRadosListNP (2996 ms total) 2024-09-21T13:43:27.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: 2024-09-21T13:43:27.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [----------] Global test environment tear-down 2024-09-21T13:43:27.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [==========] 11 tests from 3 test suites ran. (153463 ms total) 2024-09-21T13:43:27.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_list: [ PASSED ] 11 tests. 2024-09-21T13:43:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:27 smithi162 ceph-mon[33046]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4132478520' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi002-76491-3","pool2":"test-rados-api-smithi002-76491-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T13:43:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi002-76491-3","pool2":"test-rados-api-smithi002-76491-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T13:43:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37"}]': finished 2024-09-21T13:43:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi002-76491-3","pool2":"test-rados-api-smithi002-76491-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-21T13:43:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:27 smithi162 ceph-mon[33046]: osdmap e219: 8 total, 8 up, 8 in 2024-09-21T13:43:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:27.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[40622]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:27.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4132478520' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi002-76491-3","pool2":"test-rados-api-smithi002-76491-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T13:43:27.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi002-76491-3","pool2":"test-rados-api-smithi002-76491-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T13:43:27.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37"}]': finished 2024-09-21T13:43:27.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi002-76491-3","pool2":"test-rados-api-smithi002-76491-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-21T13:43:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[40622]: osdmap e219: 8 total, 8 up, 8 in 2024-09-21T13:43:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:27.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[30076]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:27.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4132478520' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi002-76491-3","pool2":"test-rados-api-smithi002-76491-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T13:43:27.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-smithi002-76491-3","pool2":"test-rados-api-smithi002-76491-3","yes_i_really_really_mean_it_not_faking": true} : dispatch 2024-09-21T13:43:27.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi002-76384-37"}]': finished 2024-09-21T13:43:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi002-76491-3","pool2":"test-rados-api-smithi002-76491-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-21T13:43:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[30076]: osdmap e219: 8 total, 8 up, 8 in 2024-09-21T13:43:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi002-76384-37"} : dispatch 2024-09-21T13:43:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:27.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:28.718 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: pgmap v279: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:28.718 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:28.718 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi002-76384-37"}]': finished 2024-09-21T13:43:28.718 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"}]': finished 2024-09-21T13:43:28.718 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:28.718 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: osdmap e220: 8 total, 8 up, 8 in 2024-09-21T13:43:28.718 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:28.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:28.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:28.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:28.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi002-76384-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:28.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi002-76384-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:28.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: pgmap v279: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:28.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:28.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi002-76384-37"}]': finished 2024-09-21T13:43:28.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"}]': finished 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: osdmap e220: 8 total, 8 up, 8 in 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi002-76384-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi002-76384-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: pgmap v279: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3308922147' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi002-76384-37"}]': finished 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-46"}]': finished 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: osdmap e220: 8 total, 8 up, 8 in 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3151021644' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"} : dispatch 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:28.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi002-76384-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:28.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi002-76384-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:28.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:43:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:43:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-29"}]': finished 2024-09-21T13:43:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"}]': finished 2024-09-21T13:43:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi002-76384-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: osdmap e221: 8 total, 8 up, 8 in 2024-09-21T13:43:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi002-76384-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi002-76384-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-29", "mode": "writeback"} : dispatch 2024-09-21T13:43:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-29", "mode": "writeback"} : dispatch 2024-09-21T13:43:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:29.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:43:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:43:29.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:29.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-29"}]': finished 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"}]': finished 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi002-76384-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: osdmap e221: 8 total, 8 up, 8 in 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi002-76384-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi002-76384-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-29", "mode": "writeback"} : dispatch 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-29", "mode": "writeback"} : dispatch 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-29"}]': finished 2024-09-21T13:43:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-46"}]': finished 2024-09-21T13:43:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi002-76384-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: osdmap e221: 8 total, 8 up, 8 in 2024-09-21T13:43:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi002-76384-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStat_smithi002-76384-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-29", "mode": "writeback"} : dispatch 2024-09-21T13:43:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-29", "mode": "writeback"} : dispatch 2024-09-21T13:43:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:30 smithi162 ceph-mon[33046]: pgmap v282: 228 pgs: 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T13:43:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:30 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:30 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-29", "mode": "writeback"}]': finished 2024-09-21T13:43:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:30 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:30 smithi162 ceph-mon[33046]: osdmap e222: 8 total, 8 up, 8 in 2024-09-21T13:43:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:30 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[40622]: pgmap v282: 228 pgs: 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T13:43:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-29", "mode": "writeback"}]': finished 2024-09-21T13:43:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[40622]: osdmap e222: 8 total, 8 up, 8 in 2024-09-21T13:43:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:30.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[30076]: pgmap v282: 228 pgs: 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T13:43:30.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:30.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-29", "mode": "writeback"}]': finished 2024-09-21T13:43:30.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi002-76395-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:30.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:30.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[30076]: osdmap e222: 8 total, 8 up, 8 in 2024-09-21T13:43:30.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:30 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:32.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi002-76384-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi002-76384-38"}]': finished 2024-09-21T13:43:32.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:32 smithi162 ceph-mon[33046]: osdmap e223: 8 total, 8 up, 8 in 2024-09-21T13:43:32.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:32 smithi162 ceph-mon[33046]: pgmap v285: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T13:43:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi002-76384-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi002-76384-38"}]': finished 2024-09-21T13:43:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:32 smithi002 ceph-mon[30076]: osdmap e223: 8 total, 8 up, 8 in 2024-09-21T13:43:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:32 smithi002 ceph-mon[30076]: pgmap v285: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T13:43:32.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi002-76384-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi002-76384-38"}]': finished 2024-09-21T13:43:32.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:32 smithi002 ceph-mon[40622]: osdmap e223: 8 total, 8 up, 8 in 2024-09-21T13:43:32.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:32 smithi002 ceph-mon[40622]: pgmap v285: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T13:43:33.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:33 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:33.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-47"}]': finished 2024-09-21T13:43:33.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:33 smithi162 ceph-mon[33046]: osdmap e224: 8 total, 8 up, 8 in 2024-09-21T13:43:33.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:33.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:33 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-47"}]': finished 2024-09-21T13:43:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:33 smithi002 ceph-mon[40622]: osdmap e224: 8 total, 8 up, 8 in 2024-09-21T13:43:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:33 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi002-76395-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi002-76395-47"}]': finished 2024-09-21T13:43:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:33 smithi002 ceph-mon[30076]: osdmap e224: 8 total, 8 up, 8 in 2024-09-21T13:43:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:33.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:34 smithi162 ceph-mon[33046]: osdmap e225: 8 total, 8 up, 8 in 2024-09-21T13:43:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:34 smithi162 ceph-mon[33046]: pgmap v288: 236 pgs: 236 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1024 KiB/s wr, 27 op/s 2024-09-21T13:43:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[30076]: osdmap e225: 8 total, 8 up, 8 in 2024-09-21T13:43:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:34.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:34.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[30076]: pgmap v288: 236 pgs: 236 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1024 KiB/s wr, 27 op/s 2024-09-21T13:43:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[40622]: osdmap e225: 8 total, 8 up, 8 in 2024-09-21T13:43:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29"} : dispatch 2024-09-21T13:43:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:34 smithi002 ceph-mon[40622]: pgmap v288: 236 pgs: 236 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1024 KiB/s wr, 27 op/s 2024-09-21T13:43:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:35 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29"}]': finished 2024-09-21T13:43:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"}]': finished 2024-09-21T13:43:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:35 smithi162 ceph-mon[33046]: osdmap e226: 8 total, 8 up, 8 in 2024-09-21T13:43:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29"}]': finished 2024-09-21T13:43:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"}]': finished 2024-09-21T13:43:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[30076]: osdmap e226: 8 total, 8 up, 8 in 2024-09-21T13:43:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:35.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:35.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:35.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-29"}]': finished 2024-09-21T13:43:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi002-76384-38"}]': finished 2024-09-21T13:43:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[40622]: osdmap e226: 8 total, 8 up, 8 in 2024-09-21T13:43:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2734262521' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"} : dispatch 2024-09-21T13:43:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"}]': finished 2024-09-21T13:43:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"}]': finished 2024-09-21T13:43:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: osdmap e227: 8 total, 8 up, 8 in 2024-09-21T13:43:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi002-76384-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:36.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi002-76384-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:36.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:36 smithi162 ceph-mon[33046]: pgmap v291: 196 pgs: 196 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T13:43:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"}]': finished 2024-09-21T13:43:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"}]': finished 2024-09-21T13:43:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: osdmap e227: 8 total, 8 up, 8 in 2024-09-21T13:43:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi002-76384-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi002-76384-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[40622]: pgmap v291: 196 pgs: 196 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi002-76384-38"}]': finished 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi002-76395-47"}]': finished 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: osdmap e227: 8 total, 8 up, 8 in 2024-09-21T13:43:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2121829333' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"} : dispatch 2024-09-21T13:43:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi002-76384-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi002-76384-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:36 smithi002 ceph-mon[30076]: pgmap v291: 196 pgs: 196 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-21T13:43:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"}]': finished 2024-09-21T13:43:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi002-76384-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: osdmap e228: 8 total, 8 up, 8 in 2024-09-21T13:43:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi002-76384-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi002-76384-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi002-76395-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:37.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi002-76395-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"}]': finished 2024-09-21T13:43:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi002-76384-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: osdmap e228: 8 total, 8 up, 8 in 2024-09-21T13:43:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi002-76384-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi002-76384-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi002-76395-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi002-76395-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi002-76395-47"}]': finished 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi002-76384-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: osdmap e228: 8 total, 8 up, 8 in 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi002-76384-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatNS_smithi002-76384-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:37.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:37.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:37.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:37.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi002-76395-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:37.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi002-76395-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:38.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:38.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi002-76395-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:38.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi002-76395-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:38.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:38.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: osdmap e229: 8 total, 8 up, 8 in 2024-09-21T13:43:38.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi002-76395-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:38.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:38.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: pgmap v294: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:38.729 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:38.730 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi002-76384-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi002-76384-39"}]': finished 2024-09-21T13:43:38.730 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:38.730 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:38.730 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: osdmap e230: 8 total, 8 up, 8 in 2024-09-21T13:43:38.730 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:38.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:38.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi002-76395-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:38.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi002-76395-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: osdmap e229: 8 total, 8 up, 8 in 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi002-76395-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: pgmap v294: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi002-76384-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi002-76384-39"}]': finished 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: osdmap e230: 8 total, 8 up, 8 in 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:38.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi002-76395-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi002-76395-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: osdmap e229: 8 total, 8 up, 8 in 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "WaitForSafePP_smithi002-76395-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: pgmap v294: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi002-76384-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi002-76384-39"}]': finished 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: osdmap e230: 8 total, 8 up, 8 in 2024-09-21T13:43:38.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:38.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:43:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:43:39.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:39.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi002-76395-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi002-76395-48"}]': finished 2024-09-21T13:43:39.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-31"}]': finished 2024-09-21T13:43:39.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[30076]: osdmap e231: 8 total, 8 up, 8 in 2024-09-21T13:43:39.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-31", "mode": "writeback"} : dispatch 2024-09-21T13:43:39.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-31", "mode": "writeback"} : dispatch 2024-09-21T13:43:39.671 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:39.671 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi002-76395-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi002-76395-48"}]': finished 2024-09-21T13:43:39.671 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-31"}]': finished 2024-09-21T13:43:39.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[40622]: osdmap e231: 8 total, 8 up, 8 in 2024-09-21T13:43:39.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-31", "mode": "writeback"} : dispatch 2024-09-21T13:43:39.672 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-31", "mode": "writeback"} : dispatch 2024-09-21T13:43:39.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:39 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:39.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi002-76395-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi002-76395-48"}]': finished 2024-09-21T13:43:39.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-31"}]': finished 2024-09-21T13:43:39.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:39 smithi162 ceph-mon[33046]: osdmap e231: 8 total, 8 up, 8 in 2024-09-21T13:43:39.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-31", "mode": "writeback"} : dispatch 2024-09-21T13:43:39.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-31", "mode": "writeback"} : dispatch 2024-09-21T13:43:40.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:43:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:43:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:43:40.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:40 smithi162 ceph-mon[33046]: pgmap v297: 244 pgs: 8 unknown, 8 creating+peering, 228 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:40.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:40 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:40.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-31", "mode": "writeback"}]': finished 2024-09-21T13:43:40.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:40 smithi162 ceph-mon[33046]: osdmap e232: 8 total, 8 up, 8 in 2024-09-21T13:43:40.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:40.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:40.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:40 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:43:40.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[30076]: pgmap v297: 244 pgs: 8 unknown, 8 creating+peering, 228 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:40.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:40.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-31", "mode": "writeback"}]': finished 2024-09-21T13:43:40.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[30076]: osdmap e232: 8 total, 8 up, 8 in 2024-09-21T13:43:40.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:40.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:40.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:43:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[40622]: pgmap v297: 244 pgs: 8 unknown, 8 creating+peering, 228 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-31", "mode": "writeback"}]': finished 2024-09-21T13:43:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[40622]: osdmap e232: 8 total, 8 up, 8 in 2024-09-21T13:43:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:40.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:40 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:43:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:43:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:43:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:43:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"}]': finished 2024-09-21T13:43:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: osdmap e233: 8 total, 8 up, 8 in 2024-09-21T13:43:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:41.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:41.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:41.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:41.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:41.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:41.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:41.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:43:41.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:43:41.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:43:41.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"}]': finished 2024-09-21T13:43:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: osdmap e233: 8 total, 8 up, 8 in 2024-09-21T13:43:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:41.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:41.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:41.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:43:41.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:43:41.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:43:41.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi002-76384-39"}]': finished 2024-09-21T13:43:41.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:41.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: osdmap e233: 8 total, 8 up, 8 in 2024-09-21T13:43:41.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1056128017' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:41.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:41.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:41.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"} : dispatch 2024-09-21T13:43:41.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31"} : dispatch 2024-09-21T13:43:41.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:42.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:42 smithi162 ceph-mon[33046]: pgmap v300: 228 pgs: 228 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:42.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:42 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:42.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"}]': finished 2024-09-21T13:43:42.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31"}]': finished 2024-09-21T13:43:42.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"}]': finished 2024-09-21T13:43:42.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:42 smithi162 ceph-mon[33046]: osdmap e234: 8 total, 8 up, 8 in 2024-09-21T13:43:42.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:42.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:42.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:42.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:42.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi002-76384-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[30076]: pgmap v300: 228 pgs: 228 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"}]': finished 2024-09-21T13:43:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31"}]': finished 2024-09-21T13:43:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"}]': finished 2024-09-21T13:43:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[30076]: osdmap e234: 8 total, 8 up, 8 in 2024-09-21T13:43:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi002-76384-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[40622]: pgmap v300: 228 pgs: 228 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi002-76384-39"}]': finished 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-31"}]': finished 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi002-76395-48"}]': finished 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[40622]: osdmap e234: 8 total, 8 up, 8 in 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1809977165' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"} : dispatch 2024-09-21T13:43:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi002-76384-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"}]': finished 2024-09-21T13:43:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi002-76384-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:43 smithi162 ceph-mon[33046]: osdmap e235: 8 total, 8 up, 8 in 2024-09-21T13:43:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemove_smithi002-76384-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi002-76395-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:43.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi002-76395-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:43.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:43.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"}]': finished 2024-09-21T13:43:43.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi002-76384-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:43.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[30076]: osdmap e235: 8 total, 8 up, 8 in 2024-09-21T13:43:43.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemove_smithi002-76384-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi002-76395-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi002-76395-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi002-76395-48"}]': finished 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi002-76384-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[40622]: osdmap e235: 8 total, 8 up, 8 in 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemove_smithi002-76384-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:43.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:43.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi002-76395-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:43.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi002-76395-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:44.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:44 smithi162 ceph-mon[33046]: pgmap v303: 196 pgs: 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:43:44.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:44 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi002-76395-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:44.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi002-76395-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:44.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:44 smithi162 ceph-mon[33046]: osdmap e236: 8 total, 8 up, 8 in 2024-09-21T13:43:44.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:44 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi002-76395-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:44.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:44.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:44 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[30076]: pgmap v303: 196 pgs: 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:43:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi002-76395-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi002-76395-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[30076]: osdmap e236: 8 total, 8 up, 8 in 2024-09-21T13:43:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi002-76395-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:44.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:44.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[40622]: pgmap v303: 196 pgs: 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:43:44.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi002-76395-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:44.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi002-76395-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:44.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[40622]: osdmap e236: 8 total, 8 up, 8 in 2024-09-21T13:43:44.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP_smithi002-76395-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:44.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:44.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:44 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:46.652 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi002-76384-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi002-76384-40"}]': finished 2024-09-21T13:43:46.653 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:46.653 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:46.653 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[30076]: osdmap e237: 8 total, 8 up, 8 in 2024-09-21T13:43:46.653 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:46.653 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[30076]: pgmap v306: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:43:46.653 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi002-76384-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi002-76384-40"}]': finished 2024-09-21T13:43:46.653 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:46.653 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:46.653 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[40622]: osdmap e237: 8 total, 8 up, 8 in 2024-09-21T13:43:46.653 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:46.654 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:46 smithi002 ceph-mon[40622]: pgmap v306: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:43:46.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi002-76384-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi002-76384-40"}]': finished 2024-09-21T13:43:46.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:46 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:46.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:46.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:46 smithi162 ceph-mon[33046]: osdmap e237: 8 total, 8 up, 8 in 2024-09-21T13:43:46.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:46 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:46.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:46 smithi162 ceph-mon[33046]: pgmap v306: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:43:47.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:47 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:47.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:47 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi002-76395-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi002-76395-49"}]': finished 2024-09-21T13:43:47.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:47 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:47.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:47 smithi162 ceph-mon[33046]: osdmap e238: 8 total, 8 up, 8 in 2024-09-21T13:43:47.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:47.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:47 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:47.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:47.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi002-76395-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi002-76395-49"}]': finished 2024-09-21T13:43:47.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:47.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[40622]: osdmap e238: 8 total, 8 up, 8 in 2024-09-21T13:43:47.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:47.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:47.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:47.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi002-76395-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi002-76395-49"}]': finished 2024-09-21T13:43:47.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:47.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[30076]: osdmap e238: 8 total, 8 up, 8 in 2024-09-21T13:43:47.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:47.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:47 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:48.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-33"}]': finished 2024-09-21T13:43:48.752 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-mon[33046]: osdmap e239: 8 total, 8 up, 8 in 2024-09-21T13:43:48.752 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:48.752 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-33", "mode": "writeback"} : dispatch 2024-09-21T13:43:48.752 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-33", "mode": "writeback"} : dispatch 2024-09-21T13:43:48.752 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-mon[33046]: pgmap v309: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:48.753 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:48.753 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi002-76384-40"}]': finished 2024-09-21T13:43:48.753 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-33", "mode": "writeback"}]': finished 2024-09-21T13:43:48.753 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-mon[33046]: osdmap e240: 8 total, 8 up, 8 in 2024-09-21T13:43:48.753 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:48.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-33"}]': finished 2024-09-21T13:43:48.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[40622]: osdmap e239: 8 total, 8 up, 8 in 2024-09-21T13:43:48.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-33", "mode": "writeback"} : dispatch 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-33", "mode": "writeback"} : dispatch 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[40622]: pgmap v309: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi002-76384-40"}]': finished 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-33", "mode": "writeback"}]': finished 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[40622]: osdmap e240: 8 total, 8 up, 8 in 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-33"}]': finished 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[30076]: osdmap e239: 8 total, 8 up, 8 in 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-33", "mode": "writeback"} : dispatch 2024-09-21T13:43:48.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-33", "mode": "writeback"} : dispatch 2024-09-21T13:43:48.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[30076]: pgmap v309: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:48.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:48.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi002-76384-40"}]': finished 2024-09-21T13:43:48.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-33", "mode": "writeback"}]': finished 2024-09-21T13:43:48.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[30076]: osdmap e240: 8 total, 8 up, 8 in 2024-09-21T13:43:48.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemove_smithi002-76384-40"} : dispatch 2024-09-21T13:43:49.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:43:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:43:49.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:49.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:49.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:49.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:49.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:49.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi002-76384-40"}]': finished 2024-09-21T13:43:49.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"}]': finished 2024-09-21T13:43:49.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:49.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: osdmap e241: 8 total, 8 up, 8 in 2024-09-21T13:43:49.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:49.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi002-76384-40"}]': finished 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"}]': finished 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: osdmap e241: 8 total, 8 up, 8 in 2024-09-21T13:43:49.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:49.672 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:49.672 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:49.672 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:49.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:49.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:49.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:49.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:49.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:49.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1889087069' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi002-76384-40"}]': finished 2024-09-21T13:43:49.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi002-76395-49"}]': finished 2024-09-21T13:43:49.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:49.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: osdmap e241: 8 total, 8 up, 8 in 2024-09-21T13:43:49.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:49.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/325862558' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:49.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33"} : dispatch 2024-09-21T13:43:49.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"} : dispatch 2024-09-21T13:43:50.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:43:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:43:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:43:50.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi002-76384-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:50.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi002-76384-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:50.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: pgmap v312: 228 pgs: 228 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-21T13:43:50.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:50.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33"}]': finished 2024-09-21T13:43:50.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"}]': finished 2024-09-21T13:43:50.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi002-76384-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:50.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: osdmap e242: 8 total, 8 up, 8 in 2024-09-21T13:43:50.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClass_smithi002-76384-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClass_smithi002-76384-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi002-76384-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:50.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi002-76384-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:50.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: pgmap v312: 228 pgs: 228 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-21T13:43:50.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33"}]': finished 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"}]': finished 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi002-76384-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: osdmap e242: 8 total, 8 up, 8 in 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClass_smithi002-76384-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClass_smithi002-76384-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi002-76384-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi002-76384-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: pgmap v312: 228 pgs: 228 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-21T13:43:50.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:43:50.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-33"}]': finished 2024-09-21T13:43:50.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi002-76395-49"}]': finished 2024-09-21T13:43:50.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi002-76384-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:50.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: osdmap e242: 8 total, 8 up, 8 in 2024-09-21T13:43:50.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClass_smithi002-76384-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:50.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClass_smithi002-76384-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:51.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:51.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:51.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi002-76395-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:51.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi002-76395-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:51.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:51 smithi162 ceph-mon[33046]: osdmap e243: 8 total, 8 up, 8 in 2024-09-21T13:43:51.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP2_smithi002-76395-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi002-76395-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi002-76395-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:51.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[30076]: osdmap e243: 8 total, 8 up, 8 in 2024-09-21T13:43:51.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP2_smithi002-76395-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi002-76395-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi002-76395-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[40622]: osdmap e243: 8 total, 8 up, 8 in 2024-09-21T13:43:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripPP2_smithi002-76395-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:52.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:52 smithi162 ceph-mon[33046]: pgmap v315: 196 pgs: 196 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:43:52.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi002-76384-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi002-76384-41"}]': finished 2024-09-21T13:43:52.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:52 smithi162 ceph-mon[33046]: osdmap e244: 8 total, 8 up, 8 in 2024-09-21T13:43:52.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:52 smithi002 ceph-mon[30076]: pgmap v315: 196 pgs: 196 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:43:52.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi002-76384-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi002-76384-41"}]': finished 2024-09-21T13:43:52.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:52 smithi002 ceph-mon[30076]: osdmap e244: 8 total, 8 up, 8 in 2024-09-21T13:43:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:52 smithi002 ceph-mon[40622]: pgmap v315: 196 pgs: 196 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:43:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi002-76384-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi002-76384-41"}]': finished 2024-09-21T13:43:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:52 smithi002 ceph-mon[40622]: osdmap e244: 8 total, 8 up, 8 in 2024-09-21T13:43:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:53 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi002-76395-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi002-76395-50"}]': finished 2024-09-21T13:43:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:53 smithi162 ceph-mon[33046]: osdmap e245: 8 total, 8 up, 8 in 2024-09-21T13:43:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:53.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:53.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:53.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:53.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:53.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi002-76395-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi002-76395-50"}]': finished 2024-09-21T13:43:53.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:53.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[30076]: osdmap e245: 8 total, 8 up, 8 in 2024-09-21T13:43:53.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:53.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:53.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:53.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:53.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:43:53.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi002-76395-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi002-76395-50"}]': finished 2024-09-21T13:43:53.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:53.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[40622]: osdmap e245: 8 total, 8 up, 8 in 2024-09-21T13:43:53.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:53.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:43:54.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:54 smithi162 ceph-mon[33046]: pgmap v318: 244 pgs: 8 creating+peering, 236 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:43:54.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:54.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:54 smithi162 ceph-mon[33046]: osdmap e246: 8 total, 8 up, 8 in 2024-09-21T13:43:54.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:43:54.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:43:54.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:54.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[30076]: pgmap v318: 244 pgs: 8 creating+peering, 236 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:43:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[30076]: osdmap e246: 8 total, 8 up, 8 in 2024-09-21T13:43:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:43:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:43:54.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:54.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[40622]: pgmap v318: 244 pgs: 8 creating+peering, 236 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:43:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:43:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[40622]: osdmap e246: 8 total, 8 up, 8 in 2024-09-21T13:43:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:43:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:43:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:56.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"}]': finished 2024-09-21T13:43:56.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"}]': finished 2024-09-21T13:43:56.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:56 smithi162 ceph-mon[33046]: osdmap e247: 8 total, 8 up, 8 in 2024-09-21T13:43:56.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:56.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:56.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-35", "mode": "writeback"} : dispatch 2024-09-21T13:43:56.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:56.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-35", "mode": "writeback"} : dispatch 2024-09-21T13:43:56.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:56 smithi162 ceph-mon[33046]: pgmap v321: 228 pgs: 228 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:56.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"}]': finished 2024-09-21T13:43:56.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"}]': finished 2024-09-21T13:43:56.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[30076]: osdmap e247: 8 total, 8 up, 8 in 2024-09-21T13:43:56.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:56.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-35", "mode": "writeback"} : dispatch 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-35", "mode": "writeback"} : dispatch 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[30076]: pgmap v321: 228 pgs: 228 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"}]': finished 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi002-76384-41"}]': finished 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[40622]: osdmap e247: 8 total, 8 up, 8 in 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3147627915' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-35", "mode": "writeback"} : dispatch 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"} : dispatch 2024-09-21T13:43:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-35", "mode": "writeback"} : dispatch 2024-09-21T13:43:56.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:56 smithi002 ceph-mon[40622]: pgmap v321: 228 pgs: 228 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:43:57.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:57.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi002-76395-50"}]': finished 2024-09-21T13:43:57.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"}]': finished 2024-09-21T13:43:57.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-35", "mode": "writeback"}]': finished 2024-09-21T13:43:57.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: osdmap e248: 8 total, 8 up, 8 in 2024-09-21T13:43:57.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:57.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi002-76384-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:57.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi002-76384-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi002-76395-50"}]': finished 2024-09-21T13:43:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"}]': finished 2024-09-21T13:43:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-35", "mode": "writeback"}]': finished 2024-09-21T13:43:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: osdmap e248: 8 total, 8 up, 8 in 2024-09-21T13:43:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi002-76384-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi002-76384-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:43:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi002-76395-50"}]': finished 2024-09-21T13:43:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi002-76384-41"}]': finished 2024-09-21T13:43:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-35", "mode": "writeback"}]': finished 2024-09-21T13:43:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: osdmap e248: 8 total, 8 up, 8 in 2024-09-21T13:43:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi002-76395-50"} : dispatch 2024-09-21T13:43:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi002-76384-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:57.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi002-76384-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:43:58.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi002-76395-50"}]': finished 2024-09-21T13:43:58.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi002-76384-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:58.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:58 smithi162 ceph-mon[33046]: osdmap e249: 8 total, 8 up, 8 in 2024-09-21T13:43:58.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi002-76384-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:58.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi002-76384-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:58.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:58 smithi162 ceph-mon[33046]: pgmap v324: 228 pgs: 228 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:58.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:43:58.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi002-76395-50"}]': finished 2024-09-21T13:43:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi002-76384-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[30076]: osdmap e249: 8 total, 8 up, 8 in 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi002-76384-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi002-76384-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[30076]: pgmap v324: 228 pgs: 228 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2397776681' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi002-76395-50"}]': finished 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi002-76384-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[40622]: osdmap e249: 8 total, 8 up, 8 in 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi002-76384-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWrite_smithi002-76384-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[40622]: pgmap v324: 228 pgs: 228 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:43:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:43:58.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:43:59.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:43:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:43:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:59 smithi162 ceph-mon[33046]: osdmap e250: 8 total, 8 up, 8 in 2024-09-21T13:43:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2797726883' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:59 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi002-76384-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi002-76384-42"}]': finished 2024-09-21T13:43:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2797726883' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:43:59 smithi162 ceph-mon[33046]: osdmap e251: 8 total, 8 up, 8 in 2024-09-21T13:43:59.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:43:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:43:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[30076]: osdmap e250: 8 total, 8 up, 8 in 2024-09-21T13:43:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2797726883' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi002-76384-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi002-76384-42"}]': finished 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2797726883' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[30076]: osdmap e251: 8 total, 8 up, 8 in 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[40622]: osdmap e250: 8 total, 8 up, 8 in 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2797726883' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi002-76384-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi002-76384-42"}]': finished 2024-09-21T13:43:59.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2797726883' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi002-76395-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:43:59.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:43:59.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:43:59 smithi002 ceph-mon[40622]: osdmap e251: 8 total, 8 up, 8 in 2024-09-21T13:44:00.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:00.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:00.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:00 smithi162 ceph-mon[33046]: pgmap v327: 268 pgs: 8 unknown, 32 creating+peering, 228 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:44:00.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"}]': finished 2024-09-21T13:44:00.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:00 smithi162 ceph-mon[33046]: osdmap e252: 8 total, 8 up, 8 in 2024-09-21T13:44:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:00 smithi002 ceph-mon[30076]: pgmap v327: 268 pgs: 8 unknown, 32 creating+peering, 228 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:44:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"}]': finished 2024-09-21T13:44:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:00 smithi002 ceph-mon[30076]: osdmap e252: 8 total, 8 up, 8 in 2024-09-21T13:44:00.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:00.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:00.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:00 smithi002 ceph-mon[40622]: pgmap v327: 268 pgs: 8 unknown, 32 creating+peering, 228 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:44:00.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-35"}]': finished 2024-09-21T13:44:00.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:00 smithi002 ceph-mon[40622]: osdmap e252: 8 total, 8 up, 8 in 2024-09-21T13:44:01.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:01 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:01.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:01.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:01.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:01.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:01.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:01 smithi162 ceph-mon[33046]: osdmap e253: 8 total, 8 up, 8 in 2024-09-21T13:44:01.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi002-76395-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:01.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:01.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[30076]: osdmap e253: 8 total, 8 up, 8 in 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi002-76395-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[40622]: osdmap e253: 8 total, 8 up, 8 in 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi002-76395-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:02 smithi162 ceph-mon[33046]: pgmap v330: 228 pgs: 228 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:44:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"}]': finished 2024-09-21T13:44:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:44:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:02 smithi162 ceph-mon[33046]: osdmap e254: 8 total, 8 up, 8 in 2024-09-21T13:44:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[30076]: pgmap v330: 228 pgs: 228 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:44:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"}]': finished 2024-09-21T13:44:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:44:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[30076]: osdmap e254: 8 total, 8 up, 8 in 2024-09-21T13:44:02.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:02.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[40622]: pgmap v330: 228 pgs: 228 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:44:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi002-76384-42"}]': finished 2024-09-21T13:44:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:44:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3497470369' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[40622]: osdmap e254: 8 total, 8 up, 8 in 2024-09-21T13:44:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"} : dispatch 2024-09-21T13:44:02.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35"} : dispatch 2024-09-21T13:44:03.418 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7036 ms) 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6924 ms) 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7030 ms) 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6995 ms) 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7021 ms) 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7032 ms) 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-09-21T13:44:03.419 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7026 ms) 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7032 ms) 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6881 ms) 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7037 ms) 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6955 ms) 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7036 ms) 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6974 ms) 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7020 ms) 2024-09-21T13:44:03.420 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-09-21T13:44:03.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7018 ms) 2024-09-21T13:44:03.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-09-21T13:44:03.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7016 ms) 2024-09-21T13:44:03.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112033 ms total) 2024-09-21T13:44:03.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: 2024-09-21T13:44:03.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [----------] Global test environment tear-down 2024-09-21T13:44:03.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (189537 ms total) 2024-09-21T13:44:03.421 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio: [ PASSED ] 42 tests. 2024-09-21T13:44:03.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:03 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:44:03.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi002-76395-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi002-76395-52"}]': finished 2024-09-21T13:44:03.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"}]': finished 2024-09-21T13:44:03.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35"}]': finished 2024-09-21T13:44:03.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:03 smithi162 ceph-mon[33046]: osdmap e255: 8 total, 8 up, 8 in 2024-09-21T13:44:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:03 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:44:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi002-76395-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi002-76395-52"}]': finished 2024-09-21T13:44:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"}]': finished 2024-09-21T13:44:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35"}]': finished 2024-09-21T13:44:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:03 smithi002 ceph-mon[30076]: osdmap e255: 8 total, 8 up, 8 in 2024-09-21T13:44:03.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:03 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:44:03.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi002-76395-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi002-76395-52"}]': finished 2024-09-21T13:44:03.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi002-76384-42"}]': finished 2024-09-21T13:44:03.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-35"}]': finished 2024-09-21T13:44:03.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:03 smithi002 ceph-mon[40622]: osdmap e255: 8 total, 8 up, 8 in 2024-09-21T13:44:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:04 smithi162 ceph-mon[33046]: pgmap v333: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:44:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:04 smithi162 ceph-mon[33046]: osdmap e256: 8 total, 8 up, 8 in 2024-09-21T13:44:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:04 smithi002 ceph-mon[30076]: pgmap v333: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:44:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:04 smithi002 ceph-mon[30076]: osdmap e256: 8 total, 8 up, 8 in 2024-09-21T13:44:04.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:04 smithi002 ceph-mon[40622]: pgmap v333: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:44:04.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:04 smithi002 ceph-mon[40622]: osdmap e256: 8 total, 8 up, 8 in 2024-09-21T13:44:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:06 smithi162 ceph-mon[33046]: osdmap e257: 8 total, 8 up, 8 in 2024-09-21T13:44:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:06.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:06 smithi162 ceph-mon[33046]: pgmap v336: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:06 smithi002 ceph-mon[30076]: osdmap e257: 8 total, 8 up, 8 in 2024-09-21T13:44:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:06 smithi002 ceph-mon[30076]: pgmap v336: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:06 smithi002 ceph-mon[40622]: osdmap e257: 8 total, 8 up, 8 in 2024-09-21T13:44:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:06 smithi002 ceph-mon[40622]: pgmap v336: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52"}]': finished 2024-09-21T13:44:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:07 smithi162 ceph-mon[33046]: osdmap e258: 8 total, 8 up, 8 in 2024-09-21T13:44:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:07.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52"}]': finished 2024-09-21T13:44:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[30076]: osdmap e258: 8 total, 8 up, 8 in 2024-09-21T13:44:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi002-76395-52"}]': finished 2024-09-21T13:44:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[40622]: osdmap e258: 8 total, 8 up, 8 in 2024-09-21T13:44:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi002-76395-52"} : dispatch 2024-09-21T13:44:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:07.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi002-76395-52"}]': finished 2024-09-21T13:44:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: osdmap e259: 8 total, 8 up, 8 in 2024-09-21T13:44:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: pgmap v339: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-37"}]': finished 2024-09-21T13:44:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: osdmap e260: 8 total, 8 up, 8 in 2024-09-21T13:44:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi002-76395-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-37", "mode": "writeback"} : dispatch 2024-09-21T13:44:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi002-76395-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-37", "mode": "writeback"} : dispatch 2024-09-21T13:44:08.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi002-76395-52"}]': finished 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: osdmap e259: 8 total, 8 up, 8 in 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: pgmap v339: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-37"}]': finished 2024-09-21T13:44:08.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: osdmap e260: 8 total, 8 up, 8 in 2024-09-21T13:44:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi002-76395-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-37", "mode": "writeback"} : dispatch 2024-09-21T13:44:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi002-76395-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-37", "mode": "writeback"} : dispatch 2024-09-21T13:44:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2934659777' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi002-76395-52"}]': finished 2024-09-21T13:44:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: osdmap e259: 8 total, 8 up, 8 in 2024-09-21T13:44:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:08.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: pgmap v339: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-37"}]': finished 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: osdmap e260: 8 total, 8 up, 8 in 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi002-76395-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-37", "mode": "writeback"} : dispatch 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi002-76395-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:08.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-37", "mode": "writeback"} : dispatch 2024-09-21T13:44:09.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:44:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:44:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:09 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:09 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:09 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:44:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-37", "mode": "writeback"}]': finished 2024-09-21T13:44:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:09 smithi162 ceph-mon[33046]: osdmap e261: 8 total, 8 up, 8 in 2024-09-21T13:44:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:09.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:09.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:44:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:44:09.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:09.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:09.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:44:09.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-37", "mode": "writeback"}]': finished 2024-09-21T13:44:09.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[30076]: osdmap e261: 8 total, 8 up, 8 in 2024-09-21T13:44:09.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:09.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:44:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-37", "mode": "writeback"}]': finished 2024-09-21T13:44:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[40622]: osdmap e261: 8 total, 8 up, 8 in 2024-09-21T13:44:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:10 smithi162 ceph-mon[33046]: pgmap v342: 228 pgs: 228 active+clean; 4.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi002-76395-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi002-76395-53"}]': finished 2024-09-21T13:44:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:44:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:10 smithi162 ceph-mon[33046]: osdmap e262: 8 total, 8 up, 8 in 2024-09-21T13:44:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:10.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[30076]: pgmap v342: 228 pgs: 228 active+clean; 4.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi002-76395-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi002-76395-53"}]': finished 2024-09-21T13:44:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:44:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[30076]: osdmap e262: 8 total, 8 up, 8 in 2024-09-21T13:44:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[40622]: pgmap v342: 228 pgs: 228 active+clean; 4.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi002-76395-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi002-76395-53"}]': finished 2024-09-21T13:44:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:44:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[40622]: osdmap e262: 8 total, 8 up, 8 in 2024-09-21T13:44:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37"} : dispatch 2024-09-21T13:44:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:11 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:44:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37"}]': finished 2024-09-21T13:44:11.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:11 smithi162 ceph-mon[33046]: osdmap e263: 8 total, 8 up, 8 in 2024-09-21T13:44:11.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:11 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:44:11.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37"}]': finished 2024-09-21T13:44:11.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:11 smithi002 ceph-mon[30076]: osdmap e263: 8 total, 8 up, 8 in 2024-09-21T13:44:11.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:11 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:44:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-37"}]': finished 2024-09-21T13:44:11.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:11 smithi002 ceph-mon[40622]: osdmap e263: 8 total, 8 up, 8 in 2024-09-21T13:44:12.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:12 smithi162 ceph-mon[33046]: pgmap v345: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:12 smithi162 ceph-mon[33046]: osdmap e264: 8 total, 8 up, 8 in 2024-09-21T13:44:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:12.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:12.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:12 smithi002 ceph-mon[40622]: pgmap v345: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:12.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:12 smithi002 ceph-mon[40622]: osdmap e264: 8 total, 8 up, 8 in 2024-09-21T13:44:12.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:12.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:12.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:12 smithi002 ceph-mon[30076]: pgmap v345: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:12 smithi002 ceph-mon[30076]: osdmap e264: 8 total, 8 up, 8 in 2024-09-21T13:44:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:14.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:14.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:14.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"}]': finished 2024-09-21T13:44:14.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:14.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:14 smithi162 ceph-mon[33046]: osdmap e265: 8 total, 8 up, 8 in 2024-09-21T13:44:14.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:14.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:14.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:14.484 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:14 smithi162 ceph-mon[33046]: pgmap v348: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:14.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:14.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:14.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"}]': finished 2024-09-21T13:44:14.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:14.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[40622]: osdmap e265: 8 total, 8 up, 8 in 2024-09-21T13:44:14.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[40622]: pgmap v348: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi002-76395-53"}]': finished 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1012694082' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[30076]: osdmap e265: 8 total, 8 up, 8 in 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"} : dispatch 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:14.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:14 smithi002 ceph-mon[30076]: pgmap v348: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"}]': finished 2024-09-21T13:44:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:15 smithi162 ceph-mon[33046]: osdmap e266: 8 total, 8 up, 8 in 2024-09-21T13:44:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi002-76395-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:15.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi002-76395-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:15.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"}]': finished 2024-09-21T13:44:15.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:15.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[30076]: osdmap e266: 8 total, 8 up, 8 in 2024-09-21T13:44:15.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:15.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:15.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi002-76395-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:15.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi002-76395-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi002-76395-53"}]': finished 2024-09-21T13:44:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[40622]: osdmap e266: 8 total, 8 up, 8 in 2024-09-21T13:44:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:15.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi002-76395-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:15.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi002-76395-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi002-76395-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:16 smithi162 ceph-mon[33046]: osdmap e267: 8 total, 8 up, 8 in 2024-09-21T13:44:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi002-76395-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi002-76395-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:16 smithi162 ceph-mon[33046]: pgmap v351: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:16.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-39"}]': finished 2024-09-21T13:44:16.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:16.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi002-76395-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:16.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[30076]: osdmap e267: 8 total, 8 up, 8 in 2024-09-21T13:44:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi002-76395-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi002-76395-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[30076]: pgmap v351: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:16.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-39"}]': finished 2024-09-21T13:44:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi002-76395-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[40622]: osdmap e267: 8 total, 8 up, 8 in 2024-09-21T13:44:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:16.752 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi002-76395-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:16.753 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:16.753 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsCompletePP_smithi002-76395-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:16.753 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[40622]: pgmap v351: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:16.753 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-39"}]': finished 2024-09-21T13:44:17.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-39", "mode": "writeback"} : dispatch 2024-09-21T13:44:17.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:17 smithi162 ceph-mon[33046]: osdmap e268: 8 total, 8 up, 8 in 2024-09-21T13:44:17.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:17 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:17.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-39", "mode": "writeback"} : dispatch 2024-09-21T13:44:17.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:17 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:44:17.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi002-76395-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi002-76395-54"}]': finished 2024-09-21T13:44:17.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-39", "mode": "writeback"}]': finished 2024-09-21T13:44:17.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:17 smithi162 ceph-mon[33046]: osdmap e269: 8 total, 8 up, 8 in 2024-09-21T13:44:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-39", "mode": "writeback"} : dispatch 2024-09-21T13:44:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[30076]: osdmap e268: 8 total, 8 up, 8 in 2024-09-21T13:44:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-39", "mode": "writeback"} : dispatch 2024-09-21T13:44:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:44:17.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi002-76395-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi002-76395-54"}]': finished 2024-09-21T13:44:17.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-39", "mode": "writeback"}]': finished 2024-09-21T13:44:17.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[30076]: osdmap e269: 8 total, 8 up, 8 in 2024-09-21T13:44:17.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-39", "mode": "writeback"} : dispatch 2024-09-21T13:44:17.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[40622]: osdmap e268: 8 total, 8 up, 8 in 2024-09-21T13:44:17.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:17.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-39", "mode": "writeback"} : dispatch 2024-09-21T13:44:17.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:44:17.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi002-76395-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi002-76395-54"}]': finished 2024-09-21T13:44:17.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-39", "mode": "writeback"}]': finished 2024-09-21T13:44:17.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:17 smithi002 ceph-mon[40622]: osdmap e269: 8 total, 8 up, 8 in 2024-09-21T13:44:18.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:18.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:18.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:18 smithi162 ceph-mon[33046]: pgmap v354: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:18.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:44:18.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:18 smithi162 ceph-mon[33046]: osdmap e270: 8 total, 8 up, 8 in 2024-09-21T13:44:18.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:18.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[30076]: pgmap v354: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:44:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[30076]: osdmap e270: 8 total, 8 up, 8 in 2024-09-21T13:44:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:18.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[40622]: pgmap v354: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:44:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[40622]: osdmap e270: 8 total, 8 up, 8 in 2024-09-21T13:44:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:18.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39"} : dispatch 2024-09-21T13:44:19.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:44:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:44:19.669 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:19.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:44:19.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39"}]': finished 2024-09-21T13:44:19.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[30076]: osdmap e271: 8 total, 8 up, 8 in 2024-09-21T13:44:19.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:19.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:44:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39"}]': finished 2024-09-21T13:44:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[40622]: osdmap e271: 8 total, 8 up, 8 in 2024-09-21T13:44:19.670 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:19.671 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:19 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:19 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:44:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-39"}]': finished 2024-09-21T13:44:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:19 smithi162 ceph-mon[33046]: osdmap e271: 8 total, 8 up, 8 in 2024-09-21T13:44:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:20.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:44:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:44:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:44:20.386 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-09-21T13:44:20.386 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-09-21T13:44:20.386 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-09-21T13:44:20.386 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: seed 76734 2024-09-21T13:44:20.386 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-09-21T13:44:20.386 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (359 ms) 2024-09-21T13:44:20.386 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-21T13:44:20.386 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (10314 ms) 2024-09-21T13:44:20.386 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-09-21T13:44:20.386 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (21 ms) 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (10694 ms total) 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (7072 ms) 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (7958 ms) 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (9981 ms) 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: my_snaps [3] 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: my_snaps [4,3] 2024-09-21T13:44:20.387 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: my_snaps [5,4,3] 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: promoting some heads 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: promoting from clones for snap 6 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: promoting from clones for snap 5 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: promoting from clones for snap 4 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: promoting from clones for snap 3 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: waiting for scrubs... 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: done waiting 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (46105 ms) 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (9935 ms) 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (7993 ms) 2024-09-21T13:44:20.388 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8033 ms) 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8029 ms) 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10038 ms) 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (8898 ms) 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10047 ms) 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (11981 ms) 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (7978 ms) 2024-09-21T13:44:20.389 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-21T13:44:20.390 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (8029 ms) 2024-09-21T13:44:20.390 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-21T13:44:20.390 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13024 ms) 2024-09-21T13:44:20.390 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-21T13:44:20.390 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7951 ms) 2024-09-21T13:44:20.390 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-21T13:44:20.390 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8022 ms) 2024-09-21T13:44:20.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:20 smithi162 ceph-mon[33046]: pgmap v357: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 106 op/s 2024-09-21T13:44:20.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"}]': finished 2024-09-21T13:44:20.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:20 smithi162 ceph-mon[33046]: osdmap e272: 8 total, 8 up, 8 in 2024-09-21T13:44:20.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:20.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:20 smithi002 ceph-mon[30076]: pgmap v357: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 106 op/s 2024-09-21T13:44:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"}]': finished 2024-09-21T13:44:20.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:20 smithi002 ceph-mon[30076]: osdmap e272: 8 total, 8 up, 8 in 2024-09-21T13:44:20.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:20.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:20 smithi002 ceph-mon[40622]: pgmap v357: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 106 op/s 2024-09-21T13:44:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi002-76395-54"}]': finished 2024-09-21T13:44:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:20 smithi002 ceph-mon[40622]: osdmap e272: 8 total, 8 up, 8 in 2024-09-21T13:44:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1623656630' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"} : dispatch 2024-09-21T13:44:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"}]': finished 2024-09-21T13:44:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:22 smithi162 ceph-mon[33046]: osdmap e273: 8 total, 8 up, 8 in 2024-09-21T13:44:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi002-76395-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi002-76395-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:22.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:22 smithi162 ceph-mon[33046]: pgmap v360: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T13:44:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"}]': finished 2024-09-21T13:44:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[30076]: osdmap e273: 8 total, 8 up, 8 in 2024-09-21T13:44:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi002-76395-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi002-76395-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[30076]: pgmap v360: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T13:44:22.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi002-76395-54"}]': finished 2024-09-21T13:44:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[40622]: osdmap e273: 8 total, 8 up, 8 in 2024-09-21T13:44:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi002-76395-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi002-76395-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:22.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:22 smithi002 ceph-mon[40622]: pgmap v360: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T13:44:23.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:23 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:23.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:23.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi002-76395-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:23.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:23 smithi162 ceph-mon[33046]: osdmap e274: 8 total, 8 up, 8 in 2024-09-21T13:44:23.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi002-76395-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:23.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi002-76395-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:23.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:23.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:23.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:23.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi002-76395-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[30076]: osdmap e274: 8 total, 8 up, 8 in 2024-09-21T13:44:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi002-76395-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi002-76395-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:23.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:23.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi002-76395-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[40622]: osdmap e274: 8 total, 8 up, 8 in 2024-09-21T13:44:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi002-76395-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "IsSafePP_smithi002-76395-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:23.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:23.853 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:44:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:24 smithi162 ceph-mon[33046]: osdmap e275: 8 total, 8 up, 8 in 2024-09-21T13:44:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:44:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:24 smithi162 ceph-mon[33046]: pgmap v363: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:44:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:24 smithi002 ceph-mon[30076]: osdmap e275: 8 total, 8 up, 8 in 2024-09-21T13:44:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:44:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:24 smithi002 ceph-mon[30076]: pgmap v363: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:44:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:24 smithi002 ceph-mon[40622]: osdmap e275: 8 total, 8 up, 8 in 2024-09-21T13:44:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:44:24.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:24 smithi002 ceph-mon[40622]: pgmap v363: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:25.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi002-76395-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi002-76395-55"}]': finished 2024-09-21T13:44:25.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:44:25.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:25 smithi162 ceph-mon[33046]: osdmap e276: 8 total, 8 up, 8 in 2024-09-21T13:44:25.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:25.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:25.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi002-76395-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi002-76395-55"}]': finished 2024-09-21T13:44:25.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:44:25.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:25 smithi002 ceph-mon[40622]: osdmap e276: 8 total, 8 up, 8 in 2024-09-21T13:44:25.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:25.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi002-76395-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi002-76395-55"}]': finished 2024-09-21T13:44:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:44:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:25 smithi002 ceph-mon[30076]: osdmap e276: 8 total, 8 up, 8 in 2024-09-21T13:44:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:25.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:44:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:26 smithi162 ceph-mon[33046]: osdmap e277: 8 total, 8 up, 8 in 2024-09-21T13:44:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:44:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:44:26.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:26 smithi162 ceph-mon[33046]: pgmap v366: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:44:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:26 smithi002 ceph-mon[30076]: osdmap e277: 8 total, 8 up, 8 in 2024-09-21T13:44:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:44:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:44:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:26 smithi002 ceph-mon[30076]: pgmap v366: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:44:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:26 smithi002 ceph-mon[40622]: osdmap e277: 8 total, 8 up, 8 in 2024-09-21T13:44:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:44:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:44:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:26 smithi002 ceph-mon[40622]: pgmap v366: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:44:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:27 smithi162 ceph-mon[33046]: osdmap e278: 8 total, 8 up, 8 in 2024-09-21T13:44:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:27.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:27.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:44:27.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:27 smithi002 ceph-mon[30076]: osdmap e278: 8 total, 8 up, 8 in 2024-09-21T13:44:27.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:27.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:44:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:27 smithi002 ceph-mon[40622]: osdmap e278: 8 total, 8 up, 8 in 2024-09-21T13:44:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:27.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:28.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"}]': finished 2024-09-21T13:44:28.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: osdmap e279: 8 total, 8 up, 8 in 2024-09-21T13:44:28.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:28.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:28.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:28.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:28.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41"} : dispatch 2024-09-21T13:44:28.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41"} : dispatch 2024-09-21T13:44:28.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: pgmap v369: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:28.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "107.1b", "id": [3, 7]} : dispatch 2024-09-21T13:44:28.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:28.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"}]': finished 2024-09-21T13:44:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"}]': finished 2024-09-21T13:44:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: osdmap e279: 8 total, 8 up, 8 in 2024-09-21T13:44:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41"} : dispatch 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41"} : dispatch 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: pgmap v369: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "107.1b", "id": [3, 7]} : dispatch 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"}]': finished 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi002-76395-55"}]': finished 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: osdmap e279: 8 total, 8 up, 8 in 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2251196255' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"} : dispatch 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41"} : dispatch 2024-09-21T13:44:28.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41"} : dispatch 2024-09-21T13:44:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: pgmap v369: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "107.1b", "id": [3, 7]} : dispatch 2024-09-21T13:44:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:28.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi002-76395-55"}]': finished 2024-09-21T13:44:29.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:44:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:44:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41"}]': finished 2024-09-21T13:44:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "107.1b", "id": [3, 7]}]': finished 2024-09-21T13:44:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:29 smithi162 ceph-mon[33046]: osdmap e280: 8 total, 8 up, 8 in 2024-09-21T13:44:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:29 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi002-76395-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:29 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:29.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi002-76395-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:29 smithi162 ceph-mon[33046]: osdmap e281: 8 total, 8 up, 8 in 2024-09-21T13:44:29.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValuePP_smithi002-76395-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:29.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:44:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:44:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41"}]': finished 2024-09-21T13:44:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "107.1b", "id": [3, 7]}]': finished 2024-09-21T13:44:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[40622]: osdmap e280: 8 total, 8 up, 8 in 2024-09-21T13:44:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi002-76395-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi002-76395-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[40622]: osdmap e281: 8 total, 8 up, 8 in 2024-09-21T13:44:29.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValuePP_smithi002-76395-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-41"}]': finished 2024-09-21T13:44:29.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "107.1b", "id": [3, 7]}]': finished 2024-09-21T13:44:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[30076]: osdmap e280: 8 total, 8 up, 8 in 2024-09-21T13:44:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi002-76395-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi002-76395-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[30076]: osdmap e281: 8 total, 8 up, 8 in 2024-09-21T13:44:29.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReturnValuePP_smithi002-76395-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:30.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:30 smithi162 ceph-mon[33046]: pgmap v372: 196 pgs: 1 peering, 195 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:30.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:30 smithi002 ceph-mon[30076]: pgmap v372: 196 pgs: 1 peering, 195 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:30 smithi002 ceph-mon[40622]: pgmap v372: 196 pgs: 1 peering, 195 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:31.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:31 smithi162 ceph-mon[33046]: osdmap e282: 8 total, 8 up, 8 in 2024-09-21T13:44:31.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:31.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:31 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:31.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi002-76395-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi002-76395-56"}]': finished 2024-09-21T13:44:31.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:31 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:31.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:31 smithi162 ceph-mon[33046]: osdmap e283: 8 total, 8 up, 8 in 2024-09-21T13:44:31.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi002-76734-6","var": "pg_num","format": "json"} : dispatch 2024-09-21T13:44:31.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:31.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:31 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:31.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[30076]: osdmap e282: 8 total, 8 up, 8 in 2024-09-21T13:44:31.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:31.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:31.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi002-76395-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi002-76395-56"}]': finished 2024-09-21T13:44:31.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:31.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[30076]: osdmap e283: 8 total, 8 up, 8 in 2024-09-21T13:44:31.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi002-76734-6","var": "pg_num","format": "json"} : dispatch 2024-09-21T13:44:31.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:31.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:31.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[40622]: osdmap e282: 8 total, 8 up, 8 in 2024-09-21T13:44:31.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:31.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:31.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi002-76395-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi002-76395-56"}]': finished 2024-09-21T13:44:31.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:31.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[40622]: osdmap e283: 8 total, 8 up, 8 in 2024-09-21T13:44:31.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi002-76734-6","var": "pg_num","format": "json"} : dispatch 2024-09-21T13:44:31.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:31.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:31 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:32.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:32 smithi162 ceph-mon[33046]: pgmap v375: 236 pgs: 40 unknown, 1 peering, 195 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:32.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:32.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:32 smithi162 ceph-mon[33046]: osdmap e284: 8 total, 8 up, 8 in 2024-09-21T13:44:32.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T13:44:32.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T13:44:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:32 smithi002 ceph-mon[30076]: pgmap v375: 236 pgs: 40 unknown, 1 peering, 195 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:32 smithi002 ceph-mon[30076]: osdmap e284: 8 total, 8 up, 8 in 2024-09-21T13:44:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T13:44:32.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T13:44:32.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:32 smithi002 ceph-mon[40622]: pgmap v375: 236 pgs: 40 unknown, 1 peering, 195 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:32.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:32.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:32 smithi002 ceph-mon[40622]: osdmap e284: 8 total, 8 up, 8 in 2024-09-21T13:44:32.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T13:44:32.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_count","val": "8"} : dispatch 2024-09-21T13:44:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_count","val": "8"}]': finished 2024-09-21T13:44:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:34 smithi162 ceph-mon[33046]: osdmap e285: 8 total, 8 up, 8 in 2024-09-21T13:44:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:34 smithi162 ceph-mon[33046]: pgmap v378: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 10 B/s, 4 objects/s recovering 2024-09-21T13:44:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_count","val": "8"}]': finished 2024-09-21T13:44:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[30076]: osdmap e285: 8 total, 8 up, 8 in 2024-09-21T13:44:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:34.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[30076]: pgmap v378: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 10 B/s, 4 objects/s recovering 2024-09-21T13:44:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_count","val": "8"}]': finished 2024-09-21T13:44:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[40622]: osdmap e285: 8 total, 8 up, 8 in 2024-09-21T13:44:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:44:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:34 smithi002 ceph-mon[40622]: pgmap v378: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 10 B/s, 4 objects/s recovering 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: hmm, no HitSet yet 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: ok, hit_set contains 273:602f83fe:::foo:head 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9043 ms) 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg_num = 32 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 0 ls 1726926276,0 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 1 ls 1726926276,0 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 2 ls 1726926276,0 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 3 ls 1726926276,0 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 4 ls 1726926276,0 2024-09-21T13:44:35.679 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 5 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 6 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 7 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 8 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 9 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 10 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 11 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 12 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 13 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 14 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 15 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 16 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 17 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 18 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 19 ls 1726926276,0 2024-09-21T13:44:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 20 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 21 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 22 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 23 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 24 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 25 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 26 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 27 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 28 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 29 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 30 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg 31 ls 1726926276,0 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: pg_num = 32 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:6cac518f:::0:head 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:02547ec2:::1:head 2024-09-21T13:44:35.681 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:f905c69b:::2:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:cfc208b3:::3:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:d83876eb:::4:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:b29083e3:::5:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:c4fdafeb:::6:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:5c6b0b28:::7:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:bd63b0f1:::8:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:e960b815:::9:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:52ea6a34:::10:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:89d3ae78:::11:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:de5d7c5f:::12:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:566253c9:::13:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:62a1935d:::14:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:863748b0:::15:head 2024-09-21T13:44:35.682 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:3958e169:::16:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:4d4dabf9:::17:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:8391935d:::18:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:28883081:::19:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:69259c59:::20:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:4bdb80b7:::21:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:a11c5d71:::22:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:271af37b:::23:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:95b121be:::24:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:58d1031b:::25:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:0a050783:::26:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:c709704c:::27:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:cbe56eaf:::28:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:86b4b162:::29:head 2024-09-21T13:44:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:70d89383:::30:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:dd450c7c:::31:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:6d5729b1:::32:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:c388f3fb:::33:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:56cfea31:::34:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:9dbc1bf7:::35:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:40b74ccd:::36:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:4d5aaf42:::37:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:920f362c:::38:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:6cc53222:::39:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:9cad833f:::40:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:1ea84d41:::41:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:c4480ef6:::42:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:a694361e:::43:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:d1bd33e9:::44:head 2024-09-21T13:44:35.684 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:ddc2cd5d:::45:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:2b782207:::46:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:7b187fca:::47:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:90ecdf6f:::48:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:a5ed95fe:::49:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:ea0eaa55:::50:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:f33ef17b:::51:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:a0d1b2f6:::52:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:60c5229e:::53:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:edcbc575:::54:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:102cf253:::55:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:efb7fb0b:::56:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:50d0a326:::57:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:d4dc5daf:::58:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:3a130462:::59:head 2024-09-21T13:44:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:ec87ed71:::60:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:d5bc9454:::61:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:3ddfe313:::62:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:7c2816b9:::63:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:47e00e4d:::64:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:c6410c18:::65:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:b48ed237:::66:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:cd63ad31:::67:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:b179e92b:::68:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:0d9f741a:::69:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:6d3352ae:::70:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:c6d5c19e:::71:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:bc4729c3:::72:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:77e930b9:::73:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:0abeecfd:::74:head 2024-09-21T13:44:35.686 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:b7c37e15:::75:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:b6378398:::76:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:02bd68de:::77:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:cc795d2d:::78:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:630d4fea:::79:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:e0d29ef5:::80:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:fd6f13d2:::81:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:606461d5:::82:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:eadbdc43:::83:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:8761d0bb:::84:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:9ef0186f:::85:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:e0d41294:::86:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:961de695:::87:head 2024-09-21T13:44:35.687 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:1423148f:::88:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:633a8fa2:::89:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:a8653809:::90:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:3dac8b33:::91:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:35aad435:::92:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:f6dcc343:::93:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:dbbdad87:::94:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:1cb48ce0:::95:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:03cd461c:::96:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:17a4ea99:::97:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:9993c9a7:::98:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:6394211c:::99:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:94c7ae57:::100:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:6fdee5bb:::101:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:9a477fd1:::102:head 2024-09-21T13:44:35.688 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:eb850916:::103:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:affc56b9:::104:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:b42dc814:::105:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:f319f8f0:::106:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:9a40b9de:::107:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:8b524f28:::108:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:e3de589f:::109:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:90f90a5b:::110:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:a7b4f1d7:::111:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:af51766e:::112:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:b6f90bd1:::113:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:e0261208:::114:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:c9569ef7:::115:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:61bebe50:::116:head 2024-09-21T13:44:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:fe93412b:::117:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:d3d38bee:::118:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:3100ba0c:::119:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:d0560ada:::120:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:f0ea8b35:::121:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:766f231a:::122:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:a07a2582:::123:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:bd7c6b3a:::124:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:fb2ddaff:::125:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:4408e1fe:::126:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:ee1df7a7:::127:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:c3002909:::128:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:4f48ffa9:::129:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:edf38733:::130:head 2024-09-21T13:44:35.690 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:c08425c0:::131:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:5f902d98:::132:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:41ea2c93:::133:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:813cee13:::134:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:0131818d:::135:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:26ba5a85:::136:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:381b8a5a:::137:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:28797e47:::138:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:bfca7f22:::139:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:36807075:::140:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:80b03975:::141:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:5c15709b:::142:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:f39ea15e:::143:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:ea992956:::144:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:48887b1c:::145:head 2024-09-21T13:44:35.691 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:9f24a9dd:::146:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:987f100b:::147:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:d2dd3581:::148:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:7fed1808:::149:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:c80b70e9:::150:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:85ed90f9:::151:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:36428b24:::152:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:d044c34a:::153:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:7c18bf58:::154:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:d1c21232:::155:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:a7a3c575:::156:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:87da0633:::157:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:d5ac3822:::158:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:3f20522d:::159:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:6ca26563:::160:head 2024-09-21T13:44:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:532ce135:::161:head 2024-09-21T13:44:35.693 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:c78863e6:::162:head 2024-09-21T13:44:35.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:35 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi002-76395-56"}]': finished 2024-09-21T13:44:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:44:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:35 smithi162 ceph-mon[33046]: osdmap e286: 8 total, 8 up, 8 in 2024-09-21T13:44:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T13:44:35.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T13:44:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi002-76395-56"}]': finished 2024-09-21T13:44:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:44:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[30076]: osdmap e286: 8 total, 8 up, 8 in 2024-09-21T13:44:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T13:44:35.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T13:44:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi002-76395-56"}]': finished 2024-09-21T13:44:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:44:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[40622]: osdmap e286: 8 total, 8 up, 8 in 2024-09-21T13:44:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi002-76395-56"} : dispatch 2024-09-21T13:44:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T13:44:35.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_type","val": "explicit_hash"} : dispatch 2024-09-21T13:44:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi002-76395-56"}]': finished 2024-09-21T13:44:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-21T13:44:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: osdmap e287: 8 total, 8 up, 8 in 2024-09-21T13:44:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi002-76395-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: pgmap v381: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 10 B/s, 4 objects/s recovering 2024-09-21T13:44:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi002-76734-43","var": "pg_num","format": "json"} : dispatch 2024-09-21T13:44:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:36.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:36.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43"} : dispatch 2024-09-21T13:44:36.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43"} : dispatch 2024-09-21T13:44:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi002-76395-56"}]': finished 2024-09-21T13:44:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-21T13:44:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: osdmap e287: 8 total, 8 up, 8 in 2024-09-21T13:44:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi002-76395-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: pgmap v381: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 10 B/s, 4 objects/s recovering 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi002-76734-43","var": "pg_num","format": "json"} : dispatch 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43"} : dispatch 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43"} : dispatch 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3441915153' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi002-76395-56"}]': finished 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: osdmap e287: 8 total, 8 up, 8 in 2024-09-21T13:44:36.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi002-76395-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: pgmap v381: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 10 B/s, 4 objects/s recovering 2024-09-21T13:44:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool get","pool":"test-rados-api-smithi002-76734-43","var": "pg_num","format": "json"} : dispatch 2024-09-21T13:44:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43"} : dispatch 2024-09-21T13:44:36.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43"} : dispatch 2024-09-21T13:44:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi002-76395-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43"}]': finished 2024-09-21T13:44:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:37 smithi162 ceph-mon[33046]: osdmap e288: 8 total, 8 up, 8 in 2024-09-21T13:44:37.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushPP_smithi002-76395-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi002-76395-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43"}]': finished 2024-09-21T13:44:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:37 smithi002 ceph-mon[30076]: osdmap e288: 8 total, 8 up, 8 in 2024-09-21T13:44:37.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushPP_smithi002-76395-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:37.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi002-76395-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-43"}]': finished 2024-09-21T13:44:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:37 smithi002 ceph-mon[40622]: osdmap e288: 8 total, 8 up, 8 in 2024-09-21T13:44:37.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushPP_smithi002-76395-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:38.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:38 smithi162 ceph-mon[33046]: osdmap e289: 8 total, 8 up, 8 in 2024-09-21T13:44:38.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:38 smithi162 ceph-mon[33046]: pgmap v384: 196 pgs: 196 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:38.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi002-76395-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi002-76395-57"}]': finished 2024-09-21T13:44:38.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:38 smithi162 ceph-mon[33046]: osdmap e290: 8 total, 8 up, 8 in 2024-09-21T13:44:38.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:38.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:38.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[30076]: osdmap e289: 8 total, 8 up, 8 in 2024-09-21T13:44:38.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[30076]: pgmap v384: 196 pgs: 196 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:38.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi002-76395-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi002-76395-57"}]': finished 2024-09-21T13:44:38.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[30076]: osdmap e290: 8 total, 8 up, 8 in 2024-09-21T13:44:38.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:38.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:38.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[40622]: osdmap e289: 8 total, 8 up, 8 in 2024-09-21T13:44:38.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[40622]: pgmap v384: 196 pgs: 196 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:38.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi002-76395-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi002-76395-57"}]': finished 2024-09-21T13:44:38.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[40622]: osdmap e290: 8 total, 8 up, 8 in 2024-09-21T13:44:38.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:38.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:39.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:44:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:44:39.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:39 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:39.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:39.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:39 smithi162 ceph-mon[33046]: osdmap e291: 8 total, 8 up, 8 in 2024-09-21T13:44:39.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:39.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:39.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:44:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:44:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:44:39.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:39 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:39.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:39.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:39 smithi002 ceph-mon[30076]: osdmap e291: 8 total, 8 up, 8 in 2024-09-21T13:44:39.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:39.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:39.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:39 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:39.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:39.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:39 smithi002 ceph-mon[40622]: osdmap e291: 8 total, 8 up, 8 in 2024-09-21T13:44:39.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:39.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:44:40.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[40622]: pgmap v387: 236 pgs: 40 creating+peering, 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:40.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:40.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[40622]: osdmap e292: 8 total, 8 up, 8 in 2024-09-21T13:44:40.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:40.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T13:44:40.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T13:44:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[30076]: pgmap v387: 236 pgs: 40 creating+peering, 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[30076]: osdmap e292: 8 total, 8 up, 8 in 2024-09-21T13:44:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T13:44:40.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T13:44:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:40 smithi162 ceph-mon[33046]: pgmap v387: 236 pgs: 40 creating+peering, 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:44:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:40 smithi162 ceph-mon[33046]: osdmap e292: 8 total, 8 up, 8 in 2024-09-21T13:44:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T13:44:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T13:44:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:44:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi002-76395-57"}]': finished 2024-09-21T13:44:41.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_count","val": "3"}]': finished 2024-09-21T13:44:41.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: osdmap e293: 8 total, 8 up, 8 in 2024-09-21T13:44:41.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T13:44:41.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:41.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T13:44:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:44:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi002-76395-57"}]': finished 2024-09-21T13:44:41.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_count","val": "3"}]': finished 2024-09-21T13:44:41.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: osdmap e293: 8 total, 8 up, 8 in 2024-09-21T13:44:41.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T13:44:41.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:41.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T13:44:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:44:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi002-76395-57"}]': finished 2024-09-21T13:44:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_count","val": "3"}]': finished 2024-09-21T13:44:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: osdmap e293: 8 total, 8 up, 8 in 2024-09-21T13:44:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T13:44:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushPP_smithi002-76395-57"} : dispatch 2024-09-21T13:44:41.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T13:44:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[30076]: pgmap v390: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:44:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:44:42.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi002-76395-57"}]': finished 2024-09-21T13:44:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_period","val": "3"}]': finished 2024-09-21T13:44:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[30076]: osdmap e294: 8 total, 8 up, 8 in 2024-09-21T13:44:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:44:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:44:42.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[40622]: pgmap v390: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:44:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:44:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:42.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi002-76395-57"}]': finished 2024-09-21T13:44:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_period","val": "3"}]': finished 2024-09-21T13:44:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[40622]: osdmap e294: 8 total, 8 up, 8 in 2024-09-21T13:44:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:44:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:44:42.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:42 smithi162 ceph-mon[33046]: pgmap v390: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:44:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:44:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:44:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1975241178' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi002-76395-57"}]': finished 2024-09-21T13:44:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_period","val": "3"}]': finished 2024-09-21T13:44:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:42 smithi162 ceph-mon[33046]: osdmap e294: 8 total, 8 up, 8 in 2024-09-21T13:44:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:44:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:44:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:43.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:43.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi002-76395-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:44:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi002-76395-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[30076]: osdmap e295: 8 total, 8 up, 8 in 2024-09-21T13:44:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T13:44:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi002-76395-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:43.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T13:44:43.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:43.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi002-76395-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:43.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:43.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:44:43.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi002-76395-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:43.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[40622]: osdmap e295: 8 total, 8 up, 8 in 2024-09-21T13:44:43.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T13:44:43.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi002-76395-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:43.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T13:44:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi002-76395-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:44:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi002-76395-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:43 smithi162 ceph-mon[33046]: osdmap e295: 8 total, 8 up, 8 in 2024-09-21T13:44:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T13:44:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi002-76395-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T13:44:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:44 smithi002 ceph-mon[30076]: pgmap v393: 228 pgs: 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:44 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T13:44:44.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:44 smithi002 ceph-mon[30076]: osdmap e296: 8 total, 8 up, 8 in 2024-09-21T13:44:44.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:44 smithi002 ceph-mon[40622]: pgmap v393: 228 pgs: 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:44.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:44 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T13:44:44.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:44 smithi002 ceph-mon[40622]: osdmap e296: 8 total, 8 up, 8 in 2024-09-21T13:44:44.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:44 smithi162 ceph-mon[33046]: pgmap v393: 228 pgs: 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:44 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T13:44:44.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:44 smithi162 ceph-mon[33046]: osdmap e296: 8 total, 8 up, 8 in 2024-09-21T13:44:46.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi002-76395-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi002-76395-58"}]': finished 2024-09-21T13:44:46.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:46 smithi162 ceph-mon[33046]: osdmap e297: 8 total, 8 up, 8 in 2024-09-21T13:44:46.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:46 smithi162 ceph-mon[33046]: pgmap v396: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:46.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi002-76395-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi002-76395-58"}]': finished 2024-09-21T13:44:46.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:46 smithi002 ceph-mon[30076]: osdmap e297: 8 total, 8 up, 8 in 2024-09-21T13:44:46.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:46 smithi002 ceph-mon[30076]: pgmap v396: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:46.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi002-76395-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi002-76395-58"}]': finished 2024-09-21T13:44:46.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:46 smithi002 ceph-mon[40622]: osdmap e297: 8 total, 8 up, 8 in 2024-09-21T13:44:46.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:46 smithi002 ceph-mon[40622]: pgmap v396: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:44:47.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:47 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:47.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:47 smithi162 ceph-mon[33046]: osdmap e298: 8 total, 8 up, 8 in 2024-09-21T13:44:47.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:47 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:47.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:47 smithi002 ceph-mon[30076]: osdmap e298: 8 total, 8 up, 8 in 2024-09-21T13:44:47.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:47 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:47.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:47 smithi002 ceph-mon[40622]: osdmap e298: 8 total, 8 up, 8 in 2024-09-21T13:44:48.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:48 smithi162 ceph-mon[33046]: osdmap e299: 8 total, 8 up, 8 in 2024-09-21T13:44:48.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:48.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:48 smithi162 ceph-mon[33046]: pgmap v399: 228 pgs: 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:48.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:48 smithi002 ceph-mon[30076]: osdmap e299: 8 total, 8 up, 8 in 2024-09-21T13:44:48.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:48.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:48 smithi002 ceph-mon[30076]: pgmap v399: 228 pgs: 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:48.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:48 smithi002 ceph-mon[40622]: osdmap e299: 8 total, 8 up, 8 in 2024-09-21T13:44:48.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:48.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:48 smithi002 ceph-mon[40622]: pgmap v399: 228 pgs: 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:49.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:44:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:44:49.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:44:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:44:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:44:49.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi002-76395-58"}]': finished 2024-09-21T13:44:49.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:49 smithi002 ceph-mon[40622]: osdmap e300: 8 total, 8 up, 8 in 2024-09-21T13:44:49.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:49.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:49 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi002-76395-58"}]': finished 2024-09-21T13:44:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:49 smithi002 ceph-mon[30076]: osdmap e300: 8 total, 8 up, 8 in 2024-09-21T13:44:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:49.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:49 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi002-76395-58"}]': finished 2024-09-21T13:44:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:49 smithi162 ceph-mon[33046]: osdmap e300: 8 total, 8 up, 8 in 2024-09-21T13:44:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi002-76395-58"} : dispatch 2024-09-21T13:44:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:49 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:50.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi002-76395-58"}]': finished 2024-09-21T13:44:50.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[30076]: osdmap e301: 8 total, 8 up, 8 in 2024-09-21T13:44:50.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:50.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[30076]: pgmap v402: 228 pgs: 228 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi002-76395-58"}]': finished 2024-09-21T13:44:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[40622]: osdmap e301: 8 total, 8 up, 8 in 2024-09-21T13:44:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:50.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:50.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:50 smithi002 ceph-mon[40622]: pgmap v402: 228 pgs: 228 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3554710815' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi002-76395-58"}]': finished 2024-09-21T13:44:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:50 smithi162 ceph-mon[33046]: osdmap e301: 8 total, 8 up, 8 in 2024-09-21T13:44:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:50.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:50.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:44:50.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:50 smithi162 ceph-mon[33046]: pgmap v402: 228 pgs: 228 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:51 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:51 smithi002 ceph-mon[30076]: osdmap e302: 8 total, 8 up, 8 in 2024-09-21T13:44:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi002-76395-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:51.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:51 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi002-76395-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:51 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:51 smithi002 ceph-mon[40622]: osdmap e302: 8 total, 8 up, 8 in 2024-09-21T13:44:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi002-76395-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:51 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi002-76395-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:51 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:44:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:51 smithi162 ceph-mon[33046]: osdmap e302: 8 total, 8 up, 8 in 2024-09-21T13:44:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi002-76395-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:51 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi002-76395-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:52.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:52 smithi002 ceph-mon[30076]: osdmap e303: 8 total, 8 up, 8 in 2024-09-21T13:44:52.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:52 smithi002 ceph-mon[30076]: pgmap v405: 228 pgs: 228 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:52.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi002-76395-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi002-76395-59"}]': finished 2024-09-21T13:44:52.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:52 smithi002 ceph-mon[30076]: osdmap e304: 8 total, 8 up, 8 in 2024-09-21T13:44:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:52 smithi002 ceph-mon[40622]: osdmap e303: 8 total, 8 up, 8 in 2024-09-21T13:44:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:52 smithi002 ceph-mon[40622]: pgmap v405: 228 pgs: 228 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi002-76395-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi002-76395-59"}]': finished 2024-09-21T13:44:52.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:52 smithi002 ceph-mon[40622]: osdmap e304: 8 total, 8 up, 8 in 2024-09-21T13:44:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:52 smithi162 ceph-mon[33046]: osdmap e303: 8 total, 8 up, 8 in 2024-09-21T13:44:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:52 smithi162 ceph-mon[33046]: pgmap v405: 228 pgs: 228 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:44:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi002-76395-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi002-76395-59"}]': finished 2024-09-21T13:44:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:52 smithi162 ceph-mon[33046]: osdmap e304: 8 total, 8 up, 8 in 2024-09-21T13:44:53.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:53 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:53.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:53 smithi002 ceph-mon[30076]: osdmap e305: 8 total, 8 up, 8 in 2024-09-21T13:44:53.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:53 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:53.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:53 smithi002 ceph-mon[40622]: osdmap e305: 8 total, 8 up, 8 in 2024-09-21T13:44:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:53 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:44:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:53 smithi162 ceph-mon[33046]: osdmap e305: 8 total, 8 up, 8 in 2024-09-21T13:44:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:54 smithi002 ceph-mon[30076]: pgmap v408: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T13:44:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:54 smithi002 ceph-mon[30076]: osdmap e306: 8 total, 8 up, 8 in 2024-09-21T13:44:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:54.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:54 smithi002 ceph-mon[40622]: pgmap v408: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T13:44:54.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:54 smithi002 ceph-mon[40622]: osdmap e306: 8 total, 8 up, 8 in 2024-09-21T13:44:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:54.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:54 smithi162 ceph-mon[33046]: pgmap v408: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T13:44:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:54 smithi162 ceph-mon[33046]: osdmap e306: 8 total, 8 up, 8 in 2024-09-21T13:44:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:56.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"}]': finished 2024-09-21T13:44:56.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:56 smithi002 ceph-mon[30076]: osdmap e307: 8 total, 8 up, 8 in 2024-09-21T13:44:56.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:56.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:56.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:56 smithi002 ceph-mon[30076]: pgmap v411: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T13:44:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"}]': finished 2024-09-21T13:44:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:56 smithi002 ceph-mon[40622]: osdmap e307: 8 total, 8 up, 8 in 2024-09-21T13:44:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:56.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:56 smithi002 ceph-mon[40622]: pgmap v411: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T13:44:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi002-76395-59"}]': finished 2024-09-21T13:44:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:56 smithi162 ceph-mon[33046]: osdmap e307: 8 total, 8 up, 8 in 2024-09-21T13:44:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/476039768' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"} : dispatch 2024-09-21T13:44:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:56 smithi162 ceph-mon[33046]: pgmap v411: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T13:44:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"}]': finished 2024-09-21T13:44:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[30076]: osdmap e308: 8 total, 8 up, 8 in 2024-09-21T13:44:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45"} : dispatch 2024-09-21T13:44:57.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45"} : dispatch 2024-09-21T13:44:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"}]': finished 2024-09-21T13:44:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[40622]: osdmap e308: 8 total, 8 up, 8 in 2024-09-21T13:44:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45"} : dispatch 2024-09-21T13:44:57.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45"} : dispatch 2024-09-21T13:44:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi002-76395-59"}]': finished 2024-09-21T13:44:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:57 smithi162 ceph-mon[33046]: osdmap e308: 8 total, 8 up, 8 in 2024-09-21T13:44:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:44:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45"} : dispatch 2024-09-21T13:44:57.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45"} : dispatch 2024-09-21T13:44:58.817 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:58 smithi162 ceph-mon[33046]: pgmap v413: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:58.817 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45"}]': finished 2024-09-21T13:44:58.817 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:58 smithi162 ceph-mon[33046]: osdmap e309: 8 total, 8 up, 8 in 2024-09-21T13:44:58.817 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/532988140' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:58.818 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:58.818 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[30076]: pgmap v413: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45"}]': finished 2024-09-21T13:44:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[30076]: osdmap e309: 8 total, 8 up, 8 in 2024-09-21T13:44:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/532988140' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[40622]: pgmap v413: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:44:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-45"}]': finished 2024-09-21T13:44:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[40622]: osdmap e309: 8 total, 8 up, 8 in 2024-09-21T13:44:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/532988140' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-60","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:44:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:44:59.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:44:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:44:59.560 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:7462ddf6:::1.RoundTripAppendPP (2971 ms) 2024-09-21T13:44:59.560 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-09-21T13:44:59.560 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3013 ms) 2024-09-21T13:44:59.560 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-21T13:44:59.560 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3012 ms) 2024-09-21T13:44:59.560 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-21T13:44:59.560 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3016 ms) 2024-09-21T13:44:59.560 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-09-21T13:44:59.560 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: setting pool EIO 2024-09-21T13:44:59.560 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: max_success 99, min_failed 100 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (4014 ms) 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3008 ms) 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (115520 ms total) 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3012 ms) 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9035 ms) 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14927 ms) 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-21T13:44:59.561 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3010 ms) 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29986 ms total) 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3010 ms) 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3010 ms total) 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13999 ms) 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6968 ms) 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-09-21T13:44:59.562 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7020 ms) 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7019 ms) 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3006 ms) 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7018 ms) 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6951 ms) 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7015 ms) 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7037 ms) 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-21T13:44:59.563 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7023 ms) 2024-09-21T13:44:59.564 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-09-21T13:44:59.564 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7019 ms) 2024-09-21T13:44:59.564 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-21T13:44:59.564 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7028 ms) 2024-09-21T13:44:59.564 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-21T13:44:59.564 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7031 ms) 2024-09-21T13:44:59.564 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-21T13:44:59.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:44:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:44:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:44:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:59 smithi002 ceph-mon[30076]: osdmap e310: 8 total, 8 up, 8 in 2024-09-21T13:44:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:44:59 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:59.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:59.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:59 smithi002 ceph-mon[40622]: osdmap e310: 8 total, 8 up, 8 in 2024-09-21T13:44:59.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:44:59 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:44:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi002-76395-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:44:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:59 smithi162 ceph-mon[33046]: osdmap e310: 8 total, 8 up, 8 in 2024-09-21T13:44:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:44:59 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[30076]: pgmap v416: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[30076]: osdmap e311: 8 total, 8 up, 8 in 2024-09-21T13:45:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:00.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi002-76395-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:00.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[40622]: pgmap v416: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:00.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[40622]: osdmap e311: 8 total, 8 up, 8 in 2024-09-21T13:45:00.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:00.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:00.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:00.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:00.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi002-76395-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:00 smithi162 ceph-mon[33046]: pgmap v416: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:00 smithi162 ceph-mon[33046]: osdmap e311: 8 total, 8 up, 8 in 2024-09-21T13:45:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-47","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi002-76395-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi002-76395-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[30076]: osdmap e312: 8 total, 8 up, 8 in 2024-09-21T13:45:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPP_smithi002-76395-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:01.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi002-76395-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[40622]: osdmap e312: 8 total, 8 up, 8 in 2024-09-21T13:45:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPP_smithi002-76395-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:01.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi002-76395-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:01 smithi162 ceph-mon[33046]: osdmap e312: 8 total, 8 up, 8 in 2024-09-21T13:45:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPP_smithi002-76395-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:02.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:02 smithi002 ceph-mon[40622]: pgmap v419: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:02.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:45:02.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:02.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:02 smithi002 ceph-mon[40622]: osdmap e313: 8 total, 8 up, 8 in 2024-09-21T13:45:02.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:02.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:02 smithi002 ceph-mon[30076]: pgmap v419: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:02.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:45:02.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:02.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:02 smithi002 ceph-mon[30076]: osdmap e313: 8 total, 8 up, 8 in 2024-09-21T13:45:02.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:02 smithi162 ceph-mon[33046]: pgmap v419: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:45:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:02 smithi162 ceph-mon[33046]: osdmap e313: 8 total, 8 up, 8 in 2024-09-21T13:45:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi002-76395-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi002-76395-61"}]': finished 2024-09-21T13:45:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-47"}]': finished 2024-09-21T13:45:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:03 smithi002 ceph-mon[30076]: osdmap e314: 8 total, 8 up, 8 in 2024-09-21T13:45:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-47", "mode": "writeback"} : dispatch 2024-09-21T13:45:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-47", "mode": "writeback"} : dispatch 2024-09-21T13:45:03.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi002-76395-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi002-76395-61"}]': finished 2024-09-21T13:45:03.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-47"}]': finished 2024-09-21T13:45:03.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:03 smithi002 ceph-mon[40622]: osdmap e314: 8 total, 8 up, 8 in 2024-09-21T13:45:03.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-47", "mode": "writeback"} : dispatch 2024-09-21T13:45:03.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-47", "mode": "writeback"} : dispatch 2024-09-21T13:45:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi002-76395-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi002-76395-61"}]': finished 2024-09-21T13:45:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-47"}]': finished 2024-09-21T13:45:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:03 smithi162 ceph-mon[33046]: osdmap e314: 8 total, 8 up, 8 in 2024-09-21T13:45:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-47", "mode": "writeback"} : dispatch 2024-09-21T13:45:03.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-47", "mode": "writeback"} : dispatch 2024-09-21T13:45:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[30076]: pgmap v422: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:45:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:45:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-47", "mode": "writeback"}]': finished 2024-09-21T13:45:04.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[30076]: osdmap e315: 8 total, 8 up, 8 in 2024-09-21T13:45:04.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:04.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:04.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[40622]: pgmap v422: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:45:04.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:04.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:45:04.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-47", "mode": "writeback"}]': finished 2024-09-21T13:45:04.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[40622]: osdmap e315: 8 total, 8 up, 8 in 2024-09-21T13:45:04.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:04.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:04 smithi162 ceph-mon[33046]: pgmap v422: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:45:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:04 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:04 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:45:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-47", "mode": "writeback"}]': finished 2024-09-21T13:45:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:04 smithi162 ceph-mon[33046]: osdmap e315: 8 total, 8 up, 8 in 2024-09-21T13:45:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:05.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:45:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[30076]: osdmap e316: 8 total, 8 up, 8 in 2024-09-21T13:45:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi002-76395-61"}]': finished 2024-09-21T13:45:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:45:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[30076]: osdmap e317: 8 total, 8 up, 8 in 2024-09-21T13:45:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:05.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:05.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:45:05.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[40622]: osdmap e316: 8 total, 8 up, 8 in 2024-09-21T13:45:05.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:05.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:05.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:05.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi002-76395-61"}]': finished 2024-09-21T13:45:05.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:45:05.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[40622]: osdmap e317: 8 total, 8 up, 8 in 2024-09-21T13:45:05.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:05.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:05.852 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:45:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:05 smithi162 ceph-mon[33046]: osdmap e316: 8 total, 8 up, 8 in 2024-09-21T13:45:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi002-76395-61"}]': finished 2024-09-21T13:45:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:45:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:05 smithi162 ceph-mon[33046]: osdmap e317: 8 total, 8 up, 8 in 2024-09-21T13:45:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi002-76395-61"} : dispatch 2024-09-21T13:45:05.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[30076]: pgmap v425: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:45:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:45:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi002-76395-61"}]': finished 2024-09-21T13:45:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:45:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[30076]: osdmap e318: 8 total, 8 up, 8 in 2024-09-21T13:45:06.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:06.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[40622]: pgmap v425: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:45:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:45:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi002-76395-61"}]': finished 2024-09-21T13:45:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:45:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[40622]: osdmap e318: 8 total, 8 up, 8 in 2024-09-21T13:45:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:06.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:06 smithi162 ceph-mon[33046]: pgmap v425: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:45:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:06 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:45:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/574087761' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi002-76395-61"}]': finished 2024-09-21T13:45:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:45:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:06 smithi162 ceph-mon[33046]: osdmap e318: 8 total, 8 up, 8 in 2024-09-21T13:45:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:45:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: osdmap e319: 8 total, 8 up, 8 in 2024-09-21T13:45:07.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T13:45:07.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi002-76395-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:07.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T13:45:07.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi002-76395-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:08.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:08.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:45:08.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:08.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: osdmap e319: 8 total, 8 up, 8 in 2024-09-21T13:45:08.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T13:45:08.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi002-76395-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T13:45:08.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi002-76395-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: osdmap e319: 8 total, 8 up, 8 in 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi002-76395-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T13:45:08.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi002-76395-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:08.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:45:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:45:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:08 smithi162 ceph-mon[33046]: pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T13:45:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T13:45:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:08 smithi162 ceph-mon[33046]: osdmap e320: 8 total, 8 up, 8 in 2024-09-21T13:45:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T13:45:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:08 smithi002 ceph-mon[30076]: pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T13:45:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T13:45:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:08 smithi002 ceph-mon[30076]: osdmap e320: 8 total, 8 up, 8 in 2024-09-21T13:45:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T13:45:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:08 smithi002 ceph-mon[40622]: pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T13:45:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T13:45:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:08 smithi002 ceph-mon[40622]: osdmap e320: 8 total, 8 up, 8 in 2024-09-21T13:45:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T13:45:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:09 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi002-76395-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi002-76395-62"}]': finished 2024-09-21T13:45:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T13:45:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:09 smithi162 ceph-mon[33046]: osdmap e321: 8 total, 8 up, 8 in 2024-09-21T13:45:10.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:45:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:45:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:45:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:09 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi002-76395-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi002-76395-62"}]': finished 2024-09-21T13:45:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T13:45:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:09 smithi002 ceph-mon[30076]: osdmap e321: 8 total, 8 up, 8 in 2024-09-21T13:45:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:09 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi002-76395-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi002-76395-62"}]': finished 2024-09-21T13:45:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T13:45:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:09 smithi002 ceph-mon[40622]: osdmap e321: 8 total, 8 up, 8 in 2024-09-21T13:45:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:10 smithi162 ceph-mon[33046]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:45:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:10 smithi162 ceph-mon[33046]: osdmap e322: 8 total, 8 up, 8 in 2024-09-21T13:45:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[40622]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:45:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[40622]: osdmap e322: 8 total, 8 up, 8 in 2024-09-21T13:45:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[30076]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:45:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[30076]: osdmap e322: 8 total, 8 up, 8 in 2024-09-21T13:45:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:12 smithi162 ceph-mon[33046]: pgmap v434: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"}]': finished 2024-09-21T13:45:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:12 smithi162 ceph-mon[33046]: osdmap e323: 8 total, 8 up, 8 in 2024-09-21T13:45:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:12 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[30076]: pgmap v434: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"}]': finished 2024-09-21T13:45:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[30076]: osdmap e323: 8 total, 8 up, 8 in 2024-09-21T13:45:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:13.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:13.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:13.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:13.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:13.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:13.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[40622]: pgmap v434: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"}]': finished 2024-09-21T13:45:13.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[40622]: osdmap e323: 8 total, 8 up, 8 in 2024-09-21T13:45:13.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:13.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:13.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:13.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:13.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:13.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:13.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-47"} : dispatch 2024-09-21T13:45:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"}]': finished 2024-09-21T13:45:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:13 smithi162 ceph-mon[33046]: osdmap e324: 8 total, 8 up, 8 in 2024-09-21T13:45:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"}]': finished 2024-09-21T13:45:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:13 smithi002 ceph-mon[30076]: osdmap e324: 8 total, 8 up, 8 in 2024-09-21T13:45:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi002-76395-62"}]': finished 2024-09-21T13:45:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:13 smithi002 ceph-mon[40622]: osdmap e324: 8 total, 8 up, 8 in 2024-09-21T13:45:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3951119380' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"} : dispatch 2024-09-21T13:45:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:14.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:14 smithi162 ceph-mon[33046]: pgmap v437: 196 pgs: 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:45:14.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"}]': finished 2024-09-21T13:45:14.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:14 smithi162 ceph-mon[33046]: osdmap e325: 8 total, 8 up, 8 in 2024-09-21T13:45:14.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:14.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi002-76395-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:14.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi002-76395-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[30076]: pgmap v437: 196 pgs: 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:45:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"}]': finished 2024-09-21T13:45:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[30076]: osdmap e325: 8 total, 8 up, 8 in 2024-09-21T13:45:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:15.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:15.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:15.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:15.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi002-76395-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:15.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi002-76395-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[40622]: pgmap v437: 196 pgs: 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:45:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi002-76395-62"}]': finished 2024-09-21T13:45:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[40622]: osdmap e325: 8 total, 8 up, 8 in 2024-09-21T13:45:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-49","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:15.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:15.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:15.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:15.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi002-76395-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:15.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi002-76395-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi002-76395-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:15 smithi162 ceph-mon[33046]: osdmap e326: 8 total, 8 up, 8 in 2024-09-21T13:45:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi002-76395-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi002-76395-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:15.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:16.001 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:16.002 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi002-76395-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:16.002 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[40622]: osdmap e326: 8 total, 8 up, 8 in 2024-09-21T13:45:16.002 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi002-76395-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:16.002 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi002-76395-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:16.002 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:16.002 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:16.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:16.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi002-76395-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:16.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[30076]: osdmap e326: 8 total, 8 up, 8 in 2024-09-21T13:45:16.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi002-76395-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:16.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "StatRemovePP_smithi002-76395-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:16.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:16.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:16 smithi162 ceph-mon[33046]: pgmap v440: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:45:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:45:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:16 smithi162 ceph-mon[33046]: osdmap e327: 8 total, 8 up, 8 in 2024-09-21T13:45:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:16 smithi002 ceph-mon[40622]: pgmap v440: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:45:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:45:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:16 smithi002 ceph-mon[40622]: osdmap e327: 8 total, 8 up, 8 in 2024-09-21T13:45:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:16 smithi002 ceph-mon[30076]: pgmap v440: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:45:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:45:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:16 smithi002 ceph-mon[30076]: osdmap e327: 8 total, 8 up, 8 in 2024-09-21T13:45:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi002-76395-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi002-76395-63"}]': finished 2024-09-21T13:45:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-49"}]': finished 2024-09-21T13:45:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:17 smithi162 ceph-mon[33046]: osdmap e328: 8 total, 8 up, 8 in 2024-09-21T13:45:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-49", "mode": "readproxy"} : dispatch 2024-09-21T13:45:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-49", "mode": "readproxy"} : dispatch 2024-09-21T13:45:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi002-76395-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi002-76395-63"}]': finished 2024-09-21T13:45:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-49"}]': finished 2024-09-21T13:45:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:17 smithi002 ceph-mon[30076]: osdmap e328: 8 total, 8 up, 8 in 2024-09-21T13:45:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-49", "mode": "readproxy"} : dispatch 2024-09-21T13:45:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-49", "mode": "readproxy"} : dispatch 2024-09-21T13:45:18.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi002-76395-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi002-76395-63"}]': finished 2024-09-21T13:45:18.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-49"}]': finished 2024-09-21T13:45:18.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:17 smithi002 ceph-mon[40622]: osdmap e328: 8 total, 8 up, 8 in 2024-09-21T13:45:18.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-49", "mode": "readproxy"} : dispatch 2024-09-21T13:45:18.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-49", "mode": "readproxy"} : dispatch 2024-09-21T13:45:18.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:45:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:45:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:18 smithi162 ceph-mon[33046]: pgmap v443: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:18 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:18 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:45:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-49", "mode": "readproxy"}]': finished 2024-09-21T13:45:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:18 smithi162 ceph-mon[33046]: osdmap e329: 8 total, 8 up, 8 in 2024-09-21T13:45:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:18 smithi002 ceph-mon[30076]: pgmap v443: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:18 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:18 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:45:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-49", "mode": "readproxy"}]': finished 2024-09-21T13:45:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:18 smithi002 ceph-mon[30076]: osdmap e329: 8 total, 8 up, 8 in 2024-09-21T13:45:19.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:18 smithi002 ceph-mon[40622]: pgmap v443: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:19.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:18 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:19.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:18 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:45:19.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-49", "mode": "readproxy"}]': finished 2024-09-21T13:45:19.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:18 smithi002 ceph-mon[40622]: osdmap e329: 8 total, 8 up, 8 in 2024-09-21T13:45:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:19 smithi162 ceph-mon[33046]: osdmap e330: 8 total, 8 up, 8 in 2024-09-21T13:45:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:19.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:20.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:45:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:45:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:45:20.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:19 smithi002 ceph-mon[30076]: osdmap e330: 8 total, 8 up, 8 in 2024-09-21T13:45:20.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:20.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:20.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:19 smithi002 ceph-mon[40622]: osdmap e330: 8 total, 8 up, 8 in 2024-09-21T13:45:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:20 smithi162 ceph-mon[33046]: pgmap v446: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:45:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"}]': finished 2024-09-21T13:45:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:20 smithi162 ceph-mon[33046]: osdmap e331: 8 total, 8 up, 8 in 2024-09-21T13:45:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[40622]: pgmap v446: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:45:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"}]': finished 2024-09-21T13:45:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[40622]: osdmap e331: 8 total, 8 up, 8 in 2024-09-21T13:45:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:21.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[30076]: pgmap v446: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:45:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi002-76395-63"}]': finished 2024-09-21T13:45:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[30076]: osdmap e331: 8 total, 8 up, 8 in 2024-09-21T13:45:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/4022389893' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"} : dispatch 2024-09-21T13:45:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"}]': finished 2024-09-21T13:45:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:21 smithi162 ceph-mon[33046]: osdmap e332: 8 total, 8 up, 8 in 2024-09-21T13:45:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi002-76395-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:21.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi002-76395-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:22.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"}]': finished 2024-09-21T13:45:22.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[40622]: osdmap e332: 8 total, 8 up, 8 in 2024-09-21T13:45:22.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi002-76395-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:22.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi002-76395-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:22.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi002-76395-63"}]': finished 2024-09-21T13:45:22.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[30076]: osdmap e332: 8 total, 8 up, 8 in 2024-09-21T13:45:22.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:22.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:22.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:22.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:22.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi002-76395-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:22.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi002-76395-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:22 smithi162 ceph-mon[33046]: pgmap v449: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:45:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi002-76395-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:22 smithi162 ceph-mon[33046]: osdmap e333: 8 total, 8 up, 8 in 2024-09-21T13:45:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi002-76395-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi002-76395-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:22 smithi002 ceph-mon[40622]: pgmap v449: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:45:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi002-76395-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:22 smithi002 ceph-mon[40622]: osdmap e333: 8 total, 8 up, 8 in 2024-09-21T13:45:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi002-76395-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi002-76395-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:23.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:22 smithi002 ceph-mon[30076]: pgmap v449: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:45:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi002-76395-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:22 smithi002 ceph-mon[30076]: osdmap e333: 8 total, 8 up, 8 in 2024-09-21T13:45:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi002-76395-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:23.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi002-76395-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:23 smithi162 ceph-mon[33046]: osdmap e334: 8 total, 8 up, 8 in 2024-09-21T13:45:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:23 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:23 smithi002 ceph-mon[40622]: osdmap e334: 8 total, 8 up, 8 in 2024-09-21T13:45:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:23 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:24.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:23 smithi002 ceph-mon[30076]: osdmap e334: 8 total, 8 up, 8 in 2024-09-21T13:45:24.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:23 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:24 smithi162 ceph-mon[33046]: pgmap v452: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi002-76395-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi002-76395-64"}]': finished 2024-09-21T13:45:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:24 smithi162 ceph-mon[33046]: osdmap e335: 8 total, 8 up, 8 in 2024-09-21T13:45:25.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:24 smithi002 ceph-mon[40622]: pgmap v452: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:25.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi002-76395-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi002-76395-64"}]': finished 2024-09-21T13:45:25.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:24 smithi002 ceph-mon[40622]: osdmap e335: 8 total, 8 up, 8 in 2024-09-21T13:45:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:24 smithi002 ceph-mon[30076]: pgmap v452: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi002-76395-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi002-76395-64"}]': finished 2024-09-21T13:45:25.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:24 smithi002 ceph-mon[30076]: osdmap e335: 8 total, 8 up, 8 in 2024-09-21T13:45:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:25 smithi162 ceph-mon[33046]: osdmap e336: 8 total, 8 up, 8 in 2024-09-21T13:45:26.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:25 smithi002 ceph-mon[30076]: osdmap e336: 8 total, 8 up, 8 in 2024-09-21T13:45:26.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:25 smithi002 ceph-mon[40622]: osdmap e336: 8 total, 8 up, 8 in 2024-09-21T13:45:26.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:26 smithi162 ceph-mon[33046]: pgmap v455: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:26 smithi162 ceph-mon[33046]: osdmap e337: 8 total, 8 up, 8 in 2024-09-21T13:45:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:26 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:26 smithi002 ceph-mon[30076]: pgmap v455: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:26 smithi002 ceph-mon[30076]: osdmap e337: 8 total, 8 up, 8 in 2024-09-21T13:45:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:26 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:26 smithi002 ceph-mon[40622]: pgmap v455: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:26 smithi002 ceph-mon[40622]: osdmap e337: 8 total, 8 up, 8 in 2024-09-21T13:45:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:26 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"}]': finished 2024-09-21T13:45:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:27 smithi162 ceph-mon[33046]: osdmap e338: 8 total, 8 up, 8 in 2024-09-21T13:45:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"}]': finished 2024-09-21T13:45:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:27 smithi162 ceph-mon[33046]: osdmap e339: 8 total, 8 up, 8 in 2024-09-21T13:45:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"}]': finished 2024-09-21T13:45:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[30076]: osdmap e338: 8 total, 8 up, 8 in 2024-09-21T13:45:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:28.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"}]': finished 2024-09-21T13:45:28.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[30076]: osdmap e339: 8 total, 8 up, 8 in 2024-09-21T13:45:28.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi002-76395-64"}]': finished 2024-09-21T13:45:28.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[40622]: osdmap e338: 8 total, 8 up, 8 in 2024-09-21T13:45:28.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/877755695' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:28.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"} : dispatch 2024-09-21T13:45:28.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi002-76395-64"}]': finished 2024-09-21T13:45:28.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:27 smithi002 ceph-mon[40622]: osdmap e339: 8 total, 8 up, 8 in 2024-09-21T13:45:28.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:45:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:45:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:28 smithi162 ceph-mon[33046]: pgmap v458: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi002-76395-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:28 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:28.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[30076]: pgmap v458: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi002-76395-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[40622]: pgmap v458: 228 pgs: 228 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi002-76395-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:29.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:29.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:29.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:29.103 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:30.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:45:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:45:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi002-76395-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:45:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[30076]: osdmap e340: 8 total, 8 up, 8 in 2024-09-21T13:45:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "OmapPP_smithi002-76395-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:45:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"}]': finished 2024-09-21T13:45:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi002-76395-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:45:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[40622]: osdmap e340: 8 total, 8 up, 8 in 2024-09-21T13:45:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:30.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "OmapPP_smithi002-76395-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:30.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:30.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:45:30.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"}]': finished 2024-09-21T13:45:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi002-76395-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:45:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:29 smithi162 ceph-mon[33046]: osdmap e340: 8 total, 8 up, 8 in 2024-09-21T13:45:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "OmapPP_smithi002-76395-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:29 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:45:30.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"}]': finished 2024-09-21T13:45:30.728 INFO:tasks.workunit.client.0.smithi002.stdout:63:head 2024-09-21T13:45:30.728 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:5d165639:::164:head 2024-09-21T13:45:30.728 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:f43765fc:::165:head 2024-09-21T13:45:30.728 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:b4c720e9:::166:head 2024-09-21T13:45:30.728 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:e694b040:::167:head 2024-09-21T13:45:30.728 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:afa38db2:::168:head 2024-09-21T13:45:30.728 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:77ba9f53:::169:head 2024-09-21T13:45:30.728 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:87495034:::170:head 2024-09-21T13:45:30.728 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:7c96bf0e:::171:head 2024-09-21T13:45:30.728 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:dbe346cc:::172:head 2024-09-21T13:45:30.728 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:e943ec24:::173:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:f97a9c0c:::174:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:6f26e74d:::175:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:4f95e106:::176:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:0e6f2f8f:::177:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:05db05f1:::178:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:38a78d66:::179:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:d095610b:::180:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:a1a9d709:::181:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:1e5d39db:::182:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:f7df4fb9:::183:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:03a7f161:::184:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:ba70721e:::185:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:28e5662d:::186:head 2024-09-21T13:45:30.729 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:973d52de:::187:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:4303eb1c:::188:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:b990b48e:::189:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:29b8165b:::190:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:3547f197:::191:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:7e260936:::192:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:1abec7b1:::193:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:10fdda93:::194:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:15817eea:::195:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:770bab57:::196:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:ed9e13e7:::197:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:71471a8f:::198:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: checking for 275:10fb1d02:::199:head 2024-09-21T13:45:30.730 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8038 ms) 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: first is 1726926285 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,1726926287,1726926288,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,1726926287,1726926288,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,1726926287,1726926288,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,1726926287,1726926288,1726926290,1726926291,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,1726926287,1726926288,1726926290,1726926291,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,1726926287,1726926288,1726926290,1726926291,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,1726926287,1726926288,1726926290,1726926291,1726926293,1726926294,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,1726926287,1726926288,1726926290,1726926291,1726926293,1726926294,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926285,1726926287,1726926288,1726926290,1726926291,1726926293,1726926294,0 2024-09-21T13:45:30.731 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926288,1726926290,1726926291,1726926293,1726926294,1726926296,1726926297,0 2024-09-21T13:45:30.732 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: first now 1726926288, trimmed 2024-09-21T13:45:30.732 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (21075 ms) 2024-09-21T13:45:30.732 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-21T13:45:30.732 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: foo0 2024-09-21T13:45:30.732 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-09-21T13:45:30.732 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14059 ms) 2024-09-21T13:45:30.732 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-21T13:45:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[30076]: pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[30076]: osdmap e341: 8 total, 8 up, 8 in 2024-09-21T13:45:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:31.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi002-76395-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi002-76395-65"}]': finished 2024-09-21T13:45:31.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[30076]: osdmap e342: 8 total, 8 up, 8 in 2024-09-21T13:45:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[40622]: pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[40622]: osdmap e341: 8 total, 8 up, 8 in 2024-09-21T13:45:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi002-76395-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi002-76395-65"}]': finished 2024-09-21T13:45:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:30 smithi002 ceph-mon[40622]: osdmap e342: 8 total, 8 up, 8 in 2024-09-21T13:45:31.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:31.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:30 smithi162 ceph-mon[33046]: pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:31.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:30 smithi162 ceph-mon[33046]: osdmap e341: 8 total, 8 up, 8 in 2024-09-21T13:45:31.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:31.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:30 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:31.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:31.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:30 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-49"} : dispatch 2024-09-21T13:45:31.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi002-76395-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi002-76395-65"}]': finished 2024-09-21T13:45:31.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:30 smithi162 ceph-mon[33046]: osdmap e342: 8 total, 8 up, 8 in 2024-09-21T13:45:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:32 smithi002 ceph-mon[30076]: pgmap v464: 204 pgs: 8 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:32 smithi002 ceph-mon[30076]: osdmap e343: 8 total, 8 up, 8 in 2024-09-21T13:45:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:32 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:33.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:32 smithi002 ceph-mon[40622]: pgmap v464: 204 pgs: 8 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:33.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:32 smithi002 ceph-mon[40622]: osdmap e343: 8 total, 8 up, 8 in 2024-09-21T13:45:33.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:33.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:33.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:32 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:33.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:32 smithi162 ceph-mon[33046]: pgmap v464: 204 pgs: 8 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:45:33.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:32 smithi162 ceph-mon[33046]: osdmap e343: 8 total, 8 up, 8 in 2024-09-21T13:45:33.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:33.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-51","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:33.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:32 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[30076]: osdmap e344: 8 total, 8 up, 8 in 2024-09-21T13:45:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi002-76395-65"}]': finished 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[30076]: osdmap e345: 8 total, 8 up, 8 in 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[40622]: osdmap e344: 8 total, 8 up, 8 in 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi002-76395-65"}]': finished 2024-09-21T13:45:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:45:34.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[40622]: osdmap e345: 8 total, 8 up, 8 in 2024-09-21T13:45:34.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:34.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:34.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:34.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:34.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:33 smithi162 ceph-mon[33046]: osdmap e344: 8 total, 8 up, 8 in 2024-09-21T13:45:34.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:34.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:34.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:45:34.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi002-76395-65"}]': finished 2024-09-21T13:45:34.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:45:34.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:33 smithi162 ceph-mon[33046]: osdmap e345: 8 total, 8 up, 8 in 2024-09-21T13:45:34.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"OmapPP_smithi002-76395-65"} : dispatch 2024-09-21T13:45:34.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:34.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[30076]: pgmap v467: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:45:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi002-76395-65"}]': finished 2024-09-21T13:45:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-51"}]': finished 2024-09-21T13:45:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[30076]: osdmap e346: 8 total, 8 up, 8 in 2024-09-21T13:45:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-51", "mode": "writeback"} : dispatch 2024-09-21T13:45:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-51", "mode": "writeback"} : dispatch 2024-09-21T13:45:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[40622]: pgmap v467: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:45:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi002-76395-65"}]': finished 2024-09-21T13:45:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-51"}]': finished 2024-09-21T13:45:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[40622]: osdmap e346: 8 total, 8 up, 8 in 2024-09-21T13:45:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-51", "mode": "writeback"} : dispatch 2024-09-21T13:45:35.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-51", "mode": "writeback"} : dispatch 2024-09-21T13:45:35.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:34 smithi162 ceph-mon[33046]: pgmap v467: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:45:35.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3664936046' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi002-76395-65"}]': finished 2024-09-21T13:45:35.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-51"}]': finished 2024-09-21T13:45:35.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:34 smithi162 ceph-mon[33046]: osdmap e346: 8 total, 8 up, 8 in 2024-09-21T13:45:35.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-51", "mode": "writeback"} : dispatch 2024-09-21T13:45:35.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-51", "mode": "writeback"} : dispatch 2024-09-21T13:45:36.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi002-76395-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi002-76395-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:45:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-51", "mode": "writeback"}]': finished 2024-09-21T13:45:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi002-76395-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: osdmap e347: 8 total, 8 up, 8 in 2024-09-21T13:45:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWritePP_smithi002-76395-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWritePP_smithi002-76395-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi002-76395-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:36.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi002-76395-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:36.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:45:36.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-51", "mode": "writeback"}]': finished 2024-09-21T13:45:36.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi002-76395-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:36.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: osdmap e347: 8 total, 8 up, 8 in 2024-09-21T13:45:36.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWritePP_smithi002-76395-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWritePP_smithi002-76395-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi002-76395-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:36.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi002-76395-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:45:36.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:45:36.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-51", "mode": "writeback"}]': finished 2024-09-21T13:45:36.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi002-76395-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:45:36.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: osdmap e347: 8 total, 8 up, 8 in 2024-09-21T13:45:36.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWritePP_smithi002-76395-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:36.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "MultiWritePP_smithi002-76395-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[30076]: pgmap v470: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:45:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:45:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:37.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[30076]: osdmap e348: 8 total, 8 up, 8 in 2024-09-21T13:45:37.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[40622]: pgmap v470: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:45:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:45:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[40622]: osdmap e348: 8 total, 8 up, 8 in 2024-09-21T13:45:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:37.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:36 smithi162 ceph-mon[33046]: pgmap v470: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:45:37.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:37.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:45:37.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:45:37.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:37.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:36 smithi162 ceph-mon[33046]: osdmap e348: 8 total, 8 up, 8 in 2024-09-21T13:45:37.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:45:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[30076]: pgmap v473: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi002-76395-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi002-76395-66"}]': finished 2024-09-21T13:45:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:45:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[30076]: osdmap e349: 8 total, 8 up, 8 in 2024-09-21T13:45:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:39.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[40622]: pgmap v473: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:39.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi002-76395-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi002-76395-66"}]': finished 2024-09-21T13:45:39.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:45:39.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[40622]: osdmap e349: 8 total, 8 up, 8 in 2024-09-21T13:45:39.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:39.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:39.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:38 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:39.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:45:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:45:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:38 smithi162 ceph-mon[33046]: pgmap v473: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi002-76395-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi002-76395-66"}]': finished 2024-09-21T13:45:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:45:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:38 smithi162 ceph-mon[33046]: osdmap e349: 8 total, 8 up, 8 in 2024-09-21T13:45:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:45:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:38 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:39 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:45:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:45:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:39 smithi002 ceph-mon[30076]: osdmap e350: 8 total, 8 up, 8 in 2024-09-21T13:45:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:40.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:45:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:45:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:45:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:39 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:45:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:45:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:39 smithi002 ceph-mon[40622]: osdmap e350: 8 total, 8 up, 8 in 2024-09-21T13:45:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:40.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:39 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:45:40.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:45:40.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:39 smithi162 ceph-mon[33046]: osdmap e350: 8 total, 8 up, 8 in 2024-09-21T13:45:40.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:40.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:45:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[30076]: pgmap v476: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:45:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:45:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[30076]: osdmap e351: 8 total, 8 up, 8 in 2024-09-21T13:45:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T13:45:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T13:45:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[40622]: pgmap v476: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:45:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:45:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[40622]: osdmap e351: 8 total, 8 up, 8 in 2024-09-21T13:45:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T13:45:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T13:45:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:40 smithi162 ceph-mon[33046]: pgmap v476: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:45:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:45:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:40 smithi162 ceph-mon[33046]: osdmap e351: 8 total, 8 up, 8 in 2024-09-21T13:45:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T13:45:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T13:45:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:41.777 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3031 ms) 2024-09-21T13:45:41.777 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-21T13:45:41.777 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7033 ms) 2024-09-21T13:45:41.777 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7027 ms) 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7042 ms) 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7047 ms) 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7027 ms) 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7037 ms) 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139379 ms total) 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-09-21T13:45:41.778 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (287895 ms total) 2024-09-21T13:45:41.779 INFO:tasks.workunit.client.0.smithi002.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-09-21T13:45:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "target_max_objects","val": "1"}]': finished 2024-09-21T13:45:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"}]': finished 2024-09-21T13:45:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:41 smithi002 ceph-mon[30076]: osdmap e352: 8 total, 8 up, 8 in 2024-09-21T13:45:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:42.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "target_max_objects","val": "1"}]': finished 2024-09-21T13:45:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"}]': finished 2024-09-21T13:45:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:41 smithi002 ceph-mon[40622]: osdmap e352: 8 total, 8 up, 8 in 2024-09-21T13:45:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:42.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-51","var": "target_max_objects","val": "1"}]': finished 2024-09-21T13:45:42.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi002-76395-66"}]': finished 2024-09-21T13:45:42.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:41 smithi162 ceph-mon[33046]: osdmap e352: 8 total, 8 up, 8 in 2024-09-21T13:45:42.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2978681882' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:42.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"} : dispatch 2024-09-21T13:45:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[30076]: pgmap v479: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:45:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T13:45:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"}]': finished 2024-09-21T13:45:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[30076]: osdmap e353: 8 total, 8 up, 8 in 2024-09-21T13:45:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:45:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:45:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:45:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[40622]: pgmap v479: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:45:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T13:45:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"}]': finished 2024-09-21T13:45:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[40622]: osdmap e353: 8 total, 8 up, 8 in 2024-09-21T13:45:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:45:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:45:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:45:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:42 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:42 smithi162 ceph-mon[33046]: pgmap v479: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:45:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:42 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T13:45:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi002-76395-66"}]': finished 2024-09-21T13:45:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:42 smithi162 ceph-mon[33046]: osdmap e353: 8 total, 8 up, 8 in 2024-09-21T13:45:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:45:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:45:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:45:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:42 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:44.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:44 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:44.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:44 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:44.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:44 smithi002 ceph-mon[30076]: pgmap v481: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:44.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:44 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:44.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:44 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:44.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:44 smithi002 ceph-mon[40622]: pgmap v481: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:44.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:44 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:44.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:44 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:44.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:44 smithi162 ceph-mon[33046]: pgmap v481: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:46.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:46 smithi002 ceph-mon[30076]: pgmap v482: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:46.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:46 smithi002 ceph-mon[40622]: pgmap v482: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:46 smithi162 ceph-mon[33046]: pgmap v482: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:48.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:48 smithi002 ceph-mon[30076]: pgmap v483: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 657 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T13:45:48.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:48 smithi002 ceph-mon[40622]: pgmap v483: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 657 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T13:45:48.864 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:48 smithi162 ceph-mon[33046]: pgmap v483: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 657 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T13:45:49.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:45:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:45:50.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:45:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:45:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:45:50.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:50.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:50 smithi002 ceph-mon[30076]: pgmap v484: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:50.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:50.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:50 smithi002 ceph-mon[40622]: pgmap v484: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:45:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:50 smithi162 ceph-mon[33046]: pgmap v484: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:51 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:51.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:51.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:51 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:51.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:51 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:52 smithi162 ceph-mon[33046]: pgmap v485: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:45:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:52 smithi162 ceph-mon[33046]: osdmap e354: 8 total, 8 up, 8 in 2024-09-21T13:45:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:52 smithi002 ceph-mon[30076]: pgmap v485: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:45:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:52 smithi002 ceph-mon[30076]: osdmap e354: 8 total, 8 up, 8 in 2024-09-21T13:45:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:52 smithi002 ceph-mon[40622]: pgmap v485: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:45:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:52 smithi002 ceph-mon[40622]: osdmap e354: 8 total, 8 up, 8 in 2024-09-21T13:45:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"}]': finished 2024-09-21T13:45:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:53 smithi162 ceph-mon[33046]: osdmap e355: 8 total, 8 up, 8 in 2024-09-21T13:45:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"}]': finished 2024-09-21T13:45:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[30076]: osdmap e355: 8 total, 8 up, 8 in 2024-09-21T13:45:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"}]': finished 2024-09-21T13:45:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[40622]: osdmap e355: 8 total, 8 up, 8 in 2024-09-21T13:45:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-51"} : dispatch 2024-09-21T13:45:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:54 smithi162 ceph-mon[33046]: pgmap v488: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:54 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T13:45:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:54 smithi162 ceph-mon[33046]: osdmap e356: 8 total, 8 up, 8 in 2024-09-21T13:45:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:54 smithi002 ceph-mon[30076]: pgmap v488: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:54 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T13:45:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:54 smithi002 ceph-mon[30076]: osdmap e356: 8 total, 8 up, 8 in 2024-09-21T13:45:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:54 smithi002 ceph-mon[40622]: pgmap v488: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:45:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:54 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T13:45:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:54 smithi002 ceph-mon[40622]: osdmap e356: 8 total, 8 up, 8 in 2024-09-21T13:45:55.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:55 smithi162 ceph-mon[33046]: osdmap e357: 8 total, 8 up, 8 in 2024-09-21T13:45:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:55.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:55 smithi002 ceph-mon[30076]: osdmap e357: 8 total, 8 up, 8 in 2024-09-21T13:45:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:55 smithi002 ceph-mon[40622]: osdmap e357: 8 total, 8 up, 8 in 2024-09-21T13:45:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-53","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:56 smithi162 ceph-mon[33046]: pgmap v491: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T13:45:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:56 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:56 smithi162 ceph-mon[33046]: osdmap e358: 8 total, 8 up, 8 in 2024-09-21T13:45:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-53"} : dispatch 2024-09-21T13:45:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-53"} : dispatch 2024-09-21T13:45:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[30076]: pgmap v491: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T13:45:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[30076]: osdmap e358: 8 total, 8 up, 8 in 2024-09-21T13:45:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-53"} : dispatch 2024-09-21T13:45:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-53"} : dispatch 2024-09-21T13:45:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[40622]: pgmap v491: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T13:45:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:45:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[40622]: osdmap e358: 8 total, 8 up, 8 in 2024-09-21T13:45:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-53"} : dispatch 2024-09-21T13:45:57.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-53"} : dispatch 2024-09-21T13:45:57.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:57 smithi162 ceph-mon[33046]: osdmap e359: 8 total, 8 up, 8 in 2024-09-21T13:45:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:57 smithi002 ceph-mon[30076]: osdmap e359: 8 total, 8 up, 8 in 2024-09-21T13:45:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:57 smithi002 ceph-mon[40622]: osdmap e359: 8 total, 8 up, 8 in 2024-09-21T13:45:58.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:45:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:45:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:58 smithi162 ceph-mon[33046]: pgmap v494: 196 pgs: 196 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:58 smithi162 ceph-mon[33046]: osdmap e360: 8 total, 8 up, 8 in 2024-09-21T13:45:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[30076]: pgmap v494: 196 pgs: 196 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[30076]: osdmap e360: 8 total, 8 up, 8 in 2024-09-21T13:45:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[40622]: pgmap v494: 196 pgs: 196 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:45:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[40622]: osdmap e360: 8 total, 8 up, 8 in 2024-09-21T13:45:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-55","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:45:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:45:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:45:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:45:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:59 smithi162 ceph-mon[33046]: osdmap e361: 8 total, 8 up, 8 in 2024-09-21T13:45:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:45:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:45:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-55"} : dispatch 2024-09-21T13:45:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:45:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-55"} : dispatch 2024-09-21T13:46:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:45:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:46:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[40622]: osdmap e361: 8 total, 8 up, 8 in 2024-09-21T13:46:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-55"} : dispatch 2024-09-21T13:46:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-55"} : dispatch 2024-09-21T13:46:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[30076]: osdmap e361: 8 total, 8 up, 8 in 2024-09-21T13:46:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-55"} : dispatch 2024-09-21T13:46:00.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:45:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-55"} : dispatch 2024-09-21T13:46:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:00 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:00 smithi162 ceph-mon[33046]: pgmap v497: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:46:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:00 smithi162 ceph-mon[33046]: osdmap e362: 8 total, 8 up, 8 in 2024-09-21T13:46:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:00 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:00 smithi002 ceph-mon[30076]: pgmap v497: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:46:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:00 smithi002 ceph-mon[30076]: osdmap e362: 8 total, 8 up, 8 in 2024-09-21T13:46:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:00 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:00 smithi002 ceph-mon[40622]: pgmap v497: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:46:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:00 smithi002 ceph-mon[40622]: osdmap e362: 8 total, 8 up, 8 in 2024-09-21T13:46:01.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:01 smithi162 ceph-mon[33046]: osdmap e363: 8 total, 8 up, 8 in 2024-09-21T13:46:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:01.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:01 smithi162 ceph-mon[33046]: osdmap e364: 8 total, 8 up, 8 in 2024-09-21T13:46:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:01 smithi002 ceph-mon[40622]: osdmap e363: 8 total, 8 up, 8 in 2024-09-21T13:46:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:01 smithi002 ceph-mon[40622]: osdmap e364: 8 total, 8 up, 8 in 2024-09-21T13:46:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:01 smithi002 ceph-mon[30076]: osdmap e363: 8 total, 8 up, 8 in 2024-09-21T13:46:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-57","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:02.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:01 smithi002 ceph-mon[30076]: osdmap e364: 8 total, 8 up, 8 in 2024-09-21T13:46:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:02 smithi162 ceph-mon[33046]: pgmap v500: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:46:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:02 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-57"} : dispatch 2024-09-21T13:46:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-57"} : dispatch 2024-09-21T13:46:02.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:02 smithi162 ceph-mon[33046]: osdmap e365: 8 total, 8 up, 8 in 2024-09-21T13:46:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[40622]: pgmap v500: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:46:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-57"} : dispatch 2024-09-21T13:46:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-57"} : dispatch 2024-09-21T13:46:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[40622]: osdmap e365: 8 total, 8 up, 8 in 2024-09-21T13:46:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[30076]: pgmap v500: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:46:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-57"} : dispatch 2024-09-21T13:46:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-57"} : dispatch 2024-09-21T13:46:03.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:02 smithi002 ceph-mon[30076]: osdmap e365: 8 total, 8 up, 8 in 2024-09-21T13:46:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:04 smithi162 ceph-mon[33046]: pgmap v503: 196 pgs: 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:46:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:04 smithi162 ceph-mon[33046]: osdmap e366: 8 total, 8 up, 8 in 2024-09-21T13:46:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:04 smithi002 ceph-mon[30076]: pgmap v503: 196 pgs: 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:46:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:04 smithi002 ceph-mon[30076]: osdmap e366: 8 total, 8 up, 8 in 2024-09-21T13:46:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:05.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:04 smithi002 ceph-mon[40622]: pgmap v503: 196 pgs: 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:46:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:04 smithi002 ceph-mon[40622]: osdmap e366: 8 total, 8 up, 8 in 2024-09-21T13:46:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:05.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-59","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:05 smithi162 ceph-mon[33046]: osdmap e367: 8 total, 8 up, 8 in 2024-09-21T13:46:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-59"} : dispatch 2024-09-21T13:46:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-59"} : dispatch 2024-09-21T13:46:05.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:05 smithi162 ceph-mon[33046]: osdmap e368: 8 total, 8 up, 8 in 2024-09-21T13:46:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[30076]: osdmap e367: 8 total, 8 up, 8 in 2024-09-21T13:46:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:06.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-59"} : dispatch 2024-09-21T13:46:06.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-59"} : dispatch 2024-09-21T13:46:06.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[30076]: osdmap e368: 8 total, 8 up, 8 in 2024-09-21T13:46:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[40622]: osdmap e367: 8 total, 8 up, 8 in 2024-09-21T13:46:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-59"} : dispatch 2024-09-21T13:46:06.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-59"} : dispatch 2024-09-21T13:46:06.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:05 smithi002 ceph-mon[40622]: osdmap e368: 8 total, 8 up, 8 in 2024-09-21T13:46:06.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:06 smithi162 ceph-mon[33046]: pgmap v506: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:46:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:06 smithi162 ceph-mon[33046]: osdmap e369: 8 total, 8 up, 8 in 2024-09-21T13:46:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:06 smithi002 ceph-mon[30076]: pgmap v506: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:46:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:06 smithi002 ceph-mon[30076]: osdmap e369: 8 total, 8 up, 8 in 2024-09-21T13:46:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:06 smithi002 ceph-mon[40622]: pgmap v506: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:46:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:06 smithi002 ceph-mon[40622]: osdmap e369: 8 total, 8 up, 8 in 2024-09-21T13:46:07.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:07.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-61","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:08.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:46:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:46:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:08 smithi162 ceph-mon[33046]: pgmap v509: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:08 smithi162 ceph-mon[33046]: osdmap e370: 8 total, 8 up, 8 in 2024-09-21T13:46:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:08.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:08 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[30076]: pgmap v509: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[30076]: osdmap e370: 8 total, 8 up, 8 in 2024-09-21T13:46:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[40622]: pgmap v509: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[40622]: osdmap e370: 8 total, 8 up, 8 in 2024-09-21T13:46:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:08 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:46:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:09 smithi162 ceph-mon[33046]: osdmap e371: 8 total, 8 up, 8 in 2024-09-21T13:46:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-61"} : dispatch 2024-09-21T13:46:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-61"} : dispatch 2024-09-21T13:46:10.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:46:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:46:10.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:46:10.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[40622]: osdmap e371: 8 total, 8 up, 8 in 2024-09-21T13:46:10.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:10.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-61"} : dispatch 2024-09-21T13:46:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-61"} : dispatch 2024-09-21T13:46:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:46:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[30076]: osdmap e371: 8 total, 8 up, 8 in 2024-09-21T13:46:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-61"} : dispatch 2024-09-21T13:46:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-61"} : dispatch 2024-09-21T13:46:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:10 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:10 smithi162 ceph-mon[33046]: pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:46:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:10 smithi162 ceph-mon[33046]: osdmap e372: 8 total, 8 up, 8 in 2024-09-21T13:46:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:10 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:10 smithi002 ceph-mon[30076]: pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:46:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:10 smithi002 ceph-mon[30076]: osdmap e372: 8 total, 8 up, 8 in 2024-09-21T13:46:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:10 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:10 smithi002 ceph-mon[40622]: pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:46:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:10 smithi002 ceph-mon[40622]: osdmap e372: 8 total, 8 up, 8 in 2024-09-21T13:46:11.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:11 smithi162 ceph-mon[33046]: osdmap e373: 8 total, 8 up, 8 in 2024-09-21T13:46:11.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:11.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:11 smithi002 ceph-mon[30076]: osdmap e373: 8 total, 8 up, 8 in 2024-09-21T13:46:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:12.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:11 smithi002 ceph-mon[40622]: osdmap e373: 8 total, 8 up, 8 in 2024-09-21T13:46:12.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:12.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-63","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[30076]: pgmap v515: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:46:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[30076]: osdmap e374: 8 total, 8 up, 8 in 2024-09-21T13:46:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:13.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[40622]: pgmap v515: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:46:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[40622]: osdmap e374: 8 total, 8 up, 8 in 2024-09-21T13:46:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:12 smithi162 ceph-mon[33046]: pgmap v515: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:46:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:12 smithi162 ceph-mon[33046]: osdmap e374: 8 total, 8 up, 8 in 2024-09-21T13:46:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:46:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:13 smithi002 ceph-mon[40622]: osdmap e375: 8 total, 8 up, 8 in 2024-09-21T13:46:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:46:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:13 smithi002 ceph-mon[30076]: osdmap e375: 8 total, 8 up, 8 in 2024-09-21T13:46:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:14.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:46:14.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:13 smithi162 ceph-mon[33046]: osdmap e375: 8 total, 8 up, 8 in 2024-09-21T13:46:14.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:14 smithi002 ceph-mon[40622]: pgmap v518: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-09-21T13:46:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:14 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:14 smithi002 ceph-mon[40622]: osdmap e376: 8 total, 8 up, 8 in 2024-09-21T13:46:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:14 smithi002 ceph-mon[30076]: pgmap v518: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-09-21T13:46:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:14 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:15.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:14 smithi002 ceph-mon[30076]: osdmap e376: 8 total, 8 up, 8 in 2024-09-21T13:46:15.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:14 smithi162 ceph-mon[33046]: pgmap v518: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-09-21T13:46:15.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:14 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:15.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:14 smithi162 ceph-mon[33046]: osdmap e376: 8 total, 8 up, 8 in 2024-09-21T13:46:16.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:15 smithi002 ceph-mon[30076]: osdmap e377: 8 total, 8 up, 8 in 2024-09-21T13:46:16.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:15 smithi002 ceph-mon[40622]: osdmap e377: 8 total, 8 up, 8 in 2024-09-21T13:46:16.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:15 smithi162 ceph-mon[33046]: osdmap e377: 8 total, 8 up, 8 in 2024-09-21T13:46:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:16 smithi002 ceph-mon[40622]: pgmap v521: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-09-21T13:46:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:16 smithi002 ceph-mon[40622]: osdmap e378: 8 total, 8 up, 8 in 2024-09-21T13:46:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:16 smithi002 ceph-mon[30076]: pgmap v521: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-09-21T13:46:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:16 smithi002 ceph-mon[30076]: osdmap e378: 8 total, 8 up, 8 in 2024-09-21T13:46:17.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:16 smithi162 ceph-mon[33046]: pgmap v521: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-09-21T13:46:17.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:16 smithi162 ceph-mon[33046]: osdmap e378: 8 total, 8 up, 8 in 2024-09-21T13:46:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:17 smithi002 ceph-mon[30076]: osdmap e379: 8 total, 8 up, 8 in 2024-09-21T13:46:18.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:17 smithi002 ceph-mon[40622]: osdmap e379: 8 total, 8 up, 8 in 2024-09-21T13:46:18.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:17 smithi162 ceph-mon[33046]: osdmap e379: 8 total, 8 up, 8 in 2024-09-21T13:46:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:18 smithi002 ceph-mon[30076]: pgmap v524: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:19.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:18 smithi002 ceph-mon[40622]: pgmap v524: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:19.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:18 smithi162 ceph-mon[33046]: pgmap v524: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:19.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:46:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:46:20.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:46:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:46:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:46:21.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:21.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:20 smithi002 ceph-mon[30076]: pgmap v525: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-21T13:46:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:20 smithi002 ceph-mon[40622]: pgmap v525: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-21T13:46:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:20 smithi162 ceph-mon[33046]: pgmap v525: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-21T13:46:23.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:22 smithi002 ceph-mon[30076]: pgmap v526: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 902 B/s wr, 3 op/s 2024-09-21T13:46:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:22 smithi002 ceph-mon[40622]: pgmap v526: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 902 B/s wr, 3 op/s 2024-09-21T13:46:23.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:22 smithi162 ceph-mon[33046]: pgmap v526: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 902 B/s wr, 3 op/s 2024-09-21T13:46:24.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:24 smithi162 ceph-mon[33046]: osdmap e380: 8 total, 8 up, 8 in 2024-09-21T13:46:24.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:24 smithi162 ceph-mon[33046]: pgmap v528: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 787 B/s wr, 3 op/s 2024-09-21T13:46:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:24 smithi002 ceph-mon[30076]: osdmap e380: 8 total, 8 up, 8 in 2024-09-21T13:46:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:24 smithi002 ceph-mon[30076]: pgmap v528: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 787 B/s wr, 3 op/s 2024-09-21T13:46:24.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:24 smithi002 ceph-mon[40622]: osdmap e380: 8 total, 8 up, 8 in 2024-09-21T13:46:24.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:24 smithi002 ceph-mon[40622]: pgmap v528: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 787 B/s wr, 3 op/s 2024-09-21T13:46:26.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:26 smithi162 ceph-mon[33046]: pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 698 B/s wr, 3 op/s 2024-09-21T13:46:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:26 smithi002 ceph-mon[30076]: pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 698 B/s wr, 3 op/s 2024-09-21T13:46:27.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:26 smithi002 ceph-mon[40622]: pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 698 B/s wr, 3 op/s 2024-09-21T13:46:28.909 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:28 smithi162 ceph-mon[33046]: pgmap v530: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 614 B/s wr, 2 op/s 2024-09-21T13:46:28.909 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:28 smithi162 ceph-mon[33046]: osdmap e381: 8 total, 8 up, 8 in 2024-09-21T13:46:28.909 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:28 smithi002 ceph-mon[30076]: pgmap v530: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 614 B/s wr, 2 op/s 2024-09-21T13:46:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:28 smithi002 ceph-mon[30076]: osdmap e381: 8 total, 8 up, 8 in 2024-09-21T13:46:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:28 smithi002 ceph-mon[40622]: pgmap v530: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 614 B/s wr, 2 op/s 2024-09-21T13:46:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:28 smithi002 ceph-mon[40622]: osdmap e381: 8 total, 8 up, 8 in 2024-09-21T13:46:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:29.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:46:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:46:30.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:46:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:46:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:46:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:30 smithi162 ceph-mon[33046]: pgmap v532: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:30 smithi002 ceph-mon[30076]: pgmap v532: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:30 smithi002 ceph-mon[40622]: pgmap v532: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:32.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:32 smithi162 ceph-mon[33046]: pgmap v533: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:32 smithi002 ceph-mon[30076]: pgmap v533: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:32 smithi002 ceph-mon[40622]: pgmap v533: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:34 smithi162 ceph-mon[33046]: osdmap e382: 8 total, 8 up, 8 in 2024-09-21T13:46:34.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:34 smithi162 ceph-mon[33046]: pgmap v535: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:34 smithi002 ceph-mon[30076]: osdmap e382: 8 total, 8 up, 8 in 2024-09-21T13:46:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:34 smithi002 ceph-mon[30076]: pgmap v535: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:34.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:34 smithi002 ceph-mon[40622]: osdmap e382: 8 total, 8 up, 8 in 2024-09-21T13:46:34.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:34 smithi002 ceph-mon[40622]: pgmap v535: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:36.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:36 smithi162 ceph-mon[33046]: pgmap v536: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:36 smithi002 ceph-mon[30076]: pgmap v536: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:36 smithi002 ceph-mon[40622]: pgmap v536: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:38.910 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:38 smithi162 ceph-mon[33046]: pgmap v537: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:38 smithi002 ceph-mon[30076]: pgmap v537: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:38 smithi002 ceph-mon[40622]: pgmap v537: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:46:39.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:46:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:46:39.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:39 smithi162 ceph-mon[33046]: osdmap e383: 8 total, 8 up, 8 in 2024-09-21T13:46:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:39 smithi002 ceph-mon[30076]: osdmap e383: 8 total, 8 up, 8 in 2024-09-21T13:46:40.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:39 smithi002 ceph-mon[40622]: osdmap e383: 8 total, 8 up, 8 in 2024-09-21T13:46:40.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:46:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:46:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:46:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:40 smithi162 ceph-mon[33046]: pgmap v539: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T13:46:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:40 smithi002 ceph-mon[30076]: pgmap v539: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T13:46:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:40 smithi002 ceph-mon[40622]: pgmap v539: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T13:46:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:42 smithi162 ceph-mon[33046]: pgmap v540: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T13:46:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:42 smithi002 ceph-mon[30076]: pgmap v540: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T13:46:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:42 smithi002 ceph-mon[40622]: pgmap v540: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T13:46:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:46:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:46:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:46:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:46:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:46:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:46:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:46:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:46:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:46:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:46:44.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:46:44.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:46:44.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:44 smithi162 ceph-mon[33046]: pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:46:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:44 smithi002 ceph-mon[30076]: pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:46:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:44 smithi002 ceph-mon[40622]: pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:46:46.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:46 smithi002 ceph-mon[30076]: pgmap v542: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:46:46.903 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:46 smithi002 ceph-mon[40622]: pgmap v542: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:46:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:46 smithi162 ceph-mon[33046]: pgmap v542: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:46:48.921 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:48 smithi162 ceph-mon[33046]: pgmap v543: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:46:48.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:48 smithi162 ceph-mon[33046]: osdmap e384: 8 total, 8 up, 8 in 2024-09-21T13:46:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:48 smithi002 ceph-mon[40622]: pgmap v543: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:46:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:48 smithi002 ceph-mon[40622]: osdmap e384: 8 total, 8 up, 8 in 2024-09-21T13:46:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:48 smithi002 ceph-mon[30076]: pgmap v543: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:46:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:48 smithi002 ceph-mon[30076]: osdmap e384: 8 total, 8 up, 8 in 2024-09-21T13:46:49.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:46:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:46:49.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-63"} : dispatch 2024-09-21T13:46:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-63"} : dispatch 2024-09-21T13:46:50.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:46:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:46:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:46:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-63"} : dispatch 2024-09-21T13:46:50.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-63"} : dispatch 2024-09-21T13:46:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:46:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-63"} : dispatch 2024-09-21T13:46:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-63"} : dispatch 2024-09-21T13:46:50.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:50 smithi162 ceph-mon[33046]: pgmap v545: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:46:50.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:50 smithi162 ceph-mon[33046]: osdmap e385: 8 total, 8 up, 8 in 2024-09-21T13:46:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:50 smithi002 ceph-mon[40622]: pgmap v545: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:46:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:50 smithi002 ceph-mon[40622]: osdmap e385: 8 total, 8 up, 8 in 2024-09-21T13:46:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:46:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:50 smithi002 ceph-mon[30076]: pgmap v545: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:46:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:50 smithi002 ceph-mon[30076]: osdmap e385: 8 total, 8 up, 8 in 2024-09-21T13:46:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:51 smithi162 ceph-mon[33046]: osdmap e386: 8 total, 8 up, 8 in 2024-09-21T13:46:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:51.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:51 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:51 smithi002 ceph-mon[30076]: osdmap e386: 8 total, 8 up, 8 in 2024-09-21T13:46:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:51 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:52.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:51 smithi002 ceph-mon[40622]: osdmap e386: 8 total, 8 up, 8 in 2024-09-21T13:46:52.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:51 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-65","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:46:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:52 smithi162 ceph-mon[33046]: pgmap v548: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:52 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:52 smithi162 ceph-mon[33046]: osdmap e387: 8 total, 8 up, 8 in 2024-09-21T13:46:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:52.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[30076]: pgmap v548: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[30076]: osdmap e387: 8 total, 8 up, 8 in 2024-09-21T13:46:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[40622]: pgmap v548: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:46:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[40622]: osdmap e387: 8 total, 8 up, 8 in 2024-09-21T13:46:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:46:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:46:53.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:46:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:53 smithi162 ceph-mon[33046]: osdmap e388: 8 total, 8 up, 8 in 2024-09-21T13:46:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:46:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:53 smithi002 ceph-mon[30076]: osdmap e388: 8 total, 8 up, 8 in 2024-09-21T13:46:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:46:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:53 smithi002 ceph-mon[40622]: osdmap e388: 8 total, 8 up, 8 in 2024-09-21T13:46:54.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:54 smithi162 ceph-mon[33046]: pgmap v551: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:54 smithi162 ceph-mon[33046]: osdmap e389: 8 total, 8 up, 8 in 2024-09-21T13:46:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:54 smithi002 ceph-mon[30076]: pgmap v551: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:54 smithi002 ceph-mon[30076]: osdmap e389: 8 total, 8 up, 8 in 2024-09-21T13:46:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:54 smithi002 ceph-mon[40622]: pgmap v551: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:46:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:54 smithi002 ceph-mon[40622]: osdmap e389: 8 total, 8 up, 8 in 2024-09-21T13:46:55.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:55 smithi162 ceph-mon[33046]: osdmap e390: 8 total, 8 up, 8 in 2024-09-21T13:46:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:55 smithi002 ceph-mon[30076]: osdmap e390: 8 total, 8 up, 8 in 2024-09-21T13:46:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:55 smithi002 ceph-mon[40622]: osdmap e390: 8 total, 8 up, 8 in 2024-09-21T13:46:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:56 smithi162 ceph-mon[33046]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:46:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:56 smithi162 ceph-mon[33046]: osdmap e391: 8 total, 8 up, 8 in 2024-09-21T13:46:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:56 smithi002 ceph-mon[40622]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:46:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:56 smithi002 ceph-mon[40622]: osdmap e391: 8 total, 8 up, 8 in 2024-09-21T13:46:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:56 smithi002 ceph-mon[30076]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:46:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:56 smithi002 ceph-mon[30076]: osdmap e391: 8 total, 8 up, 8 in 2024-09-21T13:46:58.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:46:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:46:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:58 smithi162 ceph-mon[33046]: pgmap v556: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T13:46:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:58.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:46:58 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:58 smithi002 ceph-mon[30076]: pgmap v556: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T13:46:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:46:58 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:46:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:58 smithi002 ceph-mon[40622]: pgmap v556: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T13:46:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:46:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:46:58 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:47:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:46:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:46:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:47:00.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:00 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:00 smithi162 ceph-mon[33046]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T13:47:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:00 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:00 smithi002 ceph-mon[30076]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T13:47:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:00 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:00 smithi002 ceph-mon[40622]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T13:47:02.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:02 smithi162 ceph-mon[33046]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 518 B/s wr, 3 op/s 2024-09-21T13:47:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:02 smithi002 ceph-mon[30076]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 518 B/s wr, 3 op/s 2024-09-21T13:47:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:02 smithi002 ceph-mon[40622]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 518 B/s wr, 3 op/s 2024-09-21T13:47:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:04 smithi162 ceph-mon[33046]: osdmap e392: 8 total, 8 up, 8 in 2024-09-21T13:47:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:04 smithi162 ceph-mon[33046]: pgmap v560: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-21T13:47:04.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:04 smithi002 ceph-mon[40622]: osdmap e392: 8 total, 8 up, 8 in 2024-09-21T13:47:04.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:04 smithi002 ceph-mon[40622]: pgmap v560: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-21T13:47:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:04 smithi002 ceph-mon[30076]: osdmap e392: 8 total, 8 up, 8 in 2024-09-21T13:47:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:04 smithi002 ceph-mon[30076]: pgmap v560: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-21T13:47:06.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:06 smithi162 ceph-mon[33046]: pgmap v561: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 414 B/s wr, 3 op/s 2024-09-21T13:47:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-65"} : dispatch 2024-09-21T13:47:06.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-65"} : dispatch 2024-09-21T13:47:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:06 smithi002 ceph-mon[30076]: pgmap v561: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 414 B/s wr, 3 op/s 2024-09-21T13:47:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-65"} : dispatch 2024-09-21T13:47:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-65"} : dispatch 2024-09-21T13:47:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:06 smithi002 ceph-mon[40622]: pgmap v561: 228 pgs: 228 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 414 B/s wr, 3 op/s 2024-09-21T13:47:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:07.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:07.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-65"} : dispatch 2024-09-21T13:47:07.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-65"} : dispatch 2024-09-21T13:47:07.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:07 smithi162 ceph-mon[33046]: osdmap e393: 8 total, 8 up, 8 in 2024-09-21T13:47:08.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:07 smithi002 ceph-mon[30076]: osdmap e393: 8 total, 8 up, 8 in 2024-09-21T13:47:08.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:07 smithi002 ceph-mon[40622]: osdmap e393: 8 total, 8 up, 8 in 2024-09-21T13:47:08.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:08 smithi162 ceph-mon[33046]: pgmap v563: 196 pgs: 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:08.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:08 smithi162 ceph-mon[33046]: osdmap e394: 8 total, 8 up, 8 in 2024-09-21T13:47:08.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:08.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:08 smithi002 ceph-mon[30076]: pgmap v563: 196 pgs: 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:08 smithi002 ceph-mon[30076]: osdmap e394: 8 total, 8 up, 8 in 2024-09-21T13:47:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:09.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:08 smithi002 ceph-mon[40622]: pgmap v563: 196 pgs: 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:09.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:08 smithi002 ceph-mon[40622]: osdmap e394: 8 total, 8 up, 8 in 2024-09-21T13:47:09.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:09.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-67","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:09.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:47:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:47:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:09 smithi162 ceph-mon[33046]: osdmap e395: 8 total, 8 up, 8 in 2024-09-21T13:47:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:10.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:47:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:47:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:47:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:09 smithi002 ceph-mon[30076]: osdmap e395: 8 total, 8 up, 8 in 2024-09-21T13:47:10.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:09 smithi002 ceph-mon[40622]: osdmap e395: 8 total, 8 up, 8 in 2024-09-21T13:47:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:10.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:10 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:10 smithi162 ceph-mon[33046]: pgmap v566: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:10 smithi162 ceph-mon[33046]: osdmap e396: 8 total, 8 up, 8 in 2024-09-21T13:47:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-67"} : dispatch 2024-09-21T13:47:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-67"} : dispatch 2024-09-21T13:47:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[30076]: pgmap v566: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[30076]: osdmap e396: 8 total, 8 up, 8 in 2024-09-21T13:47:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-67"} : dispatch 2024-09-21T13:47:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-67"} : dispatch 2024-09-21T13:47:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[40622]: pgmap v566: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[40622]: osdmap e396: 8 total, 8 up, 8 in 2024-09-21T13:47:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-67"} : dispatch 2024-09-21T13:47:11.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-67"} : dispatch 2024-09-21T13:47:11.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:11 smithi162 ceph-mon[33046]: osdmap e397: 8 total, 8 up, 8 in 2024-09-21T13:47:12.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:11 smithi002 ceph-mon[30076]: osdmap e397: 8 total, 8 up, 8 in 2024-09-21T13:47:12.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:11 smithi002 ceph-mon[40622]: osdmap e397: 8 total, 8 up, 8 in 2024-09-21T13:47:12.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:12 smithi162 ceph-mon[33046]: pgmap v569: 196 pgs: 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:47:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:12 smithi162 ceph-mon[33046]: osdmap e398: 8 total, 8 up, 8 in 2024-09-21T13:47:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:12.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:12 smithi002 ceph-mon[30076]: pgmap v569: 196 pgs: 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:47:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:12 smithi002 ceph-mon[30076]: osdmap e398: 8 total, 8 up, 8 in 2024-09-21T13:47:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:13.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:12 smithi002 ceph-mon[40622]: pgmap v569: 196 pgs: 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:47:13.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:12 smithi002 ceph-mon[40622]: osdmap e398: 8 total, 8 up, 8 in 2024-09-21T13:47:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:13.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-69","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:13 smithi162 ceph-mon[33046]: osdmap e399: 8 total, 8 up, 8 in 2024-09-21T13:47:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-69"} : dispatch 2024-09-21T13:47:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-69"} : dispatch 2024-09-21T13:47:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:47:13.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:13 smithi162 ceph-mon[33046]: osdmap e400: 8 total, 8 up, 8 in 2024-09-21T13:47:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[30076]: osdmap e399: 8 total, 8 up, 8 in 2024-09-21T13:47:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-69"} : dispatch 2024-09-21T13:47:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-69"} : dispatch 2024-09-21T13:47:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:47:14.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[30076]: osdmap e400: 8 total, 8 up, 8 in 2024-09-21T13:47:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[40622]: osdmap e399: 8 total, 8 up, 8 in 2024-09-21T13:47:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-69"} : dispatch 2024-09-21T13:47:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-69"} : dispatch 2024-09-21T13:47:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:47:14.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:13 smithi002 ceph-mon[40622]: osdmap e400: 8 total, 8 up, 8 in 2024-09-21T13:47:14.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:14 smithi162 ceph-mon[33046]: pgmap v572: 228 pgs: 228 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:47:14.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:14 smithi162 ceph-mon[33046]: osdmap e401: 8 total, 8 up, 8 in 2024-09-21T13:47:14.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:14.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:14 smithi002 ceph-mon[30076]: pgmap v572: 228 pgs: 228 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:47:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:14 smithi002 ceph-mon[30076]: osdmap e401: 8 total, 8 up, 8 in 2024-09-21T13:47:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:14 smithi002 ceph-mon[40622]: pgmap v572: 228 pgs: 228 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:47:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:14 smithi002 ceph-mon[40622]: osdmap e401: 8 total, 8 up, 8 in 2024-09-21T13:47:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:15.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-71","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:16 smithi162 ceph-mon[33046]: pgmap v575: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:47:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:16 smithi162 ceph-mon[33046]: osdmap e402: 8 total, 8 up, 8 in 2024-09-21T13:47:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:47:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:47:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:16 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:47:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[30076]: pgmap v575: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:47:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[30076]: osdmap e402: 8 total, 8 up, 8 in 2024-09-21T13:47:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:47:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:47:17.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:47:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[40622]: pgmap v575: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:47:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[40622]: osdmap e402: 8 total, 8 up, 8 in 2024-09-21T13:47:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:47:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:47:17.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:16 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:47:17.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:47:17.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:17 smithi162 ceph-mon[33046]: osdmap e403: 8 total, 8 up, 8 in 2024-09-21T13:47:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:47:18.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:17 smithi002 ceph-mon[30076]: osdmap e403: 8 total, 8 up, 8 in 2024-09-21T13:47:18.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:47:18.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:17 smithi002 ceph-mon[40622]: osdmap e403: 8 total, 8 up, 8 in 2024-09-21T13:47:18.955 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:18 smithi162 ceph-mon[33046]: pgmap v578: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:18.955 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:18 smithi162 ceph-mon[33046]: osdmap e404: 8 total, 8 up, 8 in 2024-09-21T13:47:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:18 smithi002 ceph-mon[30076]: pgmap v578: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:18 smithi002 ceph-mon[30076]: osdmap e404: 8 total, 8 up, 8 in 2024-09-21T13:47:19.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:18 smithi002 ceph-mon[40622]: pgmap v578: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:19.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:18 smithi002 ceph-mon[40622]: osdmap e404: 8 total, 8 up, 8 in 2024-09-21T13:47:19.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:47:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:47:20.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:47:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:47:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:47:20.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:20 smithi162 ceph-mon[33046]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-21T13:47:21.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:21.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:20 smithi002 ceph-mon[30076]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-21T13:47:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:20 smithi002 ceph-mon[40622]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-21T13:47:22.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:22 smithi162 ceph-mon[33046]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-09-21T13:47:23.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:22 smithi002 ceph-mon[30076]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-09-21T13:47:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:22 smithi002 ceph-mon[40622]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-09-21T13:47:23.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:23 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:47:24.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:23 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:47:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:23 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:47:24.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:24 smithi162 ceph-mon[33046]: pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T13:47:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:24 smithi002 ceph-mon[30076]: pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T13:47:25.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:24 smithi002 ceph-mon[40622]: pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T13:47:26.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:26 smithi162 ceph-mon[33046]: pgmap v583: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:47:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:26 smithi002 ceph-mon[30076]: pgmap v583: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:47:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:26 smithi002 ceph-mon[40622]: pgmap v583: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T13:47:28.965 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:28 smithi162 ceph-mon[33046]: pgmap v584: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-21T13:47:28.965 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:47:28.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.18", "id": [6, 2]} : dispatch 2024-09-21T13:47:28.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1f", "id": [6, 3]} : dispatch 2024-09-21T13:47:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:28 smithi002 ceph-mon[40622]: pgmap v584: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-21T13:47:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:47:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.18", "id": [6, 2]} : dispatch 2024-09-21T13:47:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1f", "id": [6, 3]} : dispatch 2024-09-21T13:47:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:28 smithi002 ceph-mon[30076]: pgmap v584: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-21T13:47:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:47:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.18", "id": [6, 2]} : dispatch 2024-09-21T13:47:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1f", "id": [6, 3]} : dispatch 2024-09-21T13:47:29.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:47:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:47:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.18", "id": [6, 2]}]': finished 2024-09-21T13:47:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1f", "id": [6, 3]}]': finished 2024-09-21T13:47:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:29 smithi162 ceph-mon[33046]: osdmap e405: 8 total, 8 up, 8 in 2024-09-21T13:47:30.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:47:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:47:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:47:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.18", "id": [6, 2]}]': finished 2024-09-21T13:47:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1f", "id": [6, 3]}]': finished 2024-09-21T13:47:30.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:29 smithi002 ceph-mon[30076]: osdmap e405: 8 total, 8 up, 8 in 2024-09-21T13:47:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.18", "id": [6, 2]}]': finished 2024-09-21T13:47:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "300.1f", "id": [6, 3]}]': finished 2024-09-21T13:47:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:29 smithi002 ceph-mon[40622]: osdmap e405: 8 total, 8 up, 8 in 2024-09-21T13:47:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:30 smithi162 ceph-mon[33046]: pgmap v586: 228 pgs: 228 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T13:47:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:30 smithi162 ceph-mon[33046]: osdmap e406: 8 total, 8 up, 8 in 2024-09-21T13:47:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:30 smithi002 ceph-mon[30076]: pgmap v586: 228 pgs: 228 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T13:47:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:30 smithi002 ceph-mon[30076]: osdmap e406: 8 total, 8 up, 8 in 2024-09-21T13:47:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:30 smithi002 ceph-mon[40622]: pgmap v586: 228 pgs: 228 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T13:47:31.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:30 smithi002 ceph-mon[40622]: osdmap e406: 8 total, 8 up, 8 in 2024-09-21T13:47:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:32 smithi162 ceph-mon[33046]: pgmap v588: 228 pgs: 228 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T13:47:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:32 smithi002 ceph-mon[30076]: pgmap v588: 228 pgs: 228 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T13:47:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:32 smithi002 ceph-mon[40622]: pgmap v588: 228 pgs: 228 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T13:47:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:34 smithi162 ceph-mon[33046]: pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-21T13:47:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:34 smithi002 ceph-mon[30076]: pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-21T13:47:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:34 smithi002 ceph-mon[40622]: pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-21T13:47:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:36 smithi162 ceph-mon[33046]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-21T13:47:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:36 smithi002 ceph-mon[30076]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-21T13:47:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:36 smithi002 ceph-mon[40622]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-21T13:47:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:38 smithi002 ceph-mon[30076]: pgmap v591: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 577 B/s rd, 0 op/s 2024-09-21T13:47:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-71"} : dispatch 2024-09-21T13:47:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-71"} : dispatch 2024-09-21T13:47:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:38 smithi002 ceph-mon[40622]: pgmap v591: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 577 B/s rd, 0 op/s 2024-09-21T13:47:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:39.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-71"} : dispatch 2024-09-21T13:47:39.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-71"} : dispatch 2024-09-21T13:47:39.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:47:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:47:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:38 smithi162 ceph-mon[33046]: pgmap v591: 228 pgs: 228 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 577 B/s rd, 0 op/s 2024-09-21T13:47:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-71"} : dispatch 2024-09-21T13:47:39.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-71"} : dispatch 2024-09-21T13:47:40.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:47:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:47:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:47:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:39 smithi002 ceph-mon[30076]: osdmap e407: 8 total, 8 up, 8 in 2024-09-21T13:47:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:39 smithi002 ceph-mon[30076]: osdmap e408: 8 total, 8 up, 8 in 2024-09-21T13:47:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:39 smithi002 ceph-mon[40622]: osdmap e407: 8 total, 8 up, 8 in 2024-09-21T13:47:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:39 smithi002 ceph-mon[40622]: osdmap e408: 8 total, 8 up, 8 in 2024-09-21T13:47:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:40.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:39 smithi162 ceph-mon[33046]: osdmap e407: 8 total, 8 up, 8 in 2024-09-21T13:47:40.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:39 smithi162 ceph-mon[33046]: osdmap e408: 8 total, 8 up, 8 in 2024-09-21T13:47:40.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:40.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-73","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:40 smithi002 ceph-mon[40622]: pgmap v593: 196 pgs: 196 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:40 smithi002 ceph-mon[40622]: osdmap e409: 8 total, 8 up, 8 in 2024-09-21T13:47:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:40 smithi002 ceph-mon[30076]: pgmap v593: 196 pgs: 196 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:40 smithi002 ceph-mon[30076]: osdmap e409: 8 total, 8 up, 8 in 2024-09-21T13:47:41.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:40 smithi162 ceph-mon[33046]: pgmap v593: 196 pgs: 196 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:40 smithi162 ceph-mon[33046]: osdmap e409: 8 total, 8 up, 8 in 2024-09-21T13:47:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:42 smithi002 ceph-mon[30076]: pgmap v596: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:42 smithi002 ceph-mon[30076]: osdmap e410: 8 total, 8 up, 8 in 2024-09-21T13:47:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:42 smithi002 ceph-mon[40622]: pgmap v596: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:42 smithi002 ceph-mon[40622]: osdmap e410: 8 total, 8 up, 8 in 2024-09-21T13:47:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:42 smithi162 ceph-mon[33046]: pgmap v596: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:42 smithi162 ceph-mon[33046]: osdmap e410: 8 total, 8 up, 8 in 2024-09-21T13:47:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:43 smithi002 ceph-mon[40622]: osdmap e411: 8 total, 8 up, 8 in 2024-09-21T13:47:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:47:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:43 smithi002 ceph-mon[30076]: osdmap e411: 8 total, 8 up, 8 in 2024-09-21T13:47:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:47:44.133 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:43 smithi162 ceph-mon[33046]: osdmap e411: 8 total, 8 up, 8 in 2024-09-21T13:47:44.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:47:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:44 smithi002 ceph-mon[30076]: pgmap v599: 228 pgs: 228 active+clean; 8.4 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T13:47:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:44 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:47:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:44 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:47:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:44 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:47:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:44 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:47:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:44 smithi002 ceph-mon[40622]: pgmap v599: 228 pgs: 228 active+clean; 8.4 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T13:47:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:44 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:47:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:44 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:47:45.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:44 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:47:45.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:44 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:47:45.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:44 smithi162 ceph-mon[33046]: pgmap v599: 228 pgs: 228 active+clean; 8.4 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T13:47:45.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:44 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:47:45.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:44 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:47:45.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:44 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:47:45.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:44 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:47:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:46 smithi002 ceph-mon[30076]: pgmap v600: 228 pgs: 228 active+clean; 8.4 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T13:47:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:46 smithi002 ceph-mon[40622]: pgmap v600: 228 pgs: 228 active+clean; 8.4 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T13:47:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:46 smithi162 ceph-mon[33046]: pgmap v600: 228 pgs: 228 active+clean; 8.4 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T13:47:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:48 smithi002 ceph-mon[30076]: pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-21T13:47:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:48 smithi002 ceph-mon[40622]: pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-21T13:47:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:48 smithi162 ceph-mon[33046]: pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-21T13:47:49.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:47:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:47:50.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:47:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:47:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:47:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:50 smithi002 ceph-mon[40622]: pgmap v602: 228 pgs: 228 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-21T13:47:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:50 smithi002 ceph-mon[30076]: pgmap v602: 228 pgs: 228 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-21T13:47:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:47:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:50 smithi162 ceph-mon[33046]: pgmap v602: 228 pgs: 228 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-21T13:47:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:52 smithi002 ceph-mon[30076]: pgmap v603: 228 pgs: 228 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 728 B/s wr, 3 op/s 2024-09-21T13:47:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:52 smithi002 ceph-mon[40622]: pgmap v603: 228 pgs: 228 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 728 B/s wr, 3 op/s 2024-09-21T13:47:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:52 smithi162 ceph-mon[33046]: pgmap v603: 228 pgs: 228 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 728 B/s wr, 3 op/s 2024-09-21T13:47:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-73"} : dispatch 2024-09-21T13:47:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:53 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-73"} : dispatch 2024-09-21T13:47:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-73"} : dispatch 2024-09-21T13:47:54.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:53 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-73"} : dispatch 2024-09-21T13:47:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-73"} : dispatch 2024-09-21T13:47:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:53 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-73"} : dispatch 2024-09-21T13:47:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:54 smithi002 ceph-mon[40622]: pgmap v604: 228 pgs: 228 active+clean; 8.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 661 B/s wr, 3 op/s 2024-09-21T13:47:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:54 smithi002 ceph-mon[40622]: osdmap e412: 8 total, 8 up, 8 in 2024-09-21T13:47:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:54 smithi002 ceph-mon[30076]: pgmap v604: 228 pgs: 228 active+clean; 8.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 661 B/s wr, 3 op/s 2024-09-21T13:47:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:54 smithi002 ceph-mon[30076]: osdmap e412: 8 total, 8 up, 8 in 2024-09-21T13:47:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:54 smithi162 ceph-mon[33046]: pgmap v604: 228 pgs: 228 active+clean; 8.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 661 B/s wr, 3 op/s 2024-09-21T13:47:55.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:54 smithi162 ceph-mon[33046]: osdmap e412: 8 total, 8 up, 8 in 2024-09-21T13:47:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:55 smithi002 ceph-mon[40622]: osdmap e413: 8 total, 8 up, 8 in 2024-09-21T13:47:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:55 smithi002 ceph-mon[30076]: osdmap e413: 8 total, 8 up, 8 in 2024-09-21T13:47:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:55 smithi162 ceph-mon[33046]: osdmap e413: 8 total, 8 up, 8 in 2024-09-21T13:47:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-75","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:47:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:56 smithi002 ceph-mon[40622]: pgmap v607: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:47:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:56 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:47:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:56 smithi002 ceph-mon[40622]: osdmap e414: 8 total, 8 up, 8 in 2024-09-21T13:47:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:56 smithi002 ceph-mon[30076]: pgmap v607: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:47:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:56 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:47:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:56 smithi002 ceph-mon[30076]: osdmap e414: 8 total, 8 up, 8 in 2024-09-21T13:47:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:56 smithi162 ceph-mon[33046]: pgmap v607: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:47:57.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:56 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:47:57.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:47:57.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:56 smithi162 ceph-mon[33046]: osdmap e414: 8 total, 8 up, 8 in 2024-09-21T13:47:57.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:47:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:57 smithi002 ceph-mon[30076]: osdmap e415: 8 total, 8 up, 8 in 2024-09-21T13:47:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:57 smithi002 ceph-mon[40622]: osdmap e415: 8 total, 8 up, 8 in 2024-09-21T13:47:58.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:57 smithi162 ceph-mon[33046]: osdmap e415: 8 total, 8 up, 8 in 2024-09-21T13:47:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[30076]: pgmap v610: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[30076]: osdmap e416: 8 total, 8 up, 8 in 2024-09-21T13:47:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-75"} : dispatch 2024-09-21T13:47:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-75"} : dispatch 2024-09-21T13:47:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:47:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[40622]: pgmap v610: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[40622]: osdmap e416: 8 total, 8 up, 8 in 2024-09-21T13:47:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-75"} : dispatch 2024-09-21T13:47:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-75"} : dispatch 2024-09-21T13:47:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:47:59.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:47:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:47:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:58 smithi162 ceph-mon[33046]: pgmap v610: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:47:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:58 smithi162 ceph-mon[33046]: osdmap e416: 8 total, 8 up, 8 in 2024-09-21T13:47:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:47:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-75"} : dispatch 2024-09-21T13:47:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-75"} : dispatch 2024-09-21T13:47:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:47:59 smithi002 ceph-mon[30076]: osdmap e417: 8 total, 8 up, 8 in 2024-09-21T13:48:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:47:59 smithi002 ceph-mon[40622]: osdmap e417: 8 total, 8 up, 8 in 2024-09-21T13:48:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:47:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:47:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:48:00.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:47:59 smithi162 ceph-mon[33046]: osdmap e417: 8 total, 8 up, 8 in 2024-09-21T13:48:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:00 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:00 smithi002 ceph-mon[40622]: pgmap v613: 196 pgs: 196 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:48:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:00 smithi002 ceph-mon[40622]: osdmap e418: 8 total, 8 up, 8 in 2024-09-21T13:48:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:00 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:01.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:00 smithi002 ceph-mon[30076]: pgmap v613: 196 pgs: 196 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:48:01.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:00 smithi002 ceph-mon[30076]: osdmap e418: 8 total, 8 up, 8 in 2024-09-21T13:48:01.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:01.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:00 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:00 smithi162 ceph-mon[33046]: pgmap v613: 196 pgs: 196 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:48:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:00 smithi162 ceph-mon[33046]: osdmap e418: 8 total, 8 up, 8 in 2024-09-21T13:48:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-77","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:01 smithi002 ceph-mon[30076]: osdmap e419: 8 total, 8 up, 8 in 2024-09-21T13:48:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:01 smithi002 ceph-mon[40622]: osdmap e419: 8 total, 8 up, 8 in 2024-09-21T13:48:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:01 smithi162 ceph-mon[33046]: osdmap e419: 8 total, 8 up, 8 in 2024-09-21T13:48:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:02 smithi162 ceph-mon[33046]: pgmap v616: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:48:03.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:02 smithi162 ceph-mon[33046]: osdmap e420: 8 total, 8 up, 8 in 2024-09-21T13:48:03.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:03.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:03.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-77"} : dispatch 2024-09-21T13:48:03.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-77"} : dispatch 2024-09-21T13:48:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[40622]: pgmap v616: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:48:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[40622]: osdmap e420: 8 total, 8 up, 8 in 2024-09-21T13:48:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-77"} : dispatch 2024-09-21T13:48:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-77"} : dispatch 2024-09-21T13:48:03.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[30076]: pgmap v616: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:48:03.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[30076]: osdmap e420: 8 total, 8 up, 8 in 2024-09-21T13:48:03.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:03.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:03.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-77"} : dispatch 2024-09-21T13:48:03.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-77"} : dispatch 2024-09-21T13:48:04.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:03 smithi162 ceph-mon[33046]: osdmap e421: 8 total, 8 up, 8 in 2024-09-21T13:48:04.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:03 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:03 smithi002 ceph-mon[40622]: osdmap e421: 8 total, 8 up, 8 in 2024-09-21T13:48:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:03 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:03 smithi002 ceph-mon[30076]: osdmap e421: 8 total, 8 up, 8 in 2024-09-21T13:48:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:03 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:05.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:04 smithi162 ceph-mon[33046]: pgmap v619: 196 pgs: 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:48:05.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:04 smithi162 ceph-mon[33046]: osdmap e422: 8 total, 8 up, 8 in 2024-09-21T13:48:05.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:05.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:04 smithi002 ceph-mon[40622]: pgmap v619: 196 pgs: 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:48:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:04 smithi002 ceph-mon[40622]: osdmap e422: 8 total, 8 up, 8 in 2024-09-21T13:48:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:05.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:04 smithi002 ceph-mon[30076]: pgmap v619: 196 pgs: 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:48:05.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:04 smithi002 ceph-mon[30076]: osdmap e422: 8 total, 8 up, 8 in 2024-09-21T13:48:05.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:05.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-79","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:06.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:05 smithi162 ceph-mon[33046]: osdmap e423: 8 total, 8 up, 8 in 2024-09-21T13:48:06.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:06.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:05 smithi162 ceph-mon[33046]: pgmap v622: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:48:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:05 smithi002 ceph-mon[40622]: osdmap e423: 8 total, 8 up, 8 in 2024-09-21T13:48:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:05 smithi002 ceph-mon[40622]: pgmap v622: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:48:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:06.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:05 smithi002 ceph-mon[30076]: osdmap e423: 8 total, 8 up, 8 in 2024-09-21T13:48:06.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:06.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:05 smithi002 ceph-mon[30076]: pgmap v622: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:48:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:06 smithi162 ceph-mon[33046]: osdmap e424: 8 total, 8 up, 8 in 2024-09-21T13:48:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:06 smithi002 ceph-mon[30076]: osdmap e424: 8 total, 8 up, 8 in 2024-09-21T13:48:07.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:06 smithi002 ceph-mon[40622]: osdmap e424: 8 total, 8 up, 8 in 2024-09-21T13:48:08.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:07 smithi162 ceph-mon[33046]: osdmap e425: 8 total, 8 up, 8 in 2024-09-21T13:48:08.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "304.15"} : dispatch 2024-09-21T13:48:08.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:07 smithi162 ceph-mon[33046]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "304.15"}]: dispatch 2024-09-21T13:48:08.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:07 smithi162 ceph-mon[33046]: 304.15 deep-scrub starts 2024-09-21T13:48:08.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:07 smithi162 ceph-mon[33046]: 304.15 deep-scrub ok 2024-09-21T13:48:08.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:07 smithi162 ceph-mon[33046]: pgmap v625: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[40622]: osdmap e425: 8 total, 8 up, 8 in 2024-09-21T13:48:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "304.15"} : dispatch 2024-09-21T13:48:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[40622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "304.15"}]: dispatch 2024-09-21T13:48:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[40622]: 304.15 deep-scrub starts 2024-09-21T13:48:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[40622]: 304.15 deep-scrub ok 2024-09-21T13:48:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[40622]: pgmap v625: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:08.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[30076]: osdmap e425: 8 total, 8 up, 8 in 2024-09-21T13:48:08.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "304.15"} : dispatch 2024-09-21T13:48:08.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[30076]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "304.15"}]: dispatch 2024-09-21T13:48:08.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[30076]: 304.15 deep-scrub starts 2024-09-21T13:48:08.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[30076]: 304.15 deep-scrub ok 2024-09-21T13:48:08.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:07 smithi002 ceph-mon[30076]: pgmap v625: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:09.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:48:08 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:48:10.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:48:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:48:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:48:10.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:10 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:10.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:10 smithi162 ceph-mon[33046]: pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 894 B/s rd, 894 B/s wr, 2 op/s 2024-09-21T13:48:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:10 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:10 smithi002 ceph-mon[30076]: pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 894 B/s rd, 894 B/s wr, 2 op/s 2024-09-21T13:48:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:10 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:10 smithi002 ceph-mon[40622]: pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 894 B/s rd, 894 B/s wr, 2 op/s 2024-09-21T13:48:12.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:12 smithi162 ceph-mon[33046]: pgmap v627: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 762 B/s rd, 762 B/s wr, 2 op/s 2024-09-21T13:48:13.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:12 smithi002 ceph-mon[30076]: pgmap v627: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 762 B/s rd, 762 B/s wr, 2 op/s 2024-09-21T13:48:13.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:12 smithi002 ceph-mon[40622]: pgmap v627: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 762 B/s rd, 762 B/s wr, 2 op/s 2024-09-21T13:48:13.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:14.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:14 smithi162 ceph-mon[33046]: pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-09-21T13:48:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:14 smithi002 ceph-mon[30076]: pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-09-21T13:48:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:14 smithi002 ceph-mon[40622]: pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-09-21T13:48:16.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:16 smithi162 ceph-mon[33046]: pgmap v629: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 527 B/s wr, 2 op/s 2024-09-21T13:48:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:16 smithi002 ceph-mon[30076]: pgmap v629: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 527 B/s wr, 2 op/s 2024-09-21T13:48:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:16 smithi002 ceph-mon[40622]: pgmap v629: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 527 B/s wr, 2 op/s 2024-09-21T13:48:18.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:18 smithi162 ceph-mon[33046]: pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 955 B/s rd, 477 B/s wr, 1 op/s 2024-09-21T13:48:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:18 smithi002 ceph-mon[30076]: pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 955 B/s rd, 477 B/s wr, 1 op/s 2024-09-21T13:48:19.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:18 smithi002 ceph-mon[40622]: pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 955 B/s rd, 477 B/s wr, 1 op/s 2024-09-21T13:48:19.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:48:19 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:48:20.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:48:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:48:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:48:20.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:20 smithi162 ceph-mon[33046]: pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T13:48:21.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:21.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:20 smithi002 ceph-mon[30076]: pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T13:48:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:20 smithi002 ceph-mon[40622]: pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T13:48:22.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:22 smithi162 ceph-mon[33046]: pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:48:23.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:22 smithi002 ceph-mon[30076]: pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:48:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:22 smithi002 ceph-mon[40622]: pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:48:24.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:24 smithi162 ceph-mon[33046]: pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:24 smithi002 ceph-mon[30076]: pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:25.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:24 smithi002 ceph-mon[40622]: pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:26.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:26 smithi162 ceph-mon[33046]: pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T13:48:26.983 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:48:26 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:48:26.918+0000 7f6c79875640 -1 snap_mapper.add_oid found existing snaps mapped on 304:ad7238ad:test-rados-api-smithi002-76734-80::foo:2, removing 2024-09-21T13:48:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:26 smithi002 ceph-mon[40622]: pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T13:48:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:26 smithi002 ceph-mon[30076]: pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T13:48:27.100 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:48:26 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0[44379]: 2024-09-21T13:48:26.918+0000 7fa7e77c1640 -1 snap_mapper.add_oid found existing snaps mapped on 304:ad7238ad:test-rados-api-smithi002-76734-80::foo:2, removing 2024-09-21T13:48:27.101 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:48:26 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2[56281]: 2024-09-21T13:48:26.918+0000 7f6f446bd640 -1 snap_mapper.add_oid found existing snaps mapped on 304:ad7238ad:test-rados-api-smithi002-76734-80::foo:2, removing 2024-09-21T13:48:27.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-79"} : dispatch 2024-09-21T13:48:27.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:27 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-79"} : dispatch 2024-09-21T13:48:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-79"} : dispatch 2024-09-21T13:48:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:27 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-79"} : dispatch 2024-09-21T13:48:28.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:28.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:28.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-79"} : dispatch 2024-09-21T13:48:28.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:27 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-79"} : dispatch 2024-09-21T13:48:28.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:28 smithi162 ceph-mon[33046]: pgmap v635: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T13:48:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:28 smithi162 ceph-mon[33046]: osdmap e426: 8 total, 8 up, 8 in 2024-09-21T13:48:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:28 smithi002 ceph-mon[40622]: pgmap v635: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T13:48:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:28 smithi002 ceph-mon[40622]: osdmap e426: 8 total, 8 up, 8 in 2024-09-21T13:48:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:28 smithi002 ceph-mon[30076]: pgmap v635: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T13:48:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:28 smithi002 ceph-mon[30076]: osdmap e426: 8 total, 8 up, 8 in 2024-09-21T13:48:29.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:29.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:48:29 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:48:29.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:29 smithi162 ceph-mon[33046]: osdmap e427: 8 total, 8 up, 8 in 2024-09-21T13:48:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:29 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:30.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:48:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:48:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:48:30.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:29 smithi002 ceph-mon[40622]: osdmap e427: 8 total, 8 up, 8 in 2024-09-21T13:48:30.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:30.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:29 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:29 smithi002 ceph-mon[30076]: osdmap e427: 8 total, 8 up, 8 in 2024-09-21T13:48:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:29 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-81","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:30 smithi162 ceph-mon[33046]: pgmap v638: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:48:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:30 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:30 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:30 smithi162 ceph-mon[33046]: osdmap e428: 8 total, 8 up, 8 in 2024-09-21T13:48:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:30 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[40622]: pgmap v638: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:48:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[40622]: osdmap e428: 8 total, 8 up, 8 in 2024-09-21T13:48:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:31.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:31.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[30076]: pgmap v638: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:48:31.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:31.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:31.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[30076]: osdmap e428: 8 total, 8 up, 8 in 2024-09-21T13:48:31.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:31.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:31.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:30 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:31.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:31 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:48:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:31 smithi162 ceph-mon[33046]: osdmap e429: 8 total, 8 up, 8 in 2024-09-21T13:48:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:31 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:31.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:31 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:32.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:31 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:48:32.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:31 smithi002 ceph-mon[40622]: osdmap e429: 8 total, 8 up, 8 in 2024-09-21T13:48:32.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:31 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:32.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:31 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:32.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:31 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:48:32.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:31 smithi002 ceph-mon[30076]: osdmap e429: 8 total, 8 up, 8 in 2024-09-21T13:48:32.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:31 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:32.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:31 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:32 smithi162 ceph-mon[33046]: pgmap v641: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T13:48:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:48:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:32 smithi162 ceph-mon[33046]: osdmap e430: 8 total, 8 up, 8 in 2024-09-21T13:48:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:32 smithi002 ceph-mon[40622]: pgmap v641: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T13:48:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:48:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:32 smithi002 ceph-mon[40622]: osdmap e430: 8 total, 8 up, 8 in 2024-09-21T13:48:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:32 smithi002 ceph-mon[30076]: pgmap v641: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T13:48:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:48:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:32 smithi002 ceph-mon[30076]: osdmap e430: 8 total, 8 up, 8 in 2024-09-21T13:48:33.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:33.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:48:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:33 smithi162 ceph-mon[33046]: osdmap e431: 8 total, 8 up, 8 in 2024-09-21T13:48:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:33 smithi162 ceph-mon[33046]: osdmap e432: 8 total, 8 up, 8 in 2024-09-21T13:48:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:48:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[30076]: osdmap e431: 8 total, 8 up, 8 in 2024-09-21T13:48:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:34.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[30076]: osdmap e432: 8 total, 8 up, 8 in 2024-09-21T13:48:34.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:48:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[40622]: osdmap e431: 8 total, 8 up, 8 in 2024-09-21T13:48:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:34.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:33 smithi002 ceph-mon[40622]: osdmap e432: 8 total, 8 up, 8 in 2024-09-21T13:48:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:34 smithi162 ceph-mon[33046]: pgmap v644: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T13:48:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T13:48:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:34 smithi002 ceph-mon[30076]: pgmap v644: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T13:48:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T13:48:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:34 smithi002 ceph-mon[40622]: pgmap v644: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T13:48:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "512"} : dispatch 2024-09-21T13:48:35.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-21T13:48:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:35 smithi162 ceph-mon[33046]: osdmap e433: 8 total, 8 up, 8 in 2024-09-21T13:48:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T13:48:35.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T13:48:36.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-21T13:48:36.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:35 smithi002 ceph-mon[30076]: osdmap e433: 8 total, 8 up, 8 in 2024-09-21T13:48:36.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T13:48:36.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T13:48:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-21T13:48:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:35 smithi002 ceph-mon[40622]: osdmap e433: 8 total, 8 up, 8 in 2024-09-21T13:48:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T13:48:36.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "16384"} : dispatch 2024-09-21T13:48:36.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:36 smithi162 ceph-mon[33046]: pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-21T13:48:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:36 smithi162 ceph-mon[33046]: osdmap e434: 8 total, 8 up, 8 in 2024-09-21T13:48:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:36.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:36 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:36 smithi002 ceph-mon[30076]: pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-21T13:48:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:36 smithi002 ceph-mon[30076]: osdmap e434: 8 total, 8 up, 8 in 2024-09-21T13:48:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:36 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:36 smithi002 ceph-mon[40622]: pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-21T13:48:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:36 smithi002 ceph-mon[40622]: osdmap e434: 8 total, 8 up, 8 in 2024-09-21T13:48:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:37.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:36 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:38.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:38.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[30076]: osdmap e435: 8 total, 8 up, 8 in 2024-09-21T13:48:38.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:38.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:38.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-81"} : dispatch 2024-09-21T13:48:38.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-81"} : dispatch 2024-09-21T13:48:38.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:38.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[40622]: osdmap e435: 8 total, 8 up, 8 in 2024-09-21T13:48:38.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:38.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:38.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-81"} : dispatch 2024-09-21T13:48:38.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-81"} : dispatch 2024-09-21T13:48:38.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:38.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:37 smithi162 ceph-mon[33046]: osdmap e435: 8 total, 8 up, 8 in 2024-09-21T13:48:38.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:38.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:38.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-81"} : dispatch 2024-09-21T13:48:38.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-81"} : dispatch 2024-09-21T13:48:39.024 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:38 smithi162 ceph-mon[33046]: pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:39.025 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:38 smithi162 ceph-mon[33046]: osdmap e436: 8 total, 8 up, 8 in 2024-09-21T13:48:39.025 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:38 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:38 smithi002 ceph-mon[40622]: pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:38 smithi002 ceph-mon[40622]: osdmap e436: 8 total, 8 up, 8 in 2024-09-21T13:48:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:38 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:38 smithi002 ceph-mon[30076]: pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:38 smithi002 ceph-mon[30076]: osdmap e436: 8 total, 8 up, 8 in 2024-09-21T13:48:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:38 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:39.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:48:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:48:40.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:48:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:48:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:48:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:39 smithi002 ceph-mon[30076]: osdmap e437: 8 total, 8 up, 8 in 2024-09-21T13:48:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:40.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:39 smithi002 ceph-mon[40622]: osdmap e437: 8 total, 8 up, 8 in 2024-09-21T13:48:40.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:40.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:40.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:39 smithi162 ceph-mon[33046]: osdmap e437: 8 total, 8 up, 8 in 2024-09-21T13:48:40.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:40.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-83","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[30076]: pgmap v653: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-21T13:48:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[30076]: osdmap e438: 8 total, 8 up, 8 in 2024-09-21T13:48:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[40622]: pgmap v653: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-21T13:48:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[40622]: osdmap e438: 8 total, 8 up, 8 in 2024-09-21T13:48:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:40 smithi162 ceph-mon[33046]: pgmap v653: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-21T13:48:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:40 smithi162 ceph-mon[33046]: osdmap e438: 8 total, 8 up, 8 in 2024-09-21T13:48:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:48:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:41 smithi002 ceph-mon[30076]: osdmap e439: 8 total, 8 up, 8 in 2024-09-21T13:48:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:42.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:48:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:41 smithi002 ceph-mon[40622]: osdmap e439: 8 total, 8 up, 8 in 2024-09-21T13:48:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:42.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:48:42.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:41 smithi162 ceph-mon[33046]: osdmap e439: 8 total, 8 up, 8 in 2024-09-21T13:48:42.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:42.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:42 smithi002 ceph-mon[30076]: pgmap v656: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-21T13:48:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:48:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:42 smithi002 ceph-mon[30076]: osdmap e440: 8 total, 8 up, 8 in 2024-09-21T13:48:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:42 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:42 smithi002 ceph-mon[40622]: pgmap v656: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-21T13:48:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:48:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:42 smithi002 ceph-mon[40622]: osdmap e440: 8 total, 8 up, 8 in 2024-09-21T13:48:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:42 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:42 smithi162 ceph-mon[33046]: pgmap v656: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-21T13:48:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:48:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:42 smithi162 ceph-mon[33046]: osdmap e440: 8 total, 8 up, 8 in 2024-09-21T13:48:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:43.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:42 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:48:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[30076]: osdmap e441: 8 total, 8 up, 8 in 2024-09-21T13:48:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[30076]: osdmap e442: 8 total, 8 up, 8 in 2024-09-21T13:48:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:48:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[40622]: osdmap e441: 8 total, 8 up, 8 in 2024-09-21T13:48:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:44.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:43 smithi002 ceph-mon[40622]: osdmap e442: 8 total, 8 up, 8 in 2024-09-21T13:48:44.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:48:44.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:43 smithi162 ceph-mon[33046]: osdmap e441: 8 total, 8 up, 8 in 2024-09-21T13:48:44.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:44.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:44.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:44.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:44.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:43 smithi162 ceph-mon[33046]: osdmap e442: 8 total, 8 up, 8 in 2024-09-21T13:48:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:44 smithi002 ceph-mon[30076]: pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:44 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:48:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:44 smithi002 ceph-mon[40622]: pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:44 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:48:45.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:44 smithi162 ceph-mon[33046]: pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:45.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:44 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:48:46.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:45 smithi002 ceph-mon[30076]: osdmap e443: 8 total, 8 up, 8 in 2024-09-21T13:48:46.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:45 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:48:46.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:45 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:48:46.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:45 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:48:46.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:45 smithi002 ceph-mon[40622]: osdmap e443: 8 total, 8 up, 8 in 2024-09-21T13:48:46.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:45 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:48:46.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:45 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:48:46.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:45 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:48:46.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:45 smithi162 ceph-mon[33046]: osdmap e443: 8 total, 8 up, 8 in 2024-09-21T13:48:46.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:45 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:48:46.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:45 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:48:46.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:45 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:48:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[30076]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[30076]: osdmap e444: 8 total, 8 up, 8 in 2024-09-21T13:48:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-83"} : dispatch 2024-09-21T13:48:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-83"} : dispatch 2024-09-21T13:48:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[40622]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[40622]: osdmap e444: 8 total, 8 up, 8 in 2024-09-21T13:48:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-83"} : dispatch 2024-09-21T13:48:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:46 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-83"} : dispatch 2024-09-21T13:48:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:46 smithi162 ceph-mon[33046]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:48:47.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:46 smithi162 ceph-mon[33046]: osdmap e444: 8 total, 8 up, 8 in 2024-09-21T13:48:47.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:47.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:46 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:47.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-83"} : dispatch 2024-09-21T13:48:47.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:46 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-83"} : dispatch 2024-09-21T13:48:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:47 smithi002 ceph-mon[30076]: osdmap e445: 8 total, 8 up, 8 in 2024-09-21T13:48:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:47 smithi002 ceph-mon[40622]: osdmap e445: 8 total, 8 up, 8 in 2024-09-21T13:48:48.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:47 smithi162 ceph-mon[33046]: osdmap e445: 8 total, 8 up, 8 in 2024-09-21T13:48:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:48 smithi002 ceph-mon[30076]: pgmap v665: 196 pgs: 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:48 smithi002 ceph-mon[30076]: osdmap e446: 8 total, 8 up, 8 in 2024-09-21T13:48:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:48 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:48 smithi002 ceph-mon[40622]: pgmap v665: 196 pgs: 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:48 smithi002 ceph-mon[40622]: osdmap e446: 8 total, 8 up, 8 in 2024-09-21T13:48:49.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:49.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:48 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:49.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:48:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:48:49.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:48 smithi162 ceph-mon[33046]: pgmap v665: 196 pgs: 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:49.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:48 smithi162 ceph-mon[33046]: osdmap e446: 8 total, 8 up, 8 in 2024-09-21T13:48:49.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:49.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:48 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-85","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:50.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:48:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:48:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:48:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:49 smithi002 ceph-mon[30076]: osdmap e447: 8 total, 8 up, 8 in 2024-09-21T13:48:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:49 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:49 smithi002 ceph-mon[40622]: osdmap e447: 8 total, 8 up, 8 in 2024-09-21T13:48:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:50.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:49 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:50.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:49 smithi162 ceph-mon[33046]: osdmap e447: 8 total, 8 up, 8 in 2024-09-21T13:48:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:49 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:48:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[30076]: pgmap v668: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T13:48:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:48:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[30076]: osdmap e448: 8 total, 8 up, 8 in 2024-09-21T13:48:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[40622]: pgmap v668: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T13:48:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:48:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[40622]: osdmap e448: 8 total, 8 up, 8 in 2024-09-21T13:48:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:50 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:48:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:50 smithi162 ceph-mon[33046]: pgmap v668: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T13:48:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:48:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:50 smithi162 ceph-mon[33046]: osdmap e448: 8 total, 8 up, 8 in 2024-09-21T13:48:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:50 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:48:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[30076]: osdmap e449: 8 total, 8 up, 8 in 2024-09-21T13:48:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:48:52.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[30076]: osdmap e450: 8 total, 8 up, 8 in 2024-09-21T13:48:52.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:48:52.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[40622]: osdmap e449: 8 total, 8 up, 8 in 2024-09-21T13:48:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:48:52.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:51 smithi002 ceph-mon[40622]: osdmap e450: 8 total, 8 up, 8 in 2024-09-21T13:48:52.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:51 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_tier","val": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:48:52.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:51 smithi162 ceph-mon[33046]: osdmap e449: 8 total, 8 up, 8 in 2024-09-21T13:48:52.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:52.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:51 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:48:52.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:51 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:48:52.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:51 smithi162 ceph-mon[33046]: osdmap e450: 8 total, 8 up, 8 in 2024-09-21T13:48:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:52 smithi002 ceph-mon[40622]: pgmap v671: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T13:48:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:52 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:52 smithi002 ceph-mon[40622]: osdmap e451: 8 total, 8 up, 8 in 2024-09-21T13:48:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:52 smithi002 ceph-mon[30076]: pgmap v671: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T13:48:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:53.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:53.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:52 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:53.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:52 smithi002 ceph-mon[30076]: osdmap e451: 8 total, 8 up, 8 in 2024-09-21T13:48:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:52 smithi162 ceph-mon[33046]: pgmap v671: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T13:48:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:48:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:52 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:48:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:52 smithi162 ceph-mon[33046]: osdmap e451: 8 total, 8 up, 8 in 2024-09-21T13:48:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:54 smithi002 ceph-mon[40622]: pgmap v674: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T13:48:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:54 smithi002 ceph-mon[40622]: osdmap e452: 8 total, 8 up, 8 in 2024-09-21T13:48:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:54 smithi002 ceph-mon[30076]: pgmap v674: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T13:48:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:54 smithi002 ceph-mon[30076]: osdmap e452: 8 total, 8 up, 8 in 2024-09-21T13:48:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:54 smithi162 ceph-mon[33046]: pgmap v674: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T13:48:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:54 smithi162 ceph-mon[33046]: osdmap e452: 8 total, 8 up, 8 in 2024-09-21T13:48:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:55 smithi162 ceph-mon[33046]: osdmap e453: 8 total, 8 up, 8 in 2024-09-21T13:48:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-85"} : dispatch 2024-09-21T13:48:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-85"} : dispatch 2024-09-21T13:48:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:55 smithi002 ceph-mon[30076]: osdmap e453: 8 total, 8 up, 8 in 2024-09-21T13:48:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-85"} : dispatch 2024-09-21T13:48:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-85"} : dispatch 2024-09-21T13:48:56.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:55 smithi002 ceph-mon[40622]: osdmap e453: 8 total, 8 up, 8 in 2024-09-21T13:48:56.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:56.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:48:56.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-85"} : dispatch 2024-09-21T13:48:56.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-85"} : dispatch 2024-09-21T13:48:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:56 smithi162 ceph-mon[33046]: pgmap v677: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T13:48:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:56 smithi162 ceph-mon[33046]: osdmap e454: 8 total, 8 up, 8 in 2024-09-21T13:48:57.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:56 smithi002 ceph-mon[30076]: pgmap v677: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T13:48:57.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:56 smithi002 ceph-mon[30076]: osdmap e454: 8 total, 8 up, 8 in 2024-09-21T13:48:57.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:56 smithi002 ceph-mon[40622]: pgmap v677: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T13:48:57.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:56 smithi002 ceph-mon[40622]: osdmap e454: 8 total, 8 up, 8 in 2024-09-21T13:48:57.879 INFO:tasks.workunit.client.0.smithi002.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (18126 ms) 2024-09-21T13:48:57.879 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-21T13:48:57.879 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22897 ms) 2024-09-21T13:48:57.879 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-21T13:48:57.879 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3023 ms) 2024-09-21T13:48:57.879 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-21T13:48:57.879 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.879 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3025 ms) 2024-09-21T13:48:57.879 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-21T13:48:57.880 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3020 ms) 2024-09-21T13:48:57.880 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-21T13:48:57.880 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.880 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3006 ms) 2024-09-21T13:48:57.880 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-21T13:48:57.880 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.880 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4018 ms) 2024-09-21T13:48:57.880 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-21T13:48:57.880 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.880 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (39931 ms) 2024-09-21T13:48:57.880 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (16982 ms) 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4029 ms) 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3018 ms) 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (25061 ms) 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.881 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15049 ms) 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5026 ms) 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4045 ms) 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: waiting for scrubs... 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: done waiting 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (24825 ms) 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-21T13:48:57.882 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.883 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10062 ms) 2024-09-21T13:48:57.883 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-21T13:48:57.883 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.883 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9053 ms) 2024-09-21T13:48:57.883 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-21T13:48:57.883 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:48:57.883 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9060 ms) 2024-09-21T13:48:57.883 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-21T13:48:58.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:57 smithi162 ceph-mon[33046]: osdmap e455: 8 total, 8 up, 8 in 2024-09-21T13:48:58.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:58.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:58.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:57 smithi002 ceph-mon[40622]: osdmap e455: 8 total, 8 up, 8 in 2024-09-21T13:48:58.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:58.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:58.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:57 smithi002 ceph-mon[30076]: osdmap e455: 8 total, 8 up, 8 in 2024-09-21T13:48:58.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:58.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-87","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:48:59.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:48:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:48:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:58 smithi162 ceph-mon[33046]: pgmap v680: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:58 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:58 smithi162 ceph-mon[33046]: osdmap e456: 8 total, 8 up, 8 in 2024-09-21T13:48:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[40622]: pgmap v680: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[40622]: osdmap e456: 8 total, 8 up, 8 in 2024-09-21T13:48:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:48:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[30076]: pgmap v680: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:48:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:48:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:48:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[30076]: osdmap e456: 8 total, 8 up, 8 in 2024-09-21T13:48:59.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:48:59.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:48:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:48:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:49:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:59 smithi002 ceph-mon[40622]: osdmap e457: 8 total, 8 up, 8 in 2024-09-21T13:49:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:59 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:48:59 smithi002 ceph-mon[40622]: pgmap v683: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-21T13:49:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:59 smithi002 ceph-mon[30076]: osdmap e457: 8 total, 8 up, 8 in 2024-09-21T13:49:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:59 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:00.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:48:59 smithi002 ceph-mon[30076]: pgmap v683: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-21T13:49:00.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:59 smithi162 ceph-mon[33046]: osdmap e457: 8 total, 8 up, 8 in 2024-09-21T13:49:00.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:00.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:00.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:59 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:00.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:48:59 smithi162 ceph-mon[33046]: pgmap v683: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-21T13:49:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:49:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:00 smithi162 ceph-mon[33046]: osdmap e458: 8 total, 8 up, 8 in 2024-09-21T13:49:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_tier","val": "test-rados-api-smithi002-76734-89-test-flush"} : dispatch 2024-09-21T13:49:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_tier","val": "test-rados-api-smithi002-76734-89-test-flush"} : dispatch 2024-09-21T13:49:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:49:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:00 smithi002 ceph-mon[30076]: osdmap e458: 8 total, 8 up, 8 in 2024-09-21T13:49:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_tier","val": "test-rados-api-smithi002-76734-89-test-flush"} : dispatch 2024-09-21T13:49:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_tier","val": "test-rados-api-smithi002-76734-89-test-flush"} : dispatch 2024-09-21T13:49:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:49:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:00 smithi002 ceph-mon[40622]: osdmap e458: 8 total, 8 up, 8 in 2024-09-21T13:49:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_tier","val": "test-rados-api-smithi002-76734-89-test-flush"} : dispatch 2024-09-21T13:49:01.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_tier","val": "test-rados-api-smithi002-76734-89-test-flush"} : dispatch 2024-09-21T13:49:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_tier","val": "test-rados-api-smithi002-76734-89-test-flush"}]': finished 2024-09-21T13:49:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:01 smithi162 ceph-mon[33046]: osdmap e459: 8 total, 8 up, 8 in 2024-09-21T13:49:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:49:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:49:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:01 smithi162 ceph-mon[33046]: pgmap v686: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-21T13:49:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:49:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:01 smithi162 ceph-mon[33046]: osdmap e460: 8 total, 8 up, 8 in 2024-09-21T13:49:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_tier","val": "test-rados-api-smithi002-76734-89-test-flush"}]': finished 2024-09-21T13:49:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[30076]: osdmap e459: 8 total, 8 up, 8 in 2024-09-21T13:49:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:49:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:49:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[30076]: pgmap v686: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-21T13:49:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:49:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[30076]: osdmap e460: 8 total, 8 up, 8 in 2024-09-21T13:49:02.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_tier","val": "test-rados-api-smithi002-76734-89-test-flush"}]': finished 2024-09-21T13:49:02.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[40622]: osdmap e459: 8 total, 8 up, 8 in 2024-09-21T13:49:02.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:49:02.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:49:02.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[40622]: pgmap v686: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-21T13:49:02.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:49:02.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:01 smithi002 ceph-mon[40622]: osdmap e460: 8 total, 8 up, 8 in 2024-09-21T13:49:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:49:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:49:03.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:49:03.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:02 smithi162 ceph-mon[33046]: osdmap e461: 8 total, 8 up, 8 in 2024-09-21T13:49:03.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:49:03.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:49:03.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:49:03.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:02 smithi002 ceph-mon[30076]: osdmap e461: 8 total, 8 up, 8 in 2024-09-21T13:49:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:49:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:49:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:49:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:02 smithi002 ceph-mon[40622]: osdmap e461: 8 total, 8 up, 8 in 2024-09-21T13:49:04.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:04 smithi162 ceph-mon[33046]: pgmap v689: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T13:49:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:04 smithi162 ceph-mon[33046]: osdmap e462: 8 total, 8 up, 8 in 2024-09-21T13:49:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-87"} : dispatch 2024-09-21T13:49:04.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-87"} : dispatch 2024-09-21T13:49:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[30076]: pgmap v689: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T13:49:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[30076]: osdmap e462: 8 total, 8 up, 8 in 2024-09-21T13:49:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-87"} : dispatch 2024-09-21T13:49:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-87"} : dispatch 2024-09-21T13:49:04.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[40622]: pgmap v689: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T13:49:04.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[40622]: osdmap e462: 8 total, 8 up, 8 in 2024-09-21T13:49:04.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:04.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:04.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-87"} : dispatch 2024-09-21T13:49:04.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-87"} : dispatch 2024-09-21T13:49:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:05 smithi162 ceph-mon[33046]: osdmap e463: 8 total, 8 up, 8 in 2024-09-21T13:49:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:05 smithi162 ceph-mon[33046]: pgmap v692: 196 pgs: 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:49:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:05 smithi002 ceph-mon[30076]: osdmap e463: 8 total, 8 up, 8 in 2024-09-21T13:49:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:05 smithi002 ceph-mon[30076]: pgmap v692: 196 pgs: 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:49:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:05 smithi002 ceph-mon[40622]: osdmap e463: 8 total, 8 up, 8 in 2024-09-21T13:49:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:05 smithi002 ceph-mon[40622]: pgmap v692: 196 pgs: 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:49:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:06 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:07.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:06 smithi162 ceph-mon[33046]: osdmap e464: 8 total, 8 up, 8 in 2024-09-21T13:49:07.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:07.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:06 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:06 smithi002 ceph-mon[30076]: osdmap e464: 8 total, 8 up, 8 in 2024-09-21T13:49:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:07.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:06 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:07.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:06 smithi002 ceph-mon[40622]: osdmap e464: 8 total, 8 up, 8 in 2024-09-21T13:49:07.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:07.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-90","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:08.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:08.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:07 smithi162 ceph-mon[33046]: osdmap e465: 8 total, 8 up, 8 in 2024-09-21T13:49:08.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:08.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:08.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:08.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:07 smithi162 ceph-mon[33046]: pgmap v695: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[30076]: osdmap e465: 8 total, 8 up, 8 in 2024-09-21T13:49:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[30076]: pgmap v695: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:08.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:08.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[40622]: osdmap e465: 8 total, 8 up, 8 in 2024-09-21T13:49:08.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:08.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:08.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:49:08.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:07 smithi002 ceph-mon[40622]: pgmap v695: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:08 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:49:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:08 smithi162 ceph-mon[33046]: osdmap e466: 8 total, 8 up, 8 in 2024-09-21T13:49:09.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:49:09 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:49:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:08 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:49:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:08 smithi002 ceph-mon[30076]: osdmap e466: 8 total, 8 up, 8 in 2024-09-21T13:49:09.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:08 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:49:09.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:08 smithi002 ceph-mon[40622]: osdmap e466: 8 total, 8 up, 8 in 2024-09-21T13:49:09.938 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:49:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:49:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:49:10.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:09 smithi162 ceph-mon[33046]: osdmap e467: 8 total, 8 up, 8 in 2024-09-21T13:49:10.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:09 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:10.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:09 smithi162 ceph-mon[33046]: pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 2.2 KiB/s wr, 183 op/s 2024-09-21T13:49:10.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:09 smithi002 ceph-mon[40622]: osdmap e467: 8 total, 8 up, 8 in 2024-09-21T13:49:10.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:09 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:10.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:09 smithi002 ceph-mon[40622]: pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 2.2 KiB/s wr, 183 op/s 2024-09-21T13:49:10.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:09 smithi002 ceph-mon[30076]: osdmap e467: 8 total, 8 up, 8 in 2024-09-21T13:49:10.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:09 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:10.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:09 smithi002 ceph-mon[30076]: pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 2.2 KiB/s wr, 183 op/s 2024-09-21T13:49:11.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:10 smithi162 ceph-mon[33046]: osdmap e468: 8 total, 8 up, 8 in 2024-09-21T13:49:11.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:11.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:11.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-90"} : dispatch 2024-09-21T13:49:11.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-90"} : dispatch 2024-09-21T13:49:11.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:10 smithi002 ceph-mon[40622]: osdmap e468: 8 total, 8 up, 8 in 2024-09-21T13:49:11.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:11.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:11.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-90"} : dispatch 2024-09-21T13:49:11.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-90"} : dispatch 2024-09-21T13:49:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:10 smithi002 ceph-mon[30076]: osdmap e468: 8 total, 8 up, 8 in 2024-09-21T13:49:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-90"} : dispatch 2024-09-21T13:49:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-90"} : dispatch 2024-09-21T13:49:12.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:11 smithi162 ceph-mon[33046]: osdmap e469: 8 total, 8 up, 8 in 2024-09-21T13:49:12.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:11 smithi162 ceph-mon[33046]: pgmap v701: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 255 B/s wr, 180 op/s 2024-09-21T13:49:12.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:11 smithi002 ceph-mon[40622]: osdmap e469: 8 total, 8 up, 8 in 2024-09-21T13:49:12.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:11 smithi002 ceph-mon[40622]: pgmap v701: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 255 B/s wr, 180 op/s 2024-09-21T13:49:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:11 smithi002 ceph-mon[30076]: osdmap e469: 8 total, 8 up, 8 in 2024-09-21T13:49:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:11 smithi002 ceph-mon[30076]: pgmap v701: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 255 B/s wr, 180 op/s 2024-09-21T13:49:13.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:12 smithi162 ceph-mon[33046]: osdmap e470: 8 total, 8 up, 8 in 2024-09-21T13:49:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:12 smithi002 ceph-mon[40622]: osdmap e470: 8 total, 8 up, 8 in 2024-09-21T13:49:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:13.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:12 smithi002 ceph-mon[30076]: osdmap e470: 8 total, 8 up, 8 in 2024-09-21T13:49:13.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:13.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-92","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:14.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:13 smithi162 ceph-mon[33046]: osdmap e471: 8 total, 8 up, 8 in 2024-09-21T13:49:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:13 smithi162 ceph-mon[33046]: pgmap v704: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:49:14.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:14.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:13 smithi002 ceph-mon[40622]: osdmap e471: 8 total, 8 up, 8 in 2024-09-21T13:49:14.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:14.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:14.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:13 smithi002 ceph-mon[40622]: pgmap v704: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:49:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:13 smithi002 ceph-mon[30076]: osdmap e471: 8 total, 8 up, 8 in 2024-09-21T13:49:14.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:14.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:14.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:13 smithi002 ceph-mon[30076]: pgmap v704: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:49:15.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:14 smithi162 ceph-mon[33046]: osdmap e472: 8 total, 8 up, 8 in 2024-09-21T13:49:15.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:14 smithi002 ceph-mon[30076]: osdmap e472: 8 total, 8 up, 8 in 2024-09-21T13:49:15.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:14 smithi002 ceph-mon[40622]: osdmap e472: 8 total, 8 up, 8 in 2024-09-21T13:49:16.251 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[40622]: osdmap e473: 8 total, 8 up, 8 in 2024-09-21T13:49:16.251 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:16.251 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:16.251 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-92"} : dispatch 2024-09-21T13:49:16.251 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-92"} : dispatch 2024-09-21T13:49:16.252 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[40622]: pgmap v707: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-21T13:49:16.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[30076]: osdmap e473: 8 total, 8 up, 8 in 2024-09-21T13:49:16.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:16.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:16.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-92"} : dispatch 2024-09-21T13:49:16.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-92"} : dispatch 2024-09-21T13:49:16.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:15 smithi002 ceph-mon[30076]: pgmap v707: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-21T13:49:16.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:15 smithi162 ceph-mon[33046]: osdmap e473: 8 total, 8 up, 8 in 2024-09-21T13:49:16.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:16.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:16.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-92"} : dispatch 2024-09-21T13:49:16.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-92"} : dispatch 2024-09-21T13:49:16.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:15 smithi162 ceph-mon[33046]: pgmap v707: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-21T13:49:17.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:16 smithi002 ceph-mon[30076]: osdmap e474: 8 total, 8 up, 8 in 2024-09-21T13:49:17.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:16 smithi002 ceph-mon[40622]: osdmap e474: 8 total, 8 up, 8 in 2024-09-21T13:49:17.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:16 smithi162 ceph-mon[33046]: osdmap e474: 8 total, 8 up, 8 in 2024-09-21T13:49:18.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:18 smithi002 ceph-mon[30076]: osdmap e475: 8 total, 8 up, 8 in 2024-09-21T13:49:18.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:18.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:18.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:18 smithi002 ceph-mon[30076]: pgmap v710: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:18.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:18 smithi002 ceph-mon[40622]: osdmap e475: 8 total, 8 up, 8 in 2024-09-21T13:49:18.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:18.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:18.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:18 smithi002 ceph-mon[40622]: pgmap v710: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:18.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:18 smithi162 ceph-mon[33046]: osdmap e475: 8 total, 8 up, 8 in 2024-09-21T13:49:18.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:18.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-94","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:18.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:18 smithi162 ceph-mon[33046]: pgmap v710: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:19.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:19 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:19.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:19.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:19 smithi002 ceph-mon[30076]: osdmap e476: 8 total, 8 up, 8 in 2024-09-21T13:49:19.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:19.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:19 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:19.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:19 smithi002 ceph-mon[40622]: osdmap e476: 8 total, 8 up, 8 in 2024-09-21T13:49:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:19.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:49:19 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:49:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:19 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:19 smithi162 ceph-mon[33046]: osdmap e476: 8 total, 8 up, 8 in 2024-09-21T13:49:19.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:20.007 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:49:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:49:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:49:20.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:20 smithi002 ceph-mon[30076]: osdmap e477: 8 total, 8 up, 8 in 2024-09-21T13:49:20.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:20.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:20 smithi002 ceph-mon[30076]: pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:49:20.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:20 smithi002 ceph-mon[40622]: osdmap e477: 8 total, 8 up, 8 in 2024-09-21T13:49:20.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:20.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:20 smithi002 ceph-mon[40622]: pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:49:20.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:20 smithi162 ceph-mon[33046]: osdmap e477: 8 total, 8 up, 8 in 2024-09-21T13:49:20.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:20.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:20 smithi162 ceph-mon[33046]: pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:49:21.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:21 smithi002 ceph-mon[30076]: osdmap e478: 8 total, 8 up, 8 in 2024-09-21T13:49:21.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:21 smithi002 ceph-mon[40622]: osdmap e478: 8 total, 8 up, 8 in 2024-09-21T13:49:21.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:21 smithi162 ceph-mon[33046]: osdmap e478: 8 total, 8 up, 8 in 2024-09-21T13:49:22.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:22 smithi002 ceph-mon[30076]: pgmap v715: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:49:22.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:22 smithi002 ceph-mon[40622]: pgmap v715: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:49:22.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:22 smithi162 ceph-mon[33046]: pgmap v715: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T13:49:23.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:23 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:23.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:23 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:23.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:23 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:24.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:24 smithi162 ceph-mon[33046]: pgmap v716: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T13:49:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:24 smithi002 ceph-mon[30076]: pgmap v716: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T13:49:24.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:24 smithi002 ceph-mon[40622]: pgmap v716: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T13:49:26.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:26 smithi162 ceph-mon[33046]: pgmap v717: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-21T13:49:27.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:26 smithi002 ceph-mon[30076]: pgmap v717: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-21T13:49:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:26 smithi002 ceph-mon[40622]: pgmap v717: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-21T13:49:28.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:28 smithi162 ceph-mon[33046]: pgmap v718: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 237 B/s wr, 2 op/s 2024-09-21T13:49:28.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:28 smithi002 ceph-mon[30076]: pgmap v718: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 237 B/s wr, 2 op/s 2024-09-21T13:49:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:28 smithi002 ceph-mon[40622]: pgmap v718: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 237 B/s wr, 2 op/s 2024-09-21T13:49:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:29.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:49:29 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:49:30.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:49:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:49:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:49:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:30 smithi162 ceph-mon[33046]: pgmap v719: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T13:49:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:30 smithi002 ceph-mon[30076]: pgmap v719: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T13:49:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:30 smithi002 ceph-mon[40622]: pgmap v719: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T13:49:31.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:31 smithi162 ceph-mon[33046]: osdmap e479: 8 total, 8 up, 8 in 2024-09-21T13:49:32.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:31 smithi002 ceph-mon[30076]: osdmap e479: 8 total, 8 up, 8 in 2024-09-21T13:49:32.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:31 smithi002 ceph-mon[40622]: osdmap e479: 8 total, 8 up, 8 in 2024-09-21T13:49:32.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:32 smithi162 ceph-mon[33046]: pgmap v721: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T13:49:33.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:32 smithi002 ceph-mon[30076]: pgmap v721: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T13:49:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:32 smithi002 ceph-mon[40622]: pgmap v721: 228 pgs: 228 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T13:49:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:34 smithi162 ceph-mon[33046]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:34 smithi002 ceph-mon[30076]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:34 smithi002 ceph-mon[40622]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:36.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:36 smithi162 ceph-mon[33046]: pgmap v723: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:36 smithi002 ceph-mon[30076]: pgmap v723: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:36 smithi002 ceph-mon[40622]: pgmap v723: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:38.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:38 smithi162 ceph-mon[33046]: pgmap v724: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:38.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:38 smithi162 ceph-mon[33046]: osdmap e480: 8 total, 8 up, 8 in 2024-09-21T13:49:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:38 smithi002 ceph-mon[30076]: pgmap v724: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:38 smithi002 ceph-mon[30076]: osdmap e480: 8 total, 8 up, 8 in 2024-09-21T13:49:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:38 smithi002 ceph-mon[40622]: pgmap v724: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:38 smithi002 ceph-mon[40622]: osdmap e480: 8 total, 8 up, 8 in 2024-09-21T13:49:39.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:49:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:49:40.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:49:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:49:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:49:40.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:40 smithi162 ceph-mon[33046]: pgmap v726: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:40 smithi002 ceph-mon[30076]: pgmap v726: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:40 smithi002 ceph-mon[40622]: pgmap v726: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:41.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:41.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:41.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-94"} : dispatch 2024-09-21T13:49:41.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-94"} : dispatch 2024-09-21T13:49:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-94"} : dispatch 2024-09-21T13:49:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-94"} : dispatch 2024-09-21T13:49:42.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-94"} : dispatch 2024-09-21T13:49:42.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-94"} : dispatch 2024-09-21T13:49:42.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:42 smithi162 ceph-mon[33046]: pgmap v727: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:42.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:42 smithi162 ceph-mon[33046]: osdmap e481: 8 total, 8 up, 8 in 2024-09-21T13:49:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:42 smithi002 ceph-mon[30076]: pgmap v727: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:42 smithi002 ceph-mon[30076]: osdmap e481: 8 total, 8 up, 8 in 2024-09-21T13:49:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:42 smithi002 ceph-mon[40622]: pgmap v727: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:49:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:42 smithi002 ceph-mon[40622]: osdmap e481: 8 total, 8 up, 8 in 2024-09-21T13:49:43.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:43 smithi162 ceph-mon[33046]: osdmap e482: 8 total, 8 up, 8 in 2024-09-21T13:49:43.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:43.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:43 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:43.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:43 smithi002 ceph-mon[30076]: osdmap e482: 8 total, 8 up, 8 in 2024-09-21T13:49:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:43 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:43 smithi002 ceph-mon[40622]: osdmap e482: 8 total, 8 up, 8 in 2024-09-21T13:49:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:43 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-96","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:44.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:44 smithi162 ceph-mon[33046]: pgmap v730: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:44.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:44 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:44.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:44 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:44 smithi162 ceph-mon[33046]: osdmap e483: 8 total, 8 up, 8 in 2024-09-21T13:49:44.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:44 smithi002 ceph-mon[30076]: pgmap v730: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:44 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:44 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:44 smithi002 ceph-mon[30076]: osdmap e483: 8 total, 8 up, 8 in 2024-09-21T13:49:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:44 smithi002 ceph-mon[40622]: pgmap v730: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:44 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:44 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:44 smithi002 ceph-mon[40622]: osdmap e483: 8 total, 8 up, 8 in 2024-09-21T13:49:45.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:49:45.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:45 smithi162 ceph-mon[33046]: osdmap e484: 8 total, 8 up, 8 in 2024-09-21T13:49:45.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:45 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:49:46.001 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:45 smithi002 ceph-mon[40622]: osdmap e484: 8 total, 8 up, 8 in 2024-09-21T13:49:46.001 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:45 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:49:46.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:45 smithi002 ceph-mon[30076]: osdmap e484: 8 total, 8 up, 8 in 2024-09-21T13:49:46.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:45 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:49:46.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: pgmap v733: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi162 to 3248M 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: Adjusting osd_memory_target on smithi002 to 3249M 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:49:46.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:49:46.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:49:46.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:49:46.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:46 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:49:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: pgmap v733: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi162 to 3248M 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: Adjusting osd_memory_target on smithi002 to 3249M 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: pgmap v733: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T13:49:47.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi162 to 3248M 2024-09-21T13:49:47.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: Adjusting osd_memory_target on smithi002 to 3249M 2024-09-21T13:49:47.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:49:47.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:49:47.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:49:47.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:49:47.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:46 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:49:49.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:48 smithi162 ceph-mon[33046]: pgmap v734: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 865 B/s rd, 173 B/s wr, 1 op/s 2024-09-21T13:49:49.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:48 smithi002 ceph-mon[30076]: pgmap v734: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 865 B/s rd, 173 B/s wr, 1 op/s 2024-09-21T13:49:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:48 smithi002 ceph-mon[40622]: pgmap v734: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 865 B/s rd, 173 B/s wr, 1 op/s 2024-09-21T13:49:49.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:49:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:49:50.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:49:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:49:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:49:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:50 smithi002 ceph-mon[30076]: pgmap v735: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 889 B/s wr, 3 op/s 2024-09-21T13:49:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:50 smithi002 ceph-mon[40622]: pgmap v735: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 889 B/s wr, 3 op/s 2024-09-21T13:49:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:49:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:50 smithi162 ceph-mon[33046]: pgmap v735: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 889 B/s wr, 3 op/s 2024-09-21T13:49:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:52 smithi002 ceph-mon[30076]: pgmap v736: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 639 B/s wr, 1 op/s 2024-09-21T13:49:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:52 smithi002 ceph-mon[40622]: pgmap v736: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 639 B/s wr, 1 op/s 2024-09-21T13:49:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:52 smithi162 ceph-mon[33046]: pgmap v736: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 639 B/s wr, 1 op/s 2024-09-21T13:49:54.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:53 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:53 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:53 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:54 smithi002 ceph-mon[30076]: pgmap v737: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 516 B/s wr, 2 op/s 2024-09-21T13:49:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:54 smithi002 ceph-mon[40622]: pgmap v737: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 516 B/s wr, 2 op/s 2024-09-21T13:49:55.100 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:49:54 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1[50496]: 2024-09-21T13:49:54.749+0000 7f52a89ed640 -1 snap_mapper.add_oid found existing snaps mapped on 107:0bac17f2:test-rados-api-smithi002-76734-97::foo:21, removing 2024-09-21T13:49:55.101 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:49:54 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3[62290]: 2024-09-21T13:49:54.749+0000 7fef6811e640 -1 snap_mapper.add_oid found existing snaps mapped on 107:0bac17f2:test-rados-api-smithi002-76734-97::foo:21, removing 2024-09-21T13:49:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:54 smithi162 ceph-mon[33046]: pgmap v737: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 516 B/s wr, 2 op/s 2024-09-21T13:49:55.233 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:49:54 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:49:54.748+0000 7fc0d43dd640 -1 snap_mapper.add_oid found existing snaps mapped on 107:0bac17f2:test-rados-api-smithi002-76734-97::foo:21, removing 2024-09-21T13:49:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-96"} : dispatch 2024-09-21T13:49:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-96"} : dispatch 2024-09-21T13:49:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-96"} : dispatch 2024-09-21T13:49:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-96"} : dispatch 2024-09-21T13:49:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:49:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-96"} : dispatch 2024-09-21T13:49:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-96"} : dispatch 2024-09-21T13:49:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:56 smithi002 ceph-mon[30076]: pgmap v738: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 469 B/s wr, 1 op/s 2024-09-21T13:49:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:56 smithi002 ceph-mon[30076]: osdmap e485: 8 total, 8 up, 8 in 2024-09-21T13:49:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:56 smithi002 ceph-mon[40622]: pgmap v738: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 469 B/s wr, 1 op/s 2024-09-21T13:49:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:56 smithi002 ceph-mon[40622]: osdmap e485: 8 total, 8 up, 8 in 2024-09-21T13:49:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:56 smithi162 ceph-mon[33046]: pgmap v738: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 469 B/s wr, 1 op/s 2024-09-21T13:49:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:56 smithi162 ceph-mon[33046]: osdmap e485: 8 total, 8 up, 8 in 2024-09-21T13:49:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:57 smithi002 ceph-mon[30076]: osdmap e486: 8 total, 8 up, 8 in 2024-09-21T13:49:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:57 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:57 smithi002 ceph-mon[30076]: osdmap e487: 8 total, 8 up, 8 in 2024-09-21T13:49:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:57 smithi002 ceph-mon[40622]: osdmap e486: 8 total, 8 up, 8 in 2024-09-21T13:49:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:57 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:58.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:57 smithi002 ceph-mon[40622]: osdmap e487: 8 total, 8 up, 8 in 2024-09-21T13:49:58.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:57 smithi162 ceph-mon[33046]: osdmap e486: 8 total, 8 up, 8 in 2024-09-21T13:49:58.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:58.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-98","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:49:58.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:57 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:49:58.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:57 smithi162 ceph-mon[33046]: osdmap e487: 8 total, 8 up, 8 in 2024-09-21T13:49:59.079 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:58 smithi162 ceph-mon[33046]: pgmap v741: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:49:59.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:49:59.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:49:59.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:58 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:59.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:59.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:49:59.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:58 smithi162 ceph-mon[33046]: osdmap e488: 8 total, 8 up, 8 in 2024-09-21T13:49:59.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-98", "mode": "writeback"} : dispatch 2024-09-21T13:49:59.080 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:58 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-98", "mode": "writeback"} : dispatch 2024-09-21T13:49:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[30076]: pgmap v741: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:49:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:49:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:49:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:49:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[30076]: osdmap e488: 8 total, 8 up, 8 in 2024-09-21T13:49:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-98", "mode": "writeback"} : dispatch 2024-09-21T13:49:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-98", "mode": "writeback"} : dispatch 2024-09-21T13:49:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[40622]: pgmap v741: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:49:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:49:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:49:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:49:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:49:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:49:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[40622]: osdmap e488: 8 total, 8 up, 8 in 2024-09-21T13:49:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-98", "mode": "writeback"} : dispatch 2024-09-21T13:49:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:58 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-98", "mode": "writeback"} : dispatch 2024-09-21T13:49:59.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:49:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:50:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:49:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:49:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:50:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:59 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-98", "mode": "writeback"}]': finished 2024-09-21T13:50:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:59 smithi002 ceph-mon[30076]: osdmap e489: 8 total, 8 up, 8 in 2024-09-21T13:50:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:49:59 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:59 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-98", "mode": "writeback"}]': finished 2024-09-21T13:50:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:59 smithi002 ceph-mon[40622]: osdmap e489: 8 total, 8 up, 8 in 2024-09-21T13:50:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:00.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:49:59 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:00.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:59 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:00.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-98", "mode": "writeback"}]': finished 2024-09-21T13:50:00.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:59 smithi162 ceph-mon[33046]: osdmap e489: 8 total, 8 up, 8 in 2024-09-21T13:50:00.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:00.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:49:59 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 op/s 2024-09-21T13:50:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 1 pool(s) do not have an application enabled 2024-09-21T13:50:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2024-09-21T13:50:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: pool 'test-rados-api-smithi002-76734-98' with cache_mode writeback needs hit_set_type to be set but it is not 2024-09-21T13:50:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-21T13:50:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-21T13:50:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-21T13:50:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-98"}]': finished 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: osdmap e490: 8 total, 8 up, 8 in 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 op/s 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 1 pool(s) do not have an application enabled 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: pool 'test-rados-api-smithi002-76734-98' with cache_mode writeback needs hit_set_type to be set but it is not 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-21T13:50:01.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-98"}]': finished 2024-09-21T13:50:01.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: osdmap e490: 8 total, 8 up, 8 in 2024-09-21T13:50:01.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:50:01.102 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:50:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 op/s 2024-09-21T13:50:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 1 pool(s) do not have an application enabled 2024-09-21T13:50:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2024-09-21T13:50:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: pool 'test-rados-api-smithi002-76734-98' with cache_mode writeback needs hit_set_type to be set but it is not 2024-09-21T13:50:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-21T13:50:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-21T13:50:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-21T13:50:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-98"}]': finished 2024-09-21T13:50:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: osdmap e490: 8 total, 8 up, 8 in 2024-09-21T13:50:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:50:01.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:50:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:01 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:50:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:01 smithi002 ceph-mon[30076]: osdmap e491: 8 total, 8 up, 8 in 2024-09-21T13:50:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T13:50:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T13:50:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:01 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:50:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:01 smithi002 ceph-mon[40622]: osdmap e491: 8 total, 8 up, 8 in 2024-09-21T13:50:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T13:50:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T13:50:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:01 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:50:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:01 smithi162 ceph-mon[33046]: osdmap e491: 8 total, 8 up, 8 in 2024-09-21T13:50:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T13:50:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_count","val": "1"} : dispatch 2024-09-21T13:50:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:02 smithi002 ceph-mon[30076]: pgmap v747: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:50:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_count","val": "1"}]': finished 2024-09-21T13:50:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:02 smithi002 ceph-mon[30076]: osdmap e492: 8 total, 8 up, 8 in 2024-09-21T13:50:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:02 smithi002 ceph-mon[40622]: pgmap v747: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:50:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_count","val": "1"}]': finished 2024-09-21T13:50:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:02 smithi002 ceph-mon[40622]: osdmap e492: 8 total, 8 up, 8 in 2024-09-21T13:50:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:03.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:02 smithi162 ceph-mon[33046]: pgmap v747: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T13:50:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_count","val": "1"}]': finished 2024-09-21T13:50:03.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:02 smithi162 ceph-mon[33046]: osdmap e492: 8 total, 8 up, 8 in 2024-09-21T13:50:03.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:03.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:03 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:50:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:03 smithi002 ceph-mon[30076]: osdmap e493: 8 total, 8 up, 8 in 2024-09-21T13:50:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T13:50:04.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T13:50:04.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:03 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:04.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:50:04.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:03 smithi002 ceph-mon[40622]: osdmap e493: 8 total, 8 up, 8 in 2024-09-21T13:50:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T13:50:04.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T13:50:04.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:03 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:04.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:50:04.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:03 smithi162 ceph-mon[33046]: osdmap e493: 8 total, 8 up, 8 in 2024-09-21T13:50:04.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T13:50:04.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "target_max_objects","val": "250"} : dispatch 2024-09-21T13:50:05.074 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:04 smithi162 ceph-mon[33046]: pgmap v750: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:05.074 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "target_max_objects","val": "250"}]': finished 2024-09-21T13:50:05.074 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:04 smithi162 ceph-mon[33046]: osdmap e494: 8 total, 8 up, 8 in 2024-09-21T13:50:05.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:04 smithi002 ceph-mon[40622]: pgmap v750: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:05.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "target_max_objects","val": "250"}]': finished 2024-09-21T13:50:05.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:04 smithi002 ceph-mon[40622]: osdmap e494: 8 total, 8 up, 8 in 2024-09-21T13:50:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:04 smithi002 ceph-mon[30076]: pgmap v750: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-98","var": "target_max_objects","val": "250"}]': finished 2024-09-21T13:50:05.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:04 smithi002 ceph-mon[30076]: osdmap e494: 8 total, 8 up, 8 in 2024-09-21T13:50:05.482 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:50:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=sqlstore.transactions t=2024-09-21T13:50:05.074491576Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T13:50:05.483 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:50:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=sqlstore.transactions t=2024-09-21T13:50:05.085016836Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-09-21T13:50:05.483 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:50:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=cleanup t=2024-09-21T13:50:05.086765334Z level=info msg="Completed cleanup jobs" duration=21.630527ms 2024-09-21T13:50:05.483 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:50:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=plugins.update.checker t=2024-09-21T13:50:05.2087361Z level=info msg="Update check succeeded" duration=59.656519ms 2024-09-21T13:50:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:06.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:06.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:06.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:06 smithi002 ceph-mon[30076]: pgmap v753: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:50:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:06 smithi002 ceph-mon[30076]: osdmap e495: 8 total, 8 up, 8 in 2024-09-21T13:50:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:07.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:06 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:06 smithi002 ceph-mon[40622]: pgmap v753: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:07.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:50:07.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:06 smithi002 ceph-mon[40622]: osdmap e495: 8 total, 8 up, 8 in 2024-09-21T13:50:07.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:07.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:06 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:06 smithi162 ceph-mon[33046]: pgmap v753: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:50:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:06 smithi162 ceph-mon[33046]: osdmap e495: 8 total, 8 up, 8 in 2024-09-21T13:50:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:07.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:06 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98"} : dispatch 2024-09-21T13:50:08.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:07 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98"}]': finished 2024-09-21T13:50:08.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:07 smithi002 ceph-mon[30076]: osdmap e496: 8 total, 8 up, 8 in 2024-09-21T13:50:08.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:07 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98"}]': finished 2024-09-21T13:50:08.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:07 smithi002 ceph-mon[40622]: osdmap e496: 8 total, 8 up, 8 in 2024-09-21T13:50:08.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:07 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-98"}]': finished 2024-09-21T13:50:08.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:07 smithi162 ceph-mon[33046]: osdmap e496: 8 total, 8 up, 8 in 2024-09-21T13:50:09.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:08 smithi162 ceph-mon[33046]: pgmap v756: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:09.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:08 smithi162 ceph-mon[33046]: osdmap e497: 8 total, 8 up, 8 in 2024-09-21T13:50:09.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:08 smithi002 ceph-mon[30076]: pgmap v756: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:09.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:08 smithi002 ceph-mon[30076]: osdmap e497: 8 total, 8 up, 8 in 2024-09-21T13:50:09.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:08 smithi002 ceph-mon[40622]: pgmap v756: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:09.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:08 smithi002 ceph-mon[40622]: osdmap e497: 8 total, 8 up, 8 in 2024-09-21T13:50:09.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:50:09 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:50:10.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:50:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:50:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:50:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:09 smithi002 ceph-mon[30076]: osdmap e498: 8 total, 8 up, 8 in 2024-09-21T13:50:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:09 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:10.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:09 smithi002 ceph-mon[40622]: osdmap e498: 8 total, 8 up, 8 in 2024-09-21T13:50:10.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:10.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:09 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:10.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:09 smithi162 ceph-mon[33046]: osdmap e498: 8 total, 8 up, 8 in 2024-09-21T13:50:10.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:10.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:09 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-100","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[40622]: pgmap v759: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[40622]: osdmap e499: 8 total, 8 up, 8 in 2024-09-21T13:50:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:50:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:50:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[30076]: pgmap v759: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[30076]: osdmap e499: 8 total, 8 up, 8 in 2024-09-21T13:50:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:50:11.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:10 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:50:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:10 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:10 smithi162 ceph-mon[33046]: pgmap v759: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:10 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:11.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:11.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:10 smithi162 ceph-mon[33046]: osdmap e499: 8 total, 8 up, 8 in 2024-09-21T13:50:11.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:50:11.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:10 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:50:12.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:50:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:11 smithi162 ceph-mon[33046]: osdmap e500: 8 total, 8 up, 8 in 2024-09-21T13:50:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:50:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:11 smithi002 ceph-mon[30076]: osdmap e500: 8 total, 8 up, 8 in 2024-09-21T13:50:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:12.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:50:12.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:11 smithi002 ceph-mon[40622]: osdmap e500: 8 total, 8 up, 8 in 2024-09-21T13:50:12.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:12.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:13.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:12 smithi162 ceph-mon[33046]: pgmap v762: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-100"}]': finished 2024-09-21T13:50:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:12 smithi162 ceph-mon[33046]: osdmap e501: 8 total, 8 up, 8 in 2024-09-21T13:50:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-100", "mode": "writeback"} : dispatch 2024-09-21T13:50:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-100", "mode": "writeback"} : dispatch 2024-09-21T13:50:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:12 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:13.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-100", "mode": "writeback"}]': finished 2024-09-21T13:50:13.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[30076]: pgmap v762: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:13.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-100"}]': finished 2024-09-21T13:50:13.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[30076]: osdmap e501: 8 total, 8 up, 8 in 2024-09-21T13:50:13.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-100", "mode": "writeback"} : dispatch 2024-09-21T13:50:13.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-100", "mode": "writeback"} : dispatch 2024-09-21T13:50:13.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:13.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-100", "mode": "writeback"}]': finished 2024-09-21T13:50:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[40622]: pgmap v762: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-6", "overlaypool": "test-rados-api-smithi002-76734-100"}]': finished 2024-09-21T13:50:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[40622]: osdmap e501: 8 total, 8 up, 8 in 2024-09-21T13:50:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-100", "mode": "writeback"} : dispatch 2024-09-21T13:50:13.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-100", "mode": "writeback"} : dispatch 2024-09-21T13:50:13.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:13.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-100", "mode": "writeback"}]': finished 2024-09-21T13:50:14.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:13 smithi162 ceph-mon[33046]: osdmap e502: 8 total, 8 up, 8 in 2024-09-21T13:50:14.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:50:14.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:50:14.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:50:14.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:14.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:50:14.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:13 smithi162 ceph-mon[33046]: osdmap e503: 8 total, 8 up, 8 in 2024-09-21T13:50:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[30076]: osdmap e502: 8 total, 8 up, 8 in 2024-09-21T13:50:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:50:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:50:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:50:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:50:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[30076]: osdmap e503: 8 total, 8 up, 8 in 2024-09-21T13:50:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[40622]: osdmap e502: 8 total, 8 up, 8 in 2024-09-21T13:50:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:50:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:50:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:50:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:50:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:13 smithi002 ceph-mon[40622]: osdmap e503: 8 total, 8 up, 8 in 2024-09-21T13:50:15.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:14 smithi162 ceph-mon[33046]: pgmap v765: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:15.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:15.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:15.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:14 smithi002 ceph-mon[30076]: pgmap v765: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:15.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:15.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:15.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:14 smithi002 ceph-mon[40622]: pgmap v765: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:15.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:15.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:16.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:50:16.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:15 smithi162 ceph-mon[33046]: osdmap e504: 8 total, 8 up, 8 in 2024-09-21T13:50:16.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:50:16.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:15 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:50:16.251 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:50:16.251 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:15 smithi002 ceph-mon[30076]: osdmap e504: 8 total, 8 up, 8 in 2024-09-21T13:50:16.251 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:50:16.251 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:15 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:50:16.252 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:50:16.252 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:15 smithi002 ceph-mon[40622]: osdmap e504: 8 total, 8 up, 8 in 2024-09-21T13:50:16.252 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:50:16.252 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:15 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:50:17.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:16 smithi162 ceph-mon[33046]: pgmap v768: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:17.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:16 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:17.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:50:17.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:16 smithi162 ceph-mon[33046]: osdmap e505: 8 total, 8 up, 8 in 2024-09-21T13:50:17.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T13:50:17.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T13:50:17.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[40622]: pgmap v768: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:17.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:17.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:50:17.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[40622]: osdmap e505: 8 total, 8 up, 8 in 2024-09-21T13:50:17.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T13:50:17.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T13:50:17.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[30076]: pgmap v768: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:17.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:17.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:50:17.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[30076]: osdmap e505: 8 total, 8 up, 8 in 2024-09-21T13:50:17.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T13:50:17.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "min_read_recency_for_promote","val": "10000"} : dispatch 2024-09-21T13:50:18.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-21T13:50:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:17 smithi162 ceph-mon[33046]: osdmap e506: 8 total, 8 up, 8 in 2024-09-21T13:50:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:18.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:18.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-21T13:50:18.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:17 smithi002 ceph-mon[30076]: osdmap e506: 8 total, 8 up, 8 in 2024-09-21T13:50:18.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:18.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:18.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-21T13:50:18.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:17 smithi002 ceph-mon[40622]: osdmap e506: 8 total, 8 up, 8 in 2024-09-21T13:50:18.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:18.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:19.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:50:19 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:50:19.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:18 smithi162 ceph-mon[33046]: pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:19.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:50:19.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:18 smithi162 ceph-mon[33046]: osdmap e507: 8 total, 8 up, 8 in 2024-09-21T13:50:19.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:19.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:19.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:18 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:19.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[30076]: pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:19.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:50:19.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[30076]: osdmap e507: 8 total, 8 up, 8 in 2024-09-21T13:50:19.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:19.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:19.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:19.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[40622]: pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:19.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"}]': finished 2024-09-21T13:50:19.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[40622]: osdmap e507: 8 total, 8 up, 8 in 2024-09-21T13:50:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100"} : dispatch 2024-09-21T13:50:19.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:18 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:20.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:50:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:50:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:50:20.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:19 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100"}]': finished 2024-09-21T13:50:20.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:19 smithi002 ceph-mon[40622]: osdmap e508: 8 total, 8 up, 8 in 2024-09-21T13:50:20.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:19 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:20.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:19 smithi002 ceph-mon[40622]: pgmap v774: 228 pgs: 228 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:50:20.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:19 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100"}]': finished 2024-09-21T13:50:20.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:19 smithi002 ceph-mon[30076]: osdmap e508: 8 total, 8 up, 8 in 2024-09-21T13:50:20.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:19 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:20.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:19 smithi002 ceph-mon[30076]: pgmap v774: 228 pgs: 228 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:50:20.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:19 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-100"}]': finished 2024-09-21T13:50:20.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:19 smithi162 ceph-mon[33046]: osdmap e508: 8 total, 8 up, 8 in 2024-09-21T13:50:20.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:19 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:20.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:19 smithi162 ceph-mon[33046]: pgmap v774: 228 pgs: 228 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:50:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:20 smithi162 ceph-mon[33046]: osdmap e509: 8 total, 8 up, 8 in 2024-09-21T13:50:21.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:20 smithi002 ceph-mon[30076]: osdmap e509: 8 total, 8 up, 8 in 2024-09-21T13:50:21.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:20 smithi002 ceph-mon[40622]: osdmap e509: 8 total, 8 up, 8 in 2024-09-21T13:50:22.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:21 smithi162 ceph-mon[33046]: osdmap e510: 8 total, 8 up, 8 in 2024-09-21T13:50:22.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:22.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:22.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:21 smithi162 ceph-mon[33046]: pgmap v777: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:50:22.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:21 smithi002 ceph-mon[30076]: osdmap e510: 8 total, 8 up, 8 in 2024-09-21T13:50:22.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:22.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:22.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:21 smithi002 ceph-mon[30076]: pgmap v777: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:50:22.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:21 smithi002 ceph-mon[40622]: osdmap e510: 8 total, 8 up, 8 in 2024-09-21T13:50:22.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:22.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-102","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:22.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:21 smithi002 ceph-mon[40622]: pgmap v777: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:50:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:23.253 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:22 smithi162 ceph-mon[33046]: osdmap e511: 8 total, 8 up, 8 in 2024-09-21T13:50:23.253 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:50:23.253 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:50:23.253 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:50:23.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:23.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:22 smithi002 ceph-mon[40622]: osdmap e511: 8 total, 8 up, 8 in 2024-09-21T13:50:23.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:50:23.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:50:23.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:50:23.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:23.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:22 smithi002 ceph-mon[30076]: osdmap e511: 8 total, 8 up, 8 in 2024-09-21T13:50:23.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-21T13:50:23.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:50:23.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "fingerprint_algorithm","val": "sha1"} : dispatch 2024-09-21T13:50:24.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:50:24.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:23 smithi162 ceph-mon[33046]: osdmap e512: 8 total, 8 up, 8 in 2024-09-21T13:50:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:50:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:50:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:23 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:23 smithi162 ceph-mon[33046]: pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:24.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:50:24.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:50:24.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[40622]: osdmap e512: 8 total, 8 up, 8 in 2024-09-21T13:50:24.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:50:24.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:50:24.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:24.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[40622]: pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:24.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:50:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-21T13:50:24.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[30076]: osdmap e512: 8 total, 8 up, 8 in 2024-09-21T13:50:24.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:50:24.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_chunk_algorithm","val": "fastcdc"} : dispatch 2024-09-21T13:50:24.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:24.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[30076]: pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:24.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-21T13:50:25.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:24 smithi162 ceph-mon[33046]: osdmap e513: 8 total, 8 up, 8 in 2024-09-21T13:50:25.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:50:25.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:50:25.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:50:25.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:24 smithi162 ceph-mon[33046]: osdmap e514: 8 total, 8 up, 8 in 2024-09-21T13:50:25.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:24 smithi002 ceph-mon[40622]: osdmap e513: 8 total, 8 up, 8 in 2024-09-21T13:50:25.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:50:25.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:50:25.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:50:25.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:24 smithi002 ceph-mon[40622]: osdmap e514: 8 total, 8 up, 8 in 2024-09-21T13:50:25.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:24 smithi002 ceph-mon[30076]: osdmap e513: 8 total, 8 up, 8 in 2024-09-21T13:50:25.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:50:25.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_cdc_chunk_size","val": "1024"} : dispatch 2024-09-21T13:50:25.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-21T13:50:25.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:24 smithi002 ceph-mon[30076]: osdmap e514: 8 total, 8 up, 8 in 2024-09-21T13:50:26.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-102"} : dispatch 2024-09-21T13:50:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:25 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-102"} : dispatch 2024-09-21T13:50:26.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:25 smithi162 ceph-mon[33046]: pgmap v783: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:26.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:26.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:26.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-102"} : dispatch 2024-09-21T13:50:26.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:25 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-102"} : dispatch 2024-09-21T13:50:26.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:25 smithi002 ceph-mon[30076]: pgmap v783: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:26.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:26.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-6"} : dispatch 2024-09-21T13:50:26.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1081157306' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-102"} : dispatch 2024-09-21T13:50:26.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:25 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-6", "tierpool": "test-rados-api-smithi002-76734-102"} : dispatch 2024-09-21T13:50:26.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:25 smithi002 ceph-mon[40622]: pgmap v783: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:27.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:26 smithi162 ceph-mon[33046]: osdmap e515: 8 total, 8 up, 8 in 2024-09-21T13:50:27.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:26 smithi002 ceph-mon[30076]: osdmap e515: 8 total, 8 up, 8 in 2024-09-21T13:50:27.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:26 smithi002 ceph-mon[40622]: osdmap e515: 8 total, 8 up, 8 in 2024-09-21T13:50:28.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:27 smithi162 ceph-mon[33046]: osdmap e516: 8 total, 8 up, 8 in 2024-09-21T13:50:28.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:50:28.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:50:28.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:50:28.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:27 smithi162 ceph-mon[33046]: pgmap v786: 164 pgs: 164 active+clean; 583 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:28.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:27 smithi002 ceph-mon[30076]: osdmap e516: 8 total, 8 up, 8 in 2024-09-21T13:50:28.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:50:28.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:50:28.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:50:28.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:27 smithi002 ceph-mon[30076]: pgmap v786: 164 pgs: 164 active+clean; 583 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:28.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:27 smithi002 ceph-mon[40622]: osdmap e516: 8 total, 8 up, 8 in 2024-09-21T13:50:28.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:50:28.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:50:28.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:50:28.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:27 smithi002 ceph-mon[40622]: pgmap v786: 164 pgs: 164 active+clean; 583 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:29.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:50:29 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:50:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:50:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:28 smithi162 ceph-mon[33046]: osdmap e517: 8 total, 8 up, 8 in 2024-09-21T13:50:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi002-76734-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:50:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:28 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:50:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:29.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:50:29.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[30076]: osdmap e517: 8 total, 8 up, 8 in 2024-09-21T13:50:29.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi002-76734-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:50:29.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:29.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:50:29.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:29.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:50:29.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[40622]: osdmap e517: 8 total, 8 up, 8 in 2024-09-21T13:50:29.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi002-76734-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:50:29.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:29.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:50:29.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:29.962 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:50:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:50:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:50:30.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:29 smithi162 ceph-mon[33046]: osdmap e518: 8 total, 8 up, 8 in 2024-09-21T13:50:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:29 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:29 smithi162 ceph-mon[33046]: pgmap v789: 164 pgs: 164 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi002-76734-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi002-76734-104"}]': finished 2024-09-21T13:50:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:29 smithi162 ceph-mon[33046]: osdmap e519: 8 total, 8 up, 8 in 2024-09-21T13:50:30.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:29 smithi002 ceph-mon[30076]: osdmap e518: 8 total, 8 up, 8 in 2024-09-21T13:50:30.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:29 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:30.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:29 smithi002 ceph-mon[30076]: pgmap v789: 164 pgs: 164 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:30.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi002-76734-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi002-76734-104"}]': finished 2024-09-21T13:50:30.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:29 smithi002 ceph-mon[30076]: osdmap e519: 8 total, 8 up, 8 in 2024-09-21T13:50:30.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:29 smithi002 ceph-mon[40622]: osdmap e518: 8 total, 8 up, 8 in 2024-09-21T13:50:30.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:29 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:30.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:29 smithi002 ceph-mon[40622]: pgmap v789: 164 pgs: 164 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:30.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi002-76734-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi002-76734-104"}]': finished 2024-09-21T13:50:30.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:29 smithi002 ceph-mon[40622]: osdmap e519: 8 total, 8 up, 8 in 2024-09-21T13:50:32.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:31 smithi162 ceph-mon[33046]: osdmap e520: 8 total, 8 up, 8 in 2024-09-21T13:50:32.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:31 smithi162 ceph-mon[33046]: pgmap v792: 172 pgs: 8 unknown, 164 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:32.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:31 smithi002 ceph-mon[30076]: osdmap e520: 8 total, 8 up, 8 in 2024-09-21T13:50:32.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:31 smithi002 ceph-mon[30076]: pgmap v792: 172 pgs: 8 unknown, 164 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:32.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:31 smithi002 ceph-mon[40622]: osdmap e520: 8 total, 8 up, 8 in 2024-09-21T13:50:32.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:31 smithi002 ceph-mon[40622]: pgmap v792: 172 pgs: 8 unknown, 164 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:33.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:32 smithi162 ceph-mon[33046]: osdmap e521: 8 total, 8 up, 8 in 2024-09-21T13:50:33.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:33.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:32 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:33.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:32 smithi002 ceph-mon[30076]: osdmap e521: 8 total, 8 up, 8 in 2024-09-21T13:50:33.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:33.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:32 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:33.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:32 smithi002 ceph-mon[40622]: osdmap e521: 8 total, 8 up, 8 in 2024-09-21T13:50:33.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:33.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:32 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:34.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:33 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:34.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:33 smithi162 ceph-mon[33046]: osdmap e522: 8 total, 8 up, 8 in 2024-09-21T13:50:34.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:33 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:34.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:33 smithi162 ceph-mon[33046]: pgmap v795: 204 pgs: 9 creating+activating, 195 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:50:34.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:33 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:34.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:33 smithi002 ceph-mon[40622]: osdmap e522: 8 total, 8 up, 8 in 2024-09-21T13:50:34.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:33 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:34.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:33 smithi002 ceph-mon[40622]: pgmap v795: 204 pgs: 9 creating+activating, 195 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:50:34.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:33 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:34.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:33 smithi002 ceph-mon[30076]: osdmap e522: 8 total, 8 up, 8 in 2024-09-21T13:50:34.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:33 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:34.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:33 smithi002 ceph-mon[30076]: pgmap v795: 204 pgs: 9 creating+activating, 195 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:50:35.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:34 smithi002 ceph-mon[30076]: osdmap e523: 8 total, 8 up, 8 in 2024-09-21T13:50:35.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:35.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:34 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:35.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:34 smithi002 ceph-mon[40622]: osdmap e523: 8 total, 8 up, 8 in 2024-09-21T13:50:35.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:35.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:34 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:35.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:34 smithi162 ceph-mon[33046]: osdmap e523: 8 total, 8 up, 8 in 2024-09-21T13:50:35.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:35.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:34 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:36.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:36.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[30076]: osdmap e524: 8 total, 8 up, 8 in 2024-09-21T13:50:36.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:36.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:36.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[30076]: pgmap v798: 236 pgs: 32 unknown, 9 creating+activating, 195 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:50:36.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"}]': finished 2024-09-21T13:50:36.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[30076]: osdmap e525: 8 total, 8 up, 8 in 2024-09-21T13:50:36.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-107", "overlaypool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:36.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-107", "overlaypool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:36.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:36.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[40622]: osdmap e524: 8 total, 8 up, 8 in 2024-09-21T13:50:36.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:36.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:36.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[40622]: pgmap v798: 236 pgs: 32 unknown, 9 creating+activating, 195 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:50:36.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"}]': finished 2024-09-21T13:50:36.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[40622]: osdmap e525: 8 total, 8 up, 8 in 2024-09-21T13:50:36.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-107", "overlaypool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:36.352 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:35 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-107", "overlaypool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:36.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:36.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:35 smithi162 ceph-mon[33046]: osdmap e524: 8 total, 8 up, 8 in 2024-09-21T13:50:36.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:36.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:36.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:35 smithi162 ceph-mon[33046]: pgmap v798: 236 pgs: 32 unknown, 9 creating+activating, 195 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:50:36.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"}]': finished 2024-09-21T13:50:36.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:35 smithi162 ceph-mon[33046]: osdmap e525: 8 total, 8 up, 8 in 2024-09-21T13:50:36.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-107", "overlaypool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:36.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:35 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-107", "overlaypool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:38.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-107", "overlaypool": "test-rados-api-smithi002-76734-107-cache"}]': finished 2024-09-21T13:50:38.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:37 smithi002 ceph-mon[30076]: osdmap e526: 8 total, 8 up, 8 in 2024-09-21T13:50:38.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:37 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-107-cache", "mode": "writeback"} : dispatch 2024-09-21T13:50:38.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:37 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-107-cache", "mode": "writeback"} : dispatch 2024-09-21T13:50:38.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:37 smithi002 ceph-mon[30076]: pgmap v801: 236 pgs: 32 unknown, 9 creating+activating, 195 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:38.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-107", "overlaypool": "test-rados-api-smithi002-76734-107-cache"}]': finished 2024-09-21T13:50:38.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:37 smithi002 ceph-mon[40622]: osdmap e526: 8 total, 8 up, 8 in 2024-09-21T13:50:38.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:37 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-107-cache", "mode": "writeback"} : dispatch 2024-09-21T13:50:38.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:37 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-107-cache", "mode": "writeback"} : dispatch 2024-09-21T13:50:38.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:37 smithi002 ceph-mon[40622]: pgmap v801: 236 pgs: 32 unknown, 9 creating+activating, 195 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:38.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-107", "overlaypool": "test-rados-api-smithi002-76734-107-cache"}]': finished 2024-09-21T13:50:38.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:37 smithi162 ceph-mon[33046]: osdmap e526: 8 total, 8 up, 8 in 2024-09-21T13:50:38.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:37 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-107-cache", "mode": "writeback"} : dispatch 2024-09-21T13:50:38.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:37 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-107-cache", "mode": "writeback"} : dispatch 2024-09-21T13:50:38.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:37 smithi162 ceph-mon[33046]: pgmap v801: 236 pgs: 32 unknown, 9 creating+activating, 195 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:39.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:38 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:39.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-107-cache", "mode": "writeback"}]': finished 2024-09-21T13:50:39.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:38 smithi002 ceph-mon[30076]: osdmap e527: 8 total, 8 up, 8 in 2024-09-21T13:50:39.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:38 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-107"} : dispatch 2024-09-21T13:50:39.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:38 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-107"} : dispatch 2024-09-21T13:50:39.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:38 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:39.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-107-cache", "mode": "writeback"}]': finished 2024-09-21T13:50:39.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:38 smithi002 ceph-mon[40622]: osdmap e527: 8 total, 8 up, 8 in 2024-09-21T13:50:39.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:38 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-107"} : dispatch 2024-09-21T13:50:39.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:38 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-107"} : dispatch 2024-09-21T13:50:39.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:38 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:39.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-107-cache", "mode": "writeback"}]': finished 2024-09-21T13:50:39.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:38 smithi162 ceph-mon[33046]: osdmap e527: 8 total, 8 up, 8 in 2024-09-21T13:50:39.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:38 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-107"} : dispatch 2024-09-21T13:50:39.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:38 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-107"} : dispatch 2024-09-21T13:50:39.483 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:50:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:50:39.999 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:50:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:50:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:50:40.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-107"}]': finished 2024-09-21T13:50:40.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:40 smithi002 ceph-mon[40622]: osdmap e528: 8 total, 8 up, 8 in 2024-09-21T13:50:40.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:40.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:40.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:40.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:40 smithi002 ceph-mon[40622]: pgmap v804: 236 pgs: 236 active+clean; 583 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:50:40.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-107"}]': finished 2024-09-21T13:50:40.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:39 smithi002 ceph-mon[30076]: osdmap e528: 8 total, 8 up, 8 in 2024-09-21T13:50:40.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:40.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:40.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:39 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:40.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:39 smithi002 ceph-mon[30076]: pgmap v804: 236 pgs: 236 active+clean; 583 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:50:40.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-107"}]': finished 2024-09-21T13:50:40.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:40 smithi162 ceph-mon[33046]: osdmap e528: 8 total, 8 up, 8 in 2024-09-21T13:50:40.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1742597588' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:40.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"} : dispatch 2024-09-21T13:50:40.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:40.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:40 smithi162 ceph-mon[33046]: pgmap v804: 236 pgs: 236 active+clean; 583 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T13:50:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:41 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"}]': finished 2024-09-21T13:50:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:41 smithi002 ceph-mon[30076]: osdmap e529: 8 total, 8 up, 8 in 2024-09-21T13:50:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:41 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"}]': finished 2024-09-21T13:50:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:41 smithi002 ceph-mon[40622]: osdmap e529: 8 total, 8 up, 8 in 2024-09-21T13:50:41.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:41 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:41.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-107", "tierpool": "test-rados-api-smithi002-76734-107-cache"}]': finished 2024-09-21T13:50:41.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:41 smithi162 ceph-mon[33046]: osdmap e529: 8 total, 8 up, 8 in 2024-09-21T13:50:42.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:42 smithi002 ceph-mon[30076]: osdmap e530: 8 total, 8 up, 8 in 2024-09-21T13:50:42.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:42 smithi002 ceph-mon[30076]: pgmap v807: 204 pgs: 204 active+clean; 583 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:50:42.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:42 smithi002 ceph-mon[40622]: osdmap e530: 8 total, 8 up, 8 in 2024-09-21T13:50:42.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:42 smithi002 ceph-mon[40622]: pgmap v807: 204 pgs: 204 active+clean; 583 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:50:42.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:42 smithi162 ceph-mon[33046]: osdmap e530: 8 total, 8 up, 8 in 2024-09-21T13:50:42.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:42 smithi162 ceph-mon[33046]: pgmap v807: 204 pgs: 204 active+clean; 583 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:50:43.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:43 smithi002 ceph-mon[30076]: osdmap e531: 8 total, 8 up, 8 in 2024-09-21T13:50:43.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:43.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:43.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:50:43.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:43 smithi002 ceph-mon[40622]: osdmap e531: 8 total, 8 up, 8 in 2024-09-21T13:50:43.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:43.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:43.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:50:43.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:43 smithi162 ceph-mon[33046]: osdmap e531: 8 total, 8 up, 8 in 2024-09-21T13:50:43.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:43.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:43.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:50:44.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:50:44.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:44 smithi002 ceph-mon[40622]: osdmap e532: 8 total, 8 up, 8 in 2024-09-21T13:50:44.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:44.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:44 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:44.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:44 smithi002 ceph-mon[40622]: pgmap v810: 172 pgs: 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:44.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:50:44.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:44 smithi002 ceph-mon[30076]: osdmap e532: 8 total, 8 up, 8 in 2024-09-21T13:50:44.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:44.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:44 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:44.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:44 smithi002 ceph-mon[30076]: pgmap v810: 172 pgs: 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:44.384 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:50:44.384 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:44 smithi162 ceph-mon[33046]: osdmap e532: 8 total, 8 up, 8 in 2024-09-21T13:50:44.384 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:44.384 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:44 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:44.384 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:44 smithi162 ceph-mon[33046]: pgmap v810: 172 pgs: 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:45.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:45 smithi002 ceph-mon[30076]: osdmap e533: 8 total, 8 up, 8 in 2024-09-21T13:50:45.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:45 smithi002 ceph-mon[40622]: osdmap e533: 8 total, 8 up, 8 in 2024-09-21T13:50:45.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:45 smithi162 ceph-mon[33046]: osdmap e533: 8 total, 8 up, 8 in 2024-09-21T13:50:46.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:50:46.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:46 smithi002 ceph-mon[30076]: osdmap e534: 8 total, 8 up, 8 in 2024-09-21T13:50:46.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:46 smithi002 ceph-mon[30076]: pgmap v813: 180 pgs: 8 unknown, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:46.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:50:46.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:46 smithi002 ceph-mon[40622]: osdmap e534: 8 total, 8 up, 8 in 2024-09-21T13:50:46.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:46 smithi002 ceph-mon[40622]: pgmap v813: 180 pgs: 8 unknown, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:46.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:50:46.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:46 smithi162 ceph-mon[33046]: osdmap e534: 8 total, 8 up, 8 in 2024-09-21T13:50:46.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:46 smithi162 ceph-mon[33046]: pgmap v813: 180 pgs: 8 unknown, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:47.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:47.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[30076]: osdmap e535: 8 total, 8 up, 8 in 2024-09-21T13:50:47.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-109-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:47.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:50:47.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:50:47.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:50:47.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:50:47.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:47.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[40622]: osdmap e535: 8 total, 8 up, 8 in 2024-09-21T13:50:47.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-109-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:47.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:50:47.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:50:47.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:50:47.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:47 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:50:47.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:47 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:50:47.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:47 smithi162 ceph-mon[33046]: osdmap e535: 8 total, 8 up, 8 in 2024-09-21T13:50:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-109-cache","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:50:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:47 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:50:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:47 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:50:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:47 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:50:47.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:47 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:50:48.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:48.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[30076]: osdmap e536: 8 total, 8 up, 8 in 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"} : dispatch 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[30076]: pgmap v816: 212 pgs: 40 unknown, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"}]': finished 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[30076]: osdmap e537: 8 total, 8 up, 8 in 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-109", "overlaypool": "test-rados-api-smithi002-76734-109-cache"} : dispatch 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[40622]: osdmap e536: 8 total, 8 up, 8 in 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"} : dispatch 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[40622]: pgmap v816: 212 pgs: 40 unknown, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"}]': finished 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[40622]: osdmap e537: 8 total, 8 up, 8 in 2024-09-21T13:50:48.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-109", "overlaypool": "test-rados-api-smithi002-76734-109-cache"} : dispatch 2024-09-21T13:50:48.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:50:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:48 smithi162 ceph-mon[33046]: osdmap e536: 8 total, 8 up, 8 in 2024-09-21T13:50:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"} : dispatch 2024-09-21T13:50:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:48 smithi162 ceph-mon[33046]: pgmap v816: 212 pgs: 40 unknown, 172 active+clean; 583 KiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"}]': finished 2024-09-21T13:50:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:48 smithi162 ceph-mon[33046]: osdmap e537: 8 total, 8 up, 8 in 2024-09-21T13:50:48.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-109", "overlaypool": "test-rados-api-smithi002-76734-109-cache"} : dispatch 2024-09-21T13:50:49.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:50:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:50:50.047 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:50:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:50:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:50:50.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-109", "overlaypool": "test-rados-api-smithi002-76734-109-cache"}]': finished 2024-09-21T13:50:50.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:50 smithi002 ceph-mon[30076]: osdmap e538: 8 total, 8 up, 8 in 2024-09-21T13:50:50.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-109-cache", "mode": "writeback"} : dispatch 2024-09-21T13:50:50.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:50.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:50 smithi002 ceph-mon[30076]: pgmap v819: 212 pgs: 212 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:50.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-109", "overlaypool": "test-rados-api-smithi002-76734-109-cache"}]': finished 2024-09-21T13:50:50.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:50 smithi002 ceph-mon[40622]: osdmap e538: 8 total, 8 up, 8 in 2024-09-21T13:50:50.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-109-cache", "mode": "writeback"} : dispatch 2024-09-21T13:50:50.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:50.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:50 smithi002 ceph-mon[40622]: pgmap v819: 212 pgs: 212 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:50.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-109", "overlaypool": "test-rados-api-smithi002-76734-109-cache"}]': finished 2024-09-21T13:50:50.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:50 smithi162 ceph-mon[33046]: osdmap e538: 8 total, 8 up, 8 in 2024-09-21T13:50:50.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-109-cache", "mode": "writeback"} : dispatch 2024-09-21T13:50:50.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:50:50.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:50 smithi162 ceph-mon[33046]: pgmap v819: 212 pgs: 212 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:51.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:51 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:51.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-109-cache", "mode": "writeback"}]': finished 2024-09-21T13:50:51.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:51 smithi002 ceph-mon[30076]: osdmap e539: 8 total, 8 up, 8 in 2024-09-21T13:50:51.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:50:51.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:51 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:51.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-109-cache", "mode": "writeback"}]': finished 2024-09-21T13:50:51.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:51 smithi002 ceph-mon[40622]: osdmap e539: 8 total, 8 up, 8 in 2024-09-21T13:50:51.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:50:51.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:51 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:50:51.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-109-cache", "mode": "writeback"}]': finished 2024-09-21T13:50:51.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:51 smithi162 ceph-mon[33046]: osdmap e539: 8 total, 8 up, 8 in 2024-09-21T13:50:51.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:50:52.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:50:52.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[30076]: osdmap e540: 8 total, 8 up, 8 in 2024-09-21T13:50:52.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:52.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[30076]: pgmap v822: 212 pgs: 212 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:52.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:50:52.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[30076]: osdmap e541: 8 total, 8 up, 8 in 2024-09-21T13:50:52.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:50:52.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[40622]: osdmap e540: 8 total, 8 up, 8 in 2024-09-21T13:50:52.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:52.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[40622]: pgmap v822: 212 pgs: 212 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:52.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:50:52.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:52 smithi002 ceph-mon[40622]: osdmap e541: 8 total, 8 up, 8 in 2024-09-21T13:50:52.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:50:52.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:52 smithi162 ceph-mon[33046]: osdmap e540: 8 total, 8 up, 8 in 2024-09-21T13:50:52.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:50:52.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:52 smithi162 ceph-mon[33046]: pgmap v822: 212 pgs: 212 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:52.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:50:52.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:52 smithi162 ceph-mon[33046]: osdmap e541: 8 total, 8 up, 8 in 2024-09-21T13:50:53.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:50:53.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:53 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:53.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:50:53.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:50:53.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:53 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:53.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:50:53.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:50:53.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:53 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:50:53.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:50:54.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:54 smithi002 ceph-mon[40622]: osdmap e542: 8 total, 8 up, 8 in 2024-09-21T13:50:54.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "min_read_recency_for_promote","val": "4"} : dispatch 2024-09-21T13:50:54.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:54 smithi002 ceph-mon[40622]: pgmap v825: 212 pgs: 212 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:54.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-21T13:50:54.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:54 smithi002 ceph-mon[30076]: osdmap e542: 8 total, 8 up, 8 in 2024-09-21T13:50:54.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "min_read_recency_for_promote","val": "4"} : dispatch 2024-09-21T13:50:54.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:54 smithi002 ceph-mon[30076]: pgmap v825: 212 pgs: 212 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:54.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-21T13:50:54.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:54 smithi162 ceph-mon[33046]: osdmap e542: 8 total, 8 up, 8 in 2024-09-21T13:50:54.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "min_read_recency_for_promote","val": "4"} : dispatch 2024-09-21T13:50:54.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:54 smithi162 ceph-mon[33046]: pgmap v825: 212 pgs: 212 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:54.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-21T13:50:55.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:55 smithi002 ceph-mon[30076]: osdmap e543: 8 total, 8 up, 8 in 2024-09-21T13:50:55.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:55.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:55 smithi002 ceph-mon[40622]: osdmap e543: 8 total, 8 up, 8 in 2024-09-21T13:50:55.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:55.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:55 smithi162 ceph-mon[33046]: osdmap e543: 8 total, 8 up, 8 in 2024-09-21T13:50:55.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:50:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:56 smithi002 ceph-mon[30076]: osdmap e544: 8 total, 8 up, 8 in 2024-09-21T13:50:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"} : dispatch 2024-09-21T13:50:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:56 smithi002 ceph-mon[30076]: pgmap v828: 212 pgs: 212 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:50:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:56 smithi002 ceph-mon[40622]: osdmap e544: 8 total, 8 up, 8 in 2024-09-21T13:50:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"} : dispatch 2024-09-21T13:50:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:56 smithi002 ceph-mon[40622]: pgmap v828: 212 pgs: 212 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:56.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:50:56.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:56 smithi162 ceph-mon[33046]: osdmap e544: 8 total, 8 up, 8 in 2024-09-21T13:50:56.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"} : dispatch 2024-09-21T13:50:56.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:56 smithi162 ceph-mon[33046]: pgmap v828: 212 pgs: 212 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:50:57.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"}]': finished 2024-09-21T13:50:57.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:57 smithi002 ceph-mon[40622]: osdmap e545: 8 total, 8 up, 8 in 2024-09-21T13:50:57.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"}]': finished 2024-09-21T13:50:57.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:57 smithi002 ceph-mon[30076]: osdmap e545: 8 total, 8 up, 8 in 2024-09-21T13:50:57.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-109", "tierpool": "test-rados-api-smithi002-76734-109-cache"}]': finished 2024-09-21T13:50:57.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:57 smithi162 ceph-mon[33046]: osdmap e545: 8 total, 8 up, 8 in 2024-09-21T13:50:58.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:58 smithi002 ceph-mon[30076]: osdmap e546: 8 total, 8 up, 8 in 2024-09-21T13:50:58.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:58 smithi002 ceph-mon[30076]: pgmap v831: 180 pgs: 180 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:58.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:58 smithi002 ceph-mon[40622]: osdmap e546: 8 total, 8 up, 8 in 2024-09-21T13:50:58.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:58 smithi002 ceph-mon[40622]: pgmap v831: 180 pgs: 180 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:58.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:58 smithi162 ceph-mon[33046]: osdmap e546: 8 total, 8 up, 8 in 2024-09-21T13:50:58.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:58 smithi162 ceph-mon[33046]: pgmap v831: 180 pgs: 180 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:50:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[30076]: osdmap e547: 8 total, 8 up, 8 in 2024-09-21T13:50:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:50:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[30076]: osdmap e548: 8 total, 8 up, 8 in 2024-09-21T13:50:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[40622]: osdmap e547: 8 total, 8 up, 8 in 2024-09-21T13:50:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:59.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:50:59.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[40622]: osdmap e548: 8 total, 8 up, 8 in 2024-09-21T13:50:59.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:59.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:50:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:50:59.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:59 smithi162 ceph-mon[33046]: osdmap e547: 8 total, 8 up, 8 in 2024-09-21T13:50:59.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:50:59.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:59 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:50:59.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:50:59.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:59 smithi162 ceph-mon[33046]: osdmap e548: 8 total, 8 up, 8 in 2024-09-21T13:50:59.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:50:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-109"} : dispatch 2024-09-21T13:51:00.095 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:50:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:50:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:51:00.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:00 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:00.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:00 smithi002 ceph-mon[30076]: pgmap v834: 172 pgs: 172 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:51:00.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:51:00.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:00 smithi002 ceph-mon[30076]: osdmap e549: 8 total, 8 up, 8 in 2024-09-21T13:51:00.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:00 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:00.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:00 smithi002 ceph-mon[40622]: pgmap v834: 172 pgs: 172 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:51:00.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:51:00.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:00 smithi002 ceph-mon[40622]: osdmap e549: 8 total, 8 up, 8 in 2024-09-21T13:51:00.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:00 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:00.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:00 smithi162 ceph-mon[33046]: pgmap v834: 172 pgs: 172 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:51:00.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2810831171' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-109"}]': finished 2024-09-21T13:51:00.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:00 smithi162 ceph-mon[33046]: osdmap e549: 8 total, 8 up, 8 in 2024-09-21T13:51:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:01 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:01 smithi002 ceph-mon[30076]: osdmap e550: 8 total, 8 up, 8 in 2024-09-21T13:51:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:51:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:01 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:01.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:01 smithi002 ceph-mon[40622]: osdmap e550: 8 total, 8 up, 8 in 2024-09-21T13:51:01.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:51:01.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:01 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:01.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:01 smithi162 ceph-mon[33046]: osdmap e550: 8 total, 8 up, 8 in 2024-09-21T13:51:01.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:51:02.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:02 smithi162 ceph-mon[33046]: pgmap v837: 164 pgs: 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T13:51:02.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104"}]': finished 2024-09-21T13:51:02.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:02 smithi162 ceph-mon[33046]: osdmap e551: 8 total, 8 up, 8 in 2024-09-21T13:51:02.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:51:02.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:02 smithi002 ceph-mon[30076]: pgmap v837: 164 pgs: 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T13:51:02.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104"}]': finished 2024-09-21T13:51:02.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:02 smithi002 ceph-mon[30076]: osdmap e551: 8 total, 8 up, 8 in 2024-09-21T13:51:02.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:51:02.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:02 smithi002 ceph-mon[40622]: pgmap v837: 164 pgs: 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T13:51:02.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi002-76734-104"}]': finished 2024-09-21T13:51:02.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:02 smithi002 ceph-mon[40622]: osdmap e551: 8 total, 8 up, 8 in 2024-09-21T13:51:02.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi002-76734-104"} : dispatch 2024-09-21T13:51:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi002-76734-104"}]': finished 2024-09-21T13:51:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[30076]: osdmap e552: 8 total, 8 up, 8 in 2024-09-21T13:51:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:51:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[30076]: pgmap v840: 164 pgs: 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T13:51:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi002-76734-104"}]': finished 2024-09-21T13:51:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[40622]: osdmap e552: 8 total, 8 up, 8 in 2024-09-21T13:51:04.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:04.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:04.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:51:04.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:04 smithi002 ceph-mon[40622]: pgmap v840: 164 pgs: 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T13:51:04.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/150485008' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi002-76734-104"}]': finished 2024-09-21T13:51:04.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:04 smithi162 ceph-mon[33046]: osdmap e552: 8 total, 8 up, 8 in 2024-09-21T13:51:04.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:04.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:04.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2024-09-21T13:51:04.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:04 smithi162 ceph-mon[33046]: pgmap v840: 164 pgs: 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T13:51:05.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:51:05.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:05 smithi162 ceph-mon[33046]: osdmap e553: 8 total, 8 up, 8 in 2024-09-21T13:51:05.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:05.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:51:05.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:05 smithi002 ceph-mon[30076]: osdmap e553: 8 total, 8 up, 8 in 2024-09-21T13:51:05.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:05.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi002-76734-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-21T13:51:05.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:05 smithi002 ceph-mon[40622]: osdmap e553: 8 total, 8 up, 8 in 2024-09-21T13:51:05.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:06.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:06 smithi162 ceph-mon[33046]: osdmap e554: 8 total, 8 up, 8 in 2024-09-21T13:51:06.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:06 smithi162 ceph-mon[33046]: pgmap v843: 164 pgs: 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:51:06.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:06.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:06 smithi162 ceph-mon[33046]: osdmap e555: 8 total, 8 up, 8 in 2024-09-21T13:51:06.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:06 smithi002 ceph-mon[30076]: osdmap e554: 8 total, 8 up, 8 in 2024-09-21T13:51:06.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:06 smithi002 ceph-mon[30076]: pgmap v843: 164 pgs: 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:51:06.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:06.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:06 smithi002 ceph-mon[30076]: osdmap e555: 8 total, 8 up, 8 in 2024-09-21T13:51:06.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:06 smithi002 ceph-mon[40622]: osdmap e554: 8 total, 8 up, 8 in 2024-09-21T13:51:06.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:06 smithi002 ceph-mon[40622]: pgmap v843: 164 pgs: 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:51:06.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi002-76734-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:06.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:06 smithi002 ceph-mon[40622]: osdmap e555: 8 total, 8 up, 8 in 2024-09-21T13:51:08.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:08 smithi162 ceph-mon[33046]: osdmap e556: 8 total, 8 up, 8 in 2024-09-21T13:51:08.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-112","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:08.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:08 smithi162 ceph-mon[33046]: pgmap v846: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:08.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:08 smithi002 ceph-mon[40622]: osdmap e556: 8 total, 8 up, 8 in 2024-09-21T13:51:08.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-112","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:08.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:08 smithi002 ceph-mon[40622]: pgmap v846: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:08.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:08 smithi002 ceph-mon[30076]: osdmap e556: 8 total, 8 up, 8 in 2024-09-21T13:51:08.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-112","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:08.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:08 smithi002 ceph-mon[30076]: pgmap v846: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:09.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:51:09 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:51:09.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:09 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:09.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:09.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:09 smithi162 ceph-mon[33046]: osdmap e557: 8 total, 8 up, 8 in 2024-09-21T13:51:09.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:09.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:09 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:09.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:09.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:09 smithi002 ceph-mon[30076]: osdmap e557: 8 total, 8 up, 8 in 2024-09-21T13:51:09.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:09.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:09 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:09.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:09.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:09 smithi002 ceph-mon[40622]: osdmap e557: 8 total, 8 up, 8 in 2024-09-21T13:51:09.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:10.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:51:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:51:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:51:10.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:10.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:10 smithi162 ceph-mon[33046]: osdmap e558: 8 total, 8 up, 8 in 2024-09-21T13:51:10.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-112"} : dispatch 2024-09-21T13:51:10.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:10 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:10.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:10 smithi162 ceph-mon[33046]: pgmap v849: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:51:10.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:10.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:10 smithi002 ceph-mon[30076]: osdmap e558: 8 total, 8 up, 8 in 2024-09-21T13:51:10.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-112"} : dispatch 2024-09-21T13:51:10.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:10 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:10.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:10 smithi002 ceph-mon[30076]: pgmap v849: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:51:10.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:10.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:10 smithi002 ceph-mon[40622]: osdmap e558: 8 total, 8 up, 8 in 2024-09-21T13:51:10.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-112"} : dispatch 2024-09-21T13:51:10.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:10 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:10.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:10 smithi002 ceph-mon[40622]: pgmap v849: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:51:11.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-112"}]': finished 2024-09-21T13:51:11.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:11 smithi162 ceph-mon[33046]: osdmap e559: 8 total, 8 up, 8 in 2024-09-21T13:51:11.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:11.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-112"}]': finished 2024-09-21T13:51:11.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:11 smithi002 ceph-mon[30076]: osdmap e559: 8 total, 8 up, 8 in 2024-09-21T13:51:11.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:11.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-112"}]': finished 2024-09-21T13:51:11.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:11 smithi002 ceph-mon[40622]: osdmap e559: 8 total, 8 up, 8 in 2024-09-21T13:51:11.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:12.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:12.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:12 smithi162 ceph-mon[33046]: osdmap e560: 8 total, 8 up, 8 in 2024-09-21T13:51:12.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112"} : dispatch 2024-09-21T13:51:12.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:12 smithi162 ceph-mon[33046]: pgmap v852: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:51:12.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112"}]': finished 2024-09-21T13:51:12.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:12.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:12 smithi002 ceph-mon[30076]: osdmap e560: 8 total, 8 up, 8 in 2024-09-21T13:51:12.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112"} : dispatch 2024-09-21T13:51:12.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:12 smithi002 ceph-mon[30076]: pgmap v852: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:51:12.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112"}]': finished 2024-09-21T13:51:12.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:12.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:12 smithi002 ceph-mon[40622]: osdmap e560: 8 total, 8 up, 8 in 2024-09-21T13:51:12.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112"} : dispatch 2024-09-21T13:51:12.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:12 smithi002 ceph-mon[40622]: pgmap v852: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:51:12.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-112"}]': finished 2024-09-21T13:51:13.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:13 smithi162 ceph-mon[33046]: osdmap e561: 8 total, 8 up, 8 in 2024-09-21T13:51:13.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:13 smithi002 ceph-mon[30076]: osdmap e561: 8 total, 8 up, 8 in 2024-09-21T13:51:13.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:13 smithi002 ceph-mon[40622]: osdmap e561: 8 total, 8 up, 8 in 2024-09-21T13:51:14.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:14 smithi162 ceph-mon[33046]: osdmap e562: 8 total, 8 up, 8 in 2024-09-21T13:51:14.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:14 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:14.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:14.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:14 smithi162 ceph-mon[33046]: pgmap v855: 172 pgs: 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:51:14.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:14 smithi002 ceph-mon[40622]: osdmap e562: 8 total, 8 up, 8 in 2024-09-21T13:51:14.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:14 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:14.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:14.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:14 smithi002 ceph-mon[40622]: pgmap v855: 172 pgs: 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:51:14.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:14 smithi002 ceph-mon[30076]: osdmap e562: 8 total, 8 up, 8 in 2024-09-21T13:51:14.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:14 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:14.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:14.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:14 smithi002 ceph-mon[30076]: pgmap v855: 172 pgs: 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:51:15.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:15 smithi162 ceph-mon[33046]: osdmap e563: 8 total, 8 up, 8 in 2024-09-21T13:51:15.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-114","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:15.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:15 smithi002 ceph-mon[30076]: osdmap e563: 8 total, 8 up, 8 in 2024-09-21T13:51:15.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-114","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:15.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:15 smithi002 ceph-mon[40622]: osdmap e563: 8 total, 8 up, 8 in 2024-09-21T13:51:15.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-114","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:16.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:16.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:16 smithi162 ceph-mon[33046]: osdmap e564: 8 total, 8 up, 8 in 2024-09-21T13:51:16.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:16.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:16 smithi162 ceph-mon[33046]: pgmap v858: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:51:16.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:16.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:16 smithi002 ceph-mon[30076]: osdmap e564: 8 total, 8 up, 8 in 2024-09-21T13:51:16.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:16.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:16 smithi002 ceph-mon[30076]: pgmap v858: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:51:16.502 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:16.502 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:16 smithi002 ceph-mon[40622]: osdmap e564: 8 total, 8 up, 8 in 2024-09-21T13:51:16.502 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:16.502 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:16 smithi002 ceph-mon[40622]: pgmap v858: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:51:17.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:17.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:17 smithi162 ceph-mon[33046]: osdmap e565: 8 total, 8 up, 8 in 2024-09-21T13:51:17.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-114"} : dispatch 2024-09-21T13:51:17.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:17.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:17 smithi002 ceph-mon[30076]: osdmap e565: 8 total, 8 up, 8 in 2024-09-21T13:51:17.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-114"} : dispatch 2024-09-21T13:51:17.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:17.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:17 smithi002 ceph-mon[40622]: osdmap e565: 8 total, 8 up, 8 in 2024-09-21T13:51:17.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-114"} : dispatch 2024-09-21T13:51:18.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-114"}]': finished 2024-09-21T13:51:18.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:18 smithi162 ceph-mon[33046]: osdmap e566: 8 total, 8 up, 8 in 2024-09-21T13:51:18.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-114", "mode": "writeback"} : dispatch 2024-09-21T13:51:18.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:18 smithi162 ceph-mon[33046]: pgmap v861: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:18.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:18 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:51:18.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-114", "mode": "writeback"}]': finished 2024-09-21T13:51:18.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-114"}]': finished 2024-09-21T13:51:18.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[30076]: osdmap e566: 8 total, 8 up, 8 in 2024-09-21T13:51:18.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-114", "mode": "writeback"} : dispatch 2024-09-21T13:51:18.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[30076]: pgmap v861: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:18.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:51:18.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-114", "mode": "writeback"}]': finished 2024-09-21T13:51:18.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-114"}]': finished 2024-09-21T13:51:18.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[40622]: osdmap e566: 8 total, 8 up, 8 in 2024-09-21T13:51:18.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-114", "mode": "writeback"} : dispatch 2024-09-21T13:51:18.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[40622]: pgmap v861: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:18.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:51:18.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-114", "mode": "writeback"}]': finished 2024-09-21T13:51:19.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:19 smithi162 ceph-mon[33046]: osdmap e567: 8 total, 8 up, 8 in 2024-09-21T13:51:19.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:19.483 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:51:19 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:51:19.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:19 smithi002 ceph-mon[30076]: osdmap e567: 8 total, 8 up, 8 in 2024-09-21T13:51:19.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:19.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:19 smithi002 ceph-mon[40622]: osdmap e567: 8 total, 8 up, 8 in 2024-09-21T13:51:19.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:20.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:51:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:51:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:51:20.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:20.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:20.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:20 smithi162 ceph-mon[33046]: osdmap e568: 8 total, 8 up, 8 in 2024-09-21T13:51:20.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114"} : dispatch 2024-09-21T13:51:20.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:20 smithi162 ceph-mon[33046]: pgmap v864: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T13:51:20.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:20.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:20.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:20 smithi002 ceph-mon[30076]: osdmap e568: 8 total, 8 up, 8 in 2024-09-21T13:51:20.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114"} : dispatch 2024-09-21T13:51:20.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:20 smithi002 ceph-mon[30076]: pgmap v864: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T13:51:20.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:20.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:20.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:20 smithi002 ceph-mon[40622]: osdmap e568: 8 total, 8 up, 8 in 2024-09-21T13:51:20.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114"} : dispatch 2024-09-21T13:51:20.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:20 smithi002 ceph-mon[40622]: pgmap v864: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T13:51:21.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:21 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:51:21.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114"}]': finished 2024-09-21T13:51:21.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:21 smithi162 ceph-mon[33046]: osdmap e569: 8 total, 8 up, 8 in 2024-09-21T13:51:21.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:21 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:51:21.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114"}]': finished 2024-09-21T13:51:21.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:21 smithi002 ceph-mon[30076]: osdmap e569: 8 total, 8 up, 8 in 2024-09-21T13:51:21.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:21 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:51:21.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-114"}]': finished 2024-09-21T13:51:21.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:21 smithi002 ceph-mon[40622]: osdmap e569: 8 total, 8 up, 8 in 2024-09-21T13:51:22.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:22 smithi162 ceph-mon[33046]: osdmap e570: 8 total, 8 up, 8 in 2024-09-21T13:51:22.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:22 smithi162 ceph-mon[33046]: pgmap v867: 172 pgs: 172 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:51:22.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:22 smithi162 ceph-mon[33046]: osdmap e571: 8 total, 8 up, 8 in 2024-09-21T13:51:22.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-116","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:22.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:22 smithi002 ceph-mon[30076]: osdmap e570: 8 total, 8 up, 8 in 2024-09-21T13:51:22.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:22 smithi002 ceph-mon[30076]: pgmap v867: 172 pgs: 172 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:51:22.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:22 smithi002 ceph-mon[30076]: osdmap e571: 8 total, 8 up, 8 in 2024-09-21T13:51:22.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-116","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:22.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:22 smithi002 ceph-mon[40622]: osdmap e570: 8 total, 8 up, 8 in 2024-09-21T13:51:22.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:22 smithi002 ceph-mon[40622]: pgmap v867: 172 pgs: 172 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:51:22.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:22 smithi002 ceph-mon[40622]: osdmap e571: 8 total, 8 up, 8 in 2024-09-21T13:51:22.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-116","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:24.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:24.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:24 smithi162 ceph-mon[33046]: osdmap e572: 8 total, 8 up, 8 in 2024-09-21T13:51:24.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:24 smithi162 ceph-mon[33046]: pgmap v870: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-09-21T13:51:24.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:24.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:24 smithi002 ceph-mon[30076]: osdmap e572: 8 total, 8 up, 8 in 2024-09-21T13:51:24.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:24 smithi002 ceph-mon[30076]: pgmap v870: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-09-21T13:51:24.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:24.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:24 smithi002 ceph-mon[40622]: osdmap e572: 8 total, 8 up, 8 in 2024-09-21T13:51:24.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:24 smithi002 ceph-mon[40622]: pgmap v870: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-09-21T13:51:25.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:25 smithi162 ceph-mon[33046]: osdmap e573: 8 total, 8 up, 8 in 2024-09-21T13:51:25.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:25.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:25 smithi002 ceph-mon[30076]: osdmap e573: 8 total, 8 up, 8 in 2024-09-21T13:51:25.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:25.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:25 smithi002 ceph-mon[40622]: osdmap e573: 8 total, 8 up, 8 in 2024-09-21T13:51:25.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:26.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:26.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:26 smithi162 ceph-mon[33046]: osdmap e574: 8 total, 8 up, 8 in 2024-09-21T13:51:26.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-116"} : dispatch 2024-09-21T13:51:26.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:26 smithi162 ceph-mon[33046]: pgmap v873: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:51:26.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:26.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:26 smithi002 ceph-mon[30076]: osdmap e574: 8 total, 8 up, 8 in 2024-09-21T13:51:26.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-116"} : dispatch 2024-09-21T13:51:26.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:26 smithi002 ceph-mon[30076]: pgmap v873: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:51:26.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:26.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:26 smithi002 ceph-mon[40622]: osdmap e574: 8 total, 8 up, 8 in 2024-09-21T13:51:26.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-116"} : dispatch 2024-09-21T13:51:26.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:26 smithi002 ceph-mon[40622]: pgmap v873: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:51:27.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-116"}]': finished 2024-09-21T13:51:27.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:27 smithi162 ceph-mon[33046]: osdmap e575: 8 total, 8 up, 8 in 2024-09-21T13:51:27.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-116", "mode": "writeback"} : dispatch 2024-09-21T13:51:27.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:27 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:51:27.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-116", "mode": "writeback"}]': finished 2024-09-21T13:51:27.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-116"}]': finished 2024-09-21T13:51:27.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:27 smithi002 ceph-mon[30076]: osdmap e575: 8 total, 8 up, 8 in 2024-09-21T13:51:27.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-116", "mode": "writeback"} : dispatch 2024-09-21T13:51:27.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:27 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:51:27.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-116", "mode": "writeback"}]': finished 2024-09-21T13:51:27.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-116"}]': finished 2024-09-21T13:51:27.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:27 smithi002 ceph-mon[40622]: osdmap e575: 8 total, 8 up, 8 in 2024-09-21T13:51:27.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-116", "mode": "writeback"} : dispatch 2024-09-21T13:51:27.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:27 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:51:27.601 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-116", "mode": "writeback"}]': finished 2024-09-21T13:51:28.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:28 smithi162 ceph-mon[33046]: osdmap e576: 8 total, 8 up, 8 in 2024-09-21T13:51:28.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "325.5"} : dispatch 2024-09-21T13:51:28.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:28 smithi162 ceph-mon[33046]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "325.5"}]: dispatch 2024-09-21T13:51:28.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:28 smithi162 ceph-mon[33046]: pgmap v876: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:28.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:28 smithi002 ceph-mon[30076]: osdmap e576: 8 total, 8 up, 8 in 2024-09-21T13:51:28.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "325.5"} : dispatch 2024-09-21T13:51:28.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:28 smithi002 ceph-mon[30076]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "325.5"}]: dispatch 2024-09-21T13:51:28.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:28 smithi002 ceph-mon[30076]: pgmap v876: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:28.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:28 smithi002 ceph-mon[40622]: osdmap e576: 8 total, 8 up, 8 in 2024-09-21T13:51:28.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "pg scrub", "pgid": "325.5"} : dispatch 2024-09-21T13:51:28.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:28 smithi002 ceph-mon[40622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "325.5"}]: dispatch 2024-09-21T13:51:28.600 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:28 smithi002 ceph-mon[40622]: pgmap v876: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:29.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:51:29 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:51:29.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:29 smithi002 ceph-mon[30076]: 325.5 scrub starts 2024-09-21T13:51:29.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:29 smithi002 ceph-mon[30076]: 325.5 scrub ok 2024-09-21T13:51:29.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:29.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:29.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:51:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:51:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:51:29.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:29 smithi002 ceph-mon[40622]: 325.5 scrub starts 2024-09-21T13:51:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:29 smithi002 ceph-mon[40622]: 325.5 scrub ok 2024-09-21T13:51:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:29.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:29 smithi162 ceph-mon[33046]: 325.5 scrub starts 2024-09-21T13:51:29.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:29 smithi162 ceph-mon[33046]: 325.5 scrub ok 2024-09-21T13:51:29.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:29.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:30 smithi002 ceph-mon[40622]: pgmap v877: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 563 B/s wr, 2 op/s 2024-09-21T13:51:30.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:30.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:30 smithi002 ceph-mon[30076]: pgmap v877: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 563 B/s wr, 2 op/s 2024-09-21T13:51:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:30 smithi162 ceph-mon[33046]: pgmap v877: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 563 B/s wr, 2 op/s 2024-09-21T13:51:32.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:32 smithi162 ceph-mon[33046]: pgmap v878: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 476 B/s wr, 2 op/s 2024-09-21T13:51:33.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:32 smithi002 ceph-mon[30076]: pgmap v878: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 476 B/s wr, 2 op/s 2024-09-21T13:51:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:32 smithi002 ceph-mon[40622]: pgmap v878: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 476 B/s wr, 2 op/s 2024-09-21T13:51:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:34 smithi162 ceph-mon[33046]: pgmap v879: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T13:51:35.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:34 smithi002 ceph-mon[30076]: pgmap v879: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T13:51:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:34 smithi002 ceph-mon[40622]: pgmap v879: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-21T13:51:36.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:36 smithi162 ceph-mon[33046]: pgmap v880: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 325 B/s wr, 1 op/s 2024-09-21T13:51:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:36 smithi002 ceph-mon[40622]: pgmap v880: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 325 B/s wr, 1 op/s 2024-09-21T13:51:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:36 smithi002 ceph-mon[30076]: pgmap v880: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 325 B/s wr, 1 op/s 2024-09-21T13:51:38.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:38 smithi162 ceph-mon[33046]: pgmap v881: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 294 B/s wr, 1 op/s 2024-09-21T13:51:39.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:38 smithi002 ceph-mon[30076]: pgmap v881: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 294 B/s wr, 1 op/s 2024-09-21T13:51:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:38 smithi002 ceph-mon[40622]: pgmap v881: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 294 B/s wr, 1 op/s 2024-09-21T13:51:39.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:51:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:51:40.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:51:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:51:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:51:40.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:40.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:40 smithi162 ceph-mon[33046]: pgmap v882: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:51:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:40 smithi002 ceph-mon[30076]: pgmap v882: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:51:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:40 smithi002 ceph-mon[40622]: pgmap v882: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:51:42.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:42 smithi162 ceph-mon[33046]: pgmap v883: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T13:51:43.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:42 smithi002 ceph-mon[30076]: pgmap v883: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T13:51:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:42 smithi002 ceph-mon[40622]: pgmap v883: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T13:51:44.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:43 smithi002 ceph-mon[30076]: osdmap e577: 8 total, 8 up, 8 in 2024-09-21T13:51:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:43 smithi002 ceph-mon[40622]: osdmap e577: 8 total, 8 up, 8 in 2024-09-21T13:51:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:44.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:43 smithi162 ceph-mon[33046]: osdmap e577: 8 total, 8 up, 8 in 2024-09-21T13:51:44.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:44.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:44 smithi002 ceph-mon[30076]: pgmap v885: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:51:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:44 smithi002 ceph-mon[30076]: osdmap e578: 8 total, 8 up, 8 in 2024-09-21T13:51:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116"} : dispatch 2024-09-21T13:51:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:44 smithi002 ceph-mon[40622]: pgmap v885: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:51:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:44 smithi002 ceph-mon[40622]: osdmap e578: 8 total, 8 up, 8 in 2024-09-21T13:51:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116"} : dispatch 2024-09-21T13:51:45.133 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:44 smithi162 ceph-mon[33046]: pgmap v885: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:51:45.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:45.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:44 smithi162 ceph-mon[33046]: osdmap e578: 8 total, 8 up, 8 in 2024-09-21T13:51:45.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116"} : dispatch 2024-09-21T13:51:46.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:45 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:51:46.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:45 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116"}]': finished 2024-09-21T13:51:46.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:45 smithi002 ceph-mon[30076]: osdmap e579: 8 total, 8 up, 8 in 2024-09-21T13:51:46.001 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:45 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:51:46.001 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:45 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116"}]': finished 2024-09-21T13:51:46.001 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:45 smithi002 ceph-mon[40622]: osdmap e579: 8 total, 8 up, 8 in 2024-09-21T13:51:46.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:45 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:51:46.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:45 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-116"}]': finished 2024-09-21T13:51:46.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:45 smithi162 ceph-mon[33046]: osdmap e579: 8 total, 8 up, 8 in 2024-09-21T13:51:47.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:46 smithi002 ceph-mon[30076]: pgmap v888: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:51:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:46 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:46 smithi002 ceph-mon[30076]: osdmap e580: 8 total, 8 up, 8 in 2024-09-21T13:51:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:46 smithi002 ceph-mon[40622]: pgmap v888: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:51:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:46 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:46 smithi002 ceph-mon[40622]: osdmap e580: 8 total, 8 up, 8 in 2024-09-21T13:51:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:46 smithi162 ceph-mon[33046]: pgmap v888: 204 pgs: 204 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:51:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:46 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:46 smithi162 ceph-mon[33046]: osdmap e580: 8 total, 8 up, 8 in 2024-09-21T13:51:47.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:47 smithi162 ceph-mon[33046]: osdmap e581: 8 total, 8 up, 8 in 2024-09-21T13:51:47.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-118","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:47.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:47 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:51:47.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:47.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:47 smithi162 ceph-mon[33046]: osdmap e582: 8 total, 8 up, 8 in 2024-09-21T13:51:48.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:47 smithi002 ceph-mon[30076]: osdmap e581: 8 total, 8 up, 8 in 2024-09-21T13:51:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-118","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:47 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:51:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:47 smithi002 ceph-mon[30076]: osdmap e582: 8 total, 8 up, 8 in 2024-09-21T13:51:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:47 smithi002 ceph-mon[40622]: osdmap e581: 8 total, 8 up, 8 in 2024-09-21T13:51:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-118","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:47 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:51:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:47 smithi002 ceph-mon[40622]: osdmap e582: 8 total, 8 up, 8 in 2024-09-21T13:51:48.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:48 smithi162 ceph-mon[33046]: pgmap v891: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:48.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:48 smithi162 ceph-mon[33046]: osdmap e583: 8 total, 8 up, 8 in 2024-09-21T13:51:48.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:49.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:48 smithi002 ceph-mon[30076]: pgmap v891: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:49.091 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:48 smithi002 ceph-mon[30076]: osdmap e583: 8 total, 8 up, 8 in 2024-09-21T13:51:49.091 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:49.091 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:48 smithi002 ceph-mon[40622]: pgmap v891: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:49.091 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:48 smithi002 ceph-mon[40622]: osdmap e583: 8 total, 8 up, 8 in 2024-09-21T13:51:49.091 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:49.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:51:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:51:50.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:51:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:51:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:51:50.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:50.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:50.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[30076]: osdmap e584: 8 total, 8 up, 8 in 2024-09-21T13:51:50.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-118"} : dispatch 2024-09-21T13:51:50.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[30076]: pgmap v895: 204 pgs: 204 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 523 B/s wr, 1 op/s 2024-09-21T13:51:50.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:50.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:50.463 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:50.463 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:50.463 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[40622]: osdmap e584: 8 total, 8 up, 8 in 2024-09-21T13:51:50.463 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-118"} : dispatch 2024-09-21T13:51:50.463 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[40622]: pgmap v895: 204 pgs: 204 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 523 B/s wr, 1 op/s 2024-09-21T13:51:50.463 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:50.463 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:50 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:50.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:51:50.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:50.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:50 smithi162 ceph-mon[33046]: osdmap e584: 8 total, 8 up, 8 in 2024-09-21T13:51:50.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-118"} : dispatch 2024-09-21T13:51:50.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:50 smithi162 ceph-mon[33046]: pgmap v895: 204 pgs: 204 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 523 B/s wr, 1 op/s 2024-09-21T13:51:50.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:50 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:50.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:50 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:51.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-118"}]': finished 2024-09-21T13:51:51.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:51 smithi162 ceph-mon[33046]: osdmap e585: 8 total, 8 up, 8 in 2024-09-21T13:51:51.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-118", "mode": "writeback"} : dispatch 2024-09-21T13:51:51.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:51 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:51.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:51 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:51.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-118"}]': finished 2024-09-21T13:51:51.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:51 smithi002 ceph-mon[30076]: osdmap e585: 8 total, 8 up, 8 in 2024-09-21T13:51:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-118", "mode": "writeback"} : dispatch 2024-09-21T13:51:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:51 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:51.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:51 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:51.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-118"}]': finished 2024-09-21T13:51:51.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:51 smithi002 ceph-mon[40622]: osdmap e585: 8 total, 8 up, 8 in 2024-09-21T13:51:51.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-118", "mode": "writeback"} : dispatch 2024-09-21T13:51:51.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:51 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:51.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:51 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:52.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:52 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:51:52.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-118", "mode": "writeback"}]': finished 2024-09-21T13:51:52.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:52 smithi162 ceph-mon[33046]: osdmap e586: 8 total, 8 up, 8 in 2024-09-21T13:51:52.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:51:52.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:51:52.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:52.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:52 smithi162 ceph-mon[33046]: pgmap v898: 204 pgs: 204 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 524 B/s wr, 1 op/s 2024-09-21T13:51:52.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:52 smithi162 ceph-mon[33046]: osdmap e587: 8 total, 8 up, 8 in 2024-09-21T13:51:52.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:51:52.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-118", "mode": "writeback"}]': finished 2024-09-21T13:51:52.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[40622]: osdmap e586: 8 total, 8 up, 8 in 2024-09-21T13:51:52.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:51:52.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:51:52.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:52.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[40622]: pgmap v898: 204 pgs: 204 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 524 B/s wr, 1 op/s 2024-09-21T13:51:52.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[40622]: osdmap e587: 8 total, 8 up, 8 in 2024-09-21T13:51:52.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:51:52.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-118", "mode": "writeback"}]': finished 2024-09-21T13:51:52.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[30076]: osdmap e586: 8 total, 8 up, 8 in 2024-09-21T13:51:52.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:51:52.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:51:52.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:52.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[30076]: pgmap v898: 204 pgs: 204 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 524 B/s wr, 1 op/s 2024-09-21T13:51:52.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:52 smithi002 ceph-mon[30076]: osdmap e587: 8 total, 8 up, 8 in 2024-09-21T13:51:53.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:53.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:53 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:53.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:53.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:53 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:53.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:51:53.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:53 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:51:54.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:54 smithi002 ceph-mon[30076]: osdmap e588: 8 total, 8 up, 8 in 2024-09-21T13:51:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118"} : dispatch 2024-09-21T13:51:54.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:54 smithi002 ceph-mon[30076]: pgmap v901: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:51:54.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:54.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:54 smithi002 ceph-mon[40622]: osdmap e588: 8 total, 8 up, 8 in 2024-09-21T13:51:54.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118"} : dispatch 2024-09-21T13:51:54.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:54 smithi002 ceph-mon[40622]: pgmap v901: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:51:54.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:51:54.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:54 smithi162 ceph-mon[33046]: osdmap e588: 8 total, 8 up, 8 in 2024-09-21T13:51:54.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118"} : dispatch 2024-09-21T13:51:54.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:54 smithi162 ceph-mon[33046]: pgmap v901: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:51:55.849 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:55 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:51:55.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118"}]': finished 2024-09-21T13:51:55.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:55 smithi002 ceph-mon[40622]: osdmap e589: 8 total, 8 up, 8 in 2024-09-21T13:51:55.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:55 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:51:55.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118"}]': finished 2024-09-21T13:51:55.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:55 smithi002 ceph-mon[30076]: osdmap e589: 8 total, 8 up, 8 in 2024-09-21T13:51:55.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:55 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:51:55.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-118"}]': finished 2024-09-21T13:51:55.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:55 smithi162 ceph-mon[33046]: osdmap e589: 8 total, 8 up, 8 in 2024-09-21T13:51:56.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:56 smithi002 ceph-mon[30076]: osdmap e590: 8 total, 8 up, 8 in 2024-09-21T13:51:56.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:56 smithi002 ceph-mon[30076]: pgmap v904: 172 pgs: 172 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:51:56.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:56 smithi002 ceph-mon[40622]: osdmap e590: 8 total, 8 up, 8 in 2024-09-21T13:51:56.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:56 smithi002 ceph-mon[40622]: pgmap v904: 172 pgs: 172 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:51:56.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:56 smithi162 ceph-mon[33046]: osdmap e590: 8 total, 8 up, 8 in 2024-09-21T13:51:56.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:56 smithi162 ceph-mon[33046]: pgmap v904: 172 pgs: 172 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:51:57.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:57 smithi002 ceph-mon[40622]: osdmap e591: 8 total, 8 up, 8 in 2024-09-21T13:51:57.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-120","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:57 smithi002 ceph-mon[30076]: osdmap e591: 8 total, 8 up, 8 in 2024-09-21T13:51:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-120","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:57.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:57 smithi162 ceph-mon[33046]: osdmap e591: 8 total, 8 up, 8 in 2024-09-21T13:51:57.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-120","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:51:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[30076]: osdmap e592: 8 total, 8 up, 8 in 2024-09-21T13:51:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[30076]: pgmap v907: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[30076]: osdmap e593: 8 total, 8 up, 8 in 2024-09-21T13:51:58.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-120"} : dispatch 2024-09-21T13:51:58.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:58.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[40622]: osdmap e592: 8 total, 8 up, 8 in 2024-09-21T13:51:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[40622]: pgmap v907: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[40622]: osdmap e593: 8 total, 8 up, 8 in 2024-09-21T13:51:58.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-120"} : dispatch 2024-09-21T13:51:58.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:51:58.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:58 smithi162 ceph-mon[33046]: osdmap e592: 8 total, 8 up, 8 in 2024-09-21T13:51:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:51:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:58 smithi162 ceph-mon[33046]: pgmap v907: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:51:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:51:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:58 smithi162 ceph-mon[33046]: osdmap e593: 8 total, 8 up, 8 in 2024-09-21T13:51:58.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-120"} : dispatch 2024-09-21T13:51:59.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:51:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:51:59.849 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:59 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:59.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:59 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:59.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-120"}]': finished 2024-09-21T13:51:59.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:59 smithi002 ceph-mon[40622]: osdmap e594: 8 total, 8 up, 8 in 2024-09-21T13:51:59.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:51:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-120", "mode": "writeback"} : dispatch 2024-09-21T13:51:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:59 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:59 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-120"}]': finished 2024-09-21T13:51:59.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:59 smithi002 ceph-mon[30076]: osdmap e594: 8 total, 8 up, 8 in 2024-09-21T13:51:59.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:51:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-120", "mode": "writeback"} : dispatch 2024-09-21T13:51:59.851 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:51:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:51:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:51:59.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:59 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:51:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:59 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:51:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-120"}]': finished 2024-09-21T13:51:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:59 smithi162 ceph-mon[33046]: osdmap e594: 8 total, 8 up, 8 in 2024-09-21T13:51:59.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:51:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-120", "mode": "writeback"} : dispatch 2024-09-21T13:52:00.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:00 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:00.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:00 smithi162 ceph-mon[33046]: pgmap v910: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:00.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:00 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-120", "mode": "writeback"}]': finished 2024-09-21T13:52:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:00 smithi162 ceph-mon[33046]: osdmap e595: 8 total, 8 up, 8 in 2024-09-21T13:52:00.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[40622]: pgmap v910: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-120", "mode": "writeback"}]': finished 2024-09-21T13:52:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[40622]: osdmap e595: 8 total, 8 up, 8 in 2024-09-21T13:52:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[30076]: pgmap v910: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-120", "mode": "writeback"}]': finished 2024-09-21T13:52:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[30076]: osdmap e595: 8 total, 8 up, 8 in 2024-09-21T13:52:01.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:02.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:02.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:02 smithi162 ceph-mon[33046]: osdmap e596: 8 total, 8 up, 8 in 2024-09-21T13:52:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120"} : dispatch 2024-09-21T13:52:02.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:02 smithi162 ceph-mon[33046]: pgmap v913: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:02 smithi002 ceph-mon[30076]: osdmap e596: 8 total, 8 up, 8 in 2024-09-21T13:52:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120"} : dispatch 2024-09-21T13:52:02.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:02 smithi002 ceph-mon[30076]: pgmap v913: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:02 smithi002 ceph-mon[40622]: osdmap e596: 8 total, 8 up, 8 in 2024-09-21T13:52:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120"} : dispatch 2024-09-21T13:52:02.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:02 smithi002 ceph-mon[40622]: pgmap v913: 204 pgs: 204 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:03.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:03 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120"}]': finished 2024-09-21T13:52:03.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:03 smithi002 ceph-mon[30076]: osdmap e597: 8 total, 8 up, 8 in 2024-09-21T13:52:03.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:03 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:03.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120"}]': finished 2024-09-21T13:52:03.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:03 smithi002 ceph-mon[40622]: osdmap e597: 8 total, 8 up, 8 in 2024-09-21T13:52:03.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:03 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:03.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-120"}]': finished 2024-09-21T13:52:03.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:03 smithi162 ceph-mon[33046]: osdmap e597: 8 total, 8 up, 8 in 2024-09-21T13:52:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:04 smithi002 ceph-mon[30076]: osdmap e598: 8 total, 8 up, 8 in 2024-09-21T13:52:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:04 smithi002 ceph-mon[30076]: pgmap v916: 172 pgs: 172 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:04 smithi002 ceph-mon[30076]: osdmap e599: 8 total, 8 up, 8 in 2024-09-21T13:52:04.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-122","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:04.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:04 smithi002 ceph-mon[40622]: osdmap e598: 8 total, 8 up, 8 in 2024-09-21T13:52:04.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:04 smithi002 ceph-mon[40622]: pgmap v916: 172 pgs: 172 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:04.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:04 smithi002 ceph-mon[40622]: osdmap e599: 8 total, 8 up, 8 in 2024-09-21T13:52:04.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-122","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:04.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:04 smithi162 ceph-mon[33046]: osdmap e598: 8 total, 8 up, 8 in 2024-09-21T13:52:04.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:04 smithi162 ceph-mon[33046]: pgmap v916: 172 pgs: 172 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:04.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:04 smithi162 ceph-mon[33046]: osdmap e599: 8 total, 8 up, 8 in 2024-09-21T13:52:04.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-122","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:06.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:06.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:06 smithi162 ceph-mon[33046]: osdmap e600: 8 total, 8 up, 8 in 2024-09-21T13:52:06.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:06.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:06 smithi162 ceph-mon[33046]: pgmap v919: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:06 smithi002 ceph-mon[30076]: osdmap e600: 8 total, 8 up, 8 in 2024-09-21T13:52:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:06.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:06 smithi002 ceph-mon[30076]: pgmap v919: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:06.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:06.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:06 smithi002 ceph-mon[40622]: osdmap e600: 8 total, 8 up, 8 in 2024-09-21T13:52:06.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:06.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:06 smithi002 ceph-mon[40622]: pgmap v919: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:07.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:07.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:07 smithi162 ceph-mon[33046]: osdmap e601: 8 total, 8 up, 8 in 2024-09-21T13:52:07.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-122"} : dispatch 2024-09-21T13:52:07.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:07 smithi002 ceph-mon[30076]: osdmap e601: 8 total, 8 up, 8 in 2024-09-21T13:52:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-122"} : dispatch 2024-09-21T13:52:07.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:07.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:07 smithi002 ceph-mon[40622]: osdmap e601: 8 total, 8 up, 8 in 2024-09-21T13:52:07.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-122"} : dispatch 2024-09-21T13:52:08.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-122"}]': finished 2024-09-21T13:52:08.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:08 smithi002 ceph-mon[30076]: osdmap e602: 8 total, 8 up, 8 in 2024-09-21T13:52:08.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-122", "mode": "writeback"} : dispatch 2024-09-21T13:52:08.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:08 smithi002 ceph-mon[30076]: pgmap v922: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:08.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-122"}]': finished 2024-09-21T13:52:08.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:08 smithi002 ceph-mon[40622]: osdmap e602: 8 total, 8 up, 8 in 2024-09-21T13:52:08.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-122", "mode": "writeback"} : dispatch 2024-09-21T13:52:08.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:08 smithi002 ceph-mon[40622]: pgmap v922: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:08.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-122"}]': finished 2024-09-21T13:52:08.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:08 smithi162 ceph-mon[33046]: osdmap e602: 8 total, 8 up, 8 in 2024-09-21T13:52:08.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-122", "mode": "writeback"} : dispatch 2024-09-21T13:52:08.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:08 smithi162 ceph-mon[33046]: pgmap v922: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:09.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:52:09 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:52:09.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:52:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:52:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:52:09.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:09 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:09.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-122", "mode": "writeback"}]': finished 2024-09-21T13:52:09.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:09 smithi002 ceph-mon[30076]: osdmap e603: 8 total, 8 up, 8 in 2024-09-21T13:52:09.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:09.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:09 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-122", "mode": "writeback"}]': finished 2024-09-21T13:52:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:09 smithi002 ceph-mon[40622]: osdmap e603: 8 total, 8 up, 8 in 2024-09-21T13:52:09.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:09.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:09 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:09.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-122", "mode": "writeback"}]': finished 2024-09-21T13:52:09.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:09 smithi162 ceph-mon[33046]: osdmap e603: 8 total, 8 up, 8 in 2024-09-21T13:52:09.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[30076]: osdmap e604: 8 total, 8 up, 8 in 2024-09-21T13:52:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122"} : dispatch 2024-09-21T13:52:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[30076]: pgmap v925: 204 pgs: 204 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T13:52:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122"}]': finished 2024-09-21T13:52:10.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[30076]: osdmap e605: 8 total, 8 up, 8 in 2024-09-21T13:52:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[40622]: osdmap e604: 8 total, 8 up, 8 in 2024-09-21T13:52:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122"} : dispatch 2024-09-21T13:52:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[40622]: pgmap v925: 204 pgs: 204 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T13:52:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122"}]': finished 2024-09-21T13:52:10.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:10 smithi002 ceph-mon[40622]: osdmap e605: 8 total, 8 up, 8 in 2024-09-21T13:52:10.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:10 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:10.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:10.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:10 smithi162 ceph-mon[33046]: osdmap e604: 8 total, 8 up, 8 in 2024-09-21T13:52:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122"} : dispatch 2024-09-21T13:52:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:10 smithi162 ceph-mon[33046]: pgmap v925: 204 pgs: 204 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T13:52:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:10 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:10 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-122"}]': finished 2024-09-21T13:52:10.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:10 smithi162 ceph-mon[33046]: osdmap e605: 8 total, 8 up, 8 in 2024-09-21T13:52:12.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:12 smithi002 ceph-mon[30076]: osdmap e606: 8 total, 8 up, 8 in 2024-09-21T13:52:12.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:12 smithi002 ceph-mon[30076]: pgmap v928: 172 pgs: 172 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:12.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:12 smithi002 ceph-mon[40622]: osdmap e606: 8 total, 8 up, 8 in 2024-09-21T13:52:12.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:12 smithi002 ceph-mon[40622]: pgmap v928: 172 pgs: 172 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:12.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:12 smithi162 ceph-mon[33046]: osdmap e606: 8 total, 8 up, 8 in 2024-09-21T13:52:12.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:12 smithi162 ceph-mon[33046]: pgmap v928: 172 pgs: 172 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:13.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:13 smithi002 ceph-mon[30076]: osdmap e607: 8 total, 8 up, 8 in 2024-09-21T13:52:13.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-124","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:13 smithi002 ceph-mon[40622]: osdmap e607: 8 total, 8 up, 8 in 2024-09-21T13:52:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-124","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:13.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:13 smithi162 ceph-mon[33046]: osdmap e607: 8 total, 8 up, 8 in 2024-09-21T13:52:13.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-124","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:14.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:14.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:14 smithi002 ceph-mon[30076]: osdmap e608: 8 total, 8 up, 8 in 2024-09-21T13:52:14.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:14.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:14 smithi002 ceph-mon[30076]: pgmap v931: 204 pgs: 1 active, 13 creating+activating, 190 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-09-21T13:52:14.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:14.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:14 smithi002 ceph-mon[40622]: osdmap e608: 8 total, 8 up, 8 in 2024-09-21T13:52:14.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:14.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:14 smithi002 ceph-mon[40622]: pgmap v931: 204 pgs: 1 active, 13 creating+activating, 190 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-09-21T13:52:14.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:14.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:14 smithi162 ceph-mon[33046]: osdmap e608: 8 total, 8 up, 8 in 2024-09-21T13:52:14.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:14.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:14 smithi162 ceph-mon[33046]: pgmap v931: 204 pgs: 1 active, 13 creating+activating, 190 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-09-21T13:52:15.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:15 smithi002 ceph-mon[30076]: osdmap e609: 8 total, 8 up, 8 in 2024-09-21T13:52:15.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:15 smithi002 ceph-mon[40622]: osdmap e609: 8 total, 8 up, 8 in 2024-09-21T13:52:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:15.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:15 smithi162 ceph-mon[33046]: osdmap e609: 8 total, 8 up, 8 in 2024-09-21T13:52:15.897 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[30076]: osdmap e610: 8 total, 8 up, 8 in 2024-09-21T13:52:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-124"} : dispatch 2024-09-21T13:52:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[30076]: pgmap v934: 204 pgs: 1 active, 13 creating+activating, 190 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:52:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-124"}]': finished 2024-09-21T13:52:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[30076]: osdmap e611: 8 total, 8 up, 8 in 2024-09-21T13:52:16.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:16.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[40622]: osdmap e610: 8 total, 8 up, 8 in 2024-09-21T13:52:16.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-124"} : dispatch 2024-09-21T13:52:16.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[40622]: pgmap v934: 204 pgs: 1 active, 13 creating+activating, 190 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:52:16.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-124"}]': finished 2024-09-21T13:52:16.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:16 smithi002 ceph-mon[40622]: osdmap e611: 8 total, 8 up, 8 in 2024-09-21T13:52:16.904 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:16.904 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:16 smithi162 ceph-mon[33046]: osdmap e610: 8 total, 8 up, 8 in 2024-09-21T13:52:16.904 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-124"} : dispatch 2024-09-21T13:52:16.904 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:16 smithi162 ceph-mon[33046]: pgmap v934: 204 pgs: 1 active, 13 creating+activating, 190 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T13:52:16.904 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-124"}]': finished 2024-09-21T13:52:16.904 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:16 smithi162 ceph-mon[33046]: osdmap e611: 8 total, 8 up, 8 in 2024-09-21T13:52:17.849 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-124", "mode": "writeback"} : dispatch 2024-09-21T13:52:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:17 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-124", "mode": "writeback"}]': finished 2024-09-21T13:52:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:17 smithi002 ceph-mon[40622]: osdmap e612: 8 total, 8 up, 8 in 2024-09-21T13:52:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-124", "mode": "writeback"} : dispatch 2024-09-21T13:52:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:17 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-124", "mode": "writeback"}]': finished 2024-09-21T13:52:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:17 smithi002 ceph-mon[30076]: osdmap e612: 8 total, 8 up, 8 in 2024-09-21T13:52:17.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-124", "mode": "writeback"} : dispatch 2024-09-21T13:52:17.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:17 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:17.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-124", "mode": "writeback"}]': finished 2024-09-21T13:52:17.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:17 smithi162 ceph-mon[33046]: osdmap e612: 8 total, 8 up, 8 in 2024-09-21T13:52:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:18 smithi002 ceph-mon[30076]: pgmap v937: 204 pgs: 1 active, 13 creating+activating, 190 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:18 smithi002 ceph-mon[40622]: pgmap v937: 204 pgs: 1 active, 13 creating+activating, 190 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:18.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:18 smithi162 ceph-mon[33046]: pgmap v937: 204 pgs: 1 active, 13 creating+activating, 190 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:19.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:52:19 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:52:19.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:52:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:52:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:52:19.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:19 smithi002 ceph-mon[30076]: osdmap e613: 8 total, 8 up, 8 in 2024-09-21T13:52:19.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:19.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:19 smithi002 ceph-mon[40622]: osdmap e613: 8 total, 8 up, 8 in 2024-09-21T13:52:19.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:19.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:19 smithi162 ceph-mon[33046]: osdmap e613: 8 total, 8 up, 8 in 2024-09-21T13:52:19.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[30076]: osdmap e614: 8 total, 8 up, 8 in 2024-09-21T13:52:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124"} : dispatch 2024-09-21T13:52:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[30076]: pgmap v940: 204 pgs: 2 active+clean+snaptrim_wait, 202 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T13:52:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124"}]': finished 2024-09-21T13:52:20.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[30076]: osdmap e615: 8 total, 8 up, 8 in 2024-09-21T13:52:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[40622]: osdmap e614: 8 total, 8 up, 8 in 2024-09-21T13:52:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124"} : dispatch 2024-09-21T13:52:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[40622]: pgmap v940: 204 pgs: 2 active+clean+snaptrim_wait, 202 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T13:52:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124"}]': finished 2024-09-21T13:52:20.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:20 smithi002 ceph-mon[40622]: osdmap e615: 8 total, 8 up, 8 in 2024-09-21T13:52:20.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:20 smithi162 ceph-mon[33046]: osdmap e614: 8 total, 8 up, 8 in 2024-09-21T13:52:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124"} : dispatch 2024-09-21T13:52:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:20 smithi162 ceph-mon[33046]: pgmap v940: 204 pgs: 2 active+clean+snaptrim_wait, 202 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T13:52:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:20 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-124"}]': finished 2024-09-21T13:52:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:20 smithi162 ceph-mon[33046]: osdmap e615: 8 total, 8 up, 8 in 2024-09-21T13:52:22.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:22 smithi002 ceph-mon[30076]: osdmap e616: 8 total, 8 up, 8 in 2024-09-21T13:52:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:22 smithi002 ceph-mon[30076]: pgmap v943: 172 pgs: 1 active+clean+snaptrim_wait, 171 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T13:52:22.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:22 smithi002 ceph-mon[40622]: osdmap e616: 8 total, 8 up, 8 in 2024-09-21T13:52:22.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:22 smithi002 ceph-mon[40622]: pgmap v943: 172 pgs: 1 active+clean+snaptrim_wait, 171 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T13:52:22.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:22 smithi162 ceph-mon[33046]: osdmap e616: 8 total, 8 up, 8 in 2024-09-21T13:52:22.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:22 smithi162 ceph-mon[33046]: pgmap v943: 172 pgs: 1 active+clean+snaptrim_wait, 171 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-21T13:52:23.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:23 smithi002 ceph-mon[30076]: osdmap e617: 8 total, 8 up, 8 in 2024-09-21T13:52:23.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-126","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:23.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:23 smithi002 ceph-mon[40622]: osdmap e617: 8 total, 8 up, 8 in 2024-09-21T13:52:23.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-126","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:23.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:23 smithi162 ceph-mon[33046]: osdmap e617: 8 total, 8 up, 8 in 2024-09-21T13:52:23.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-126","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:24 smithi002 ceph-mon[30076]: osdmap e618: 8 total, 8 up, 8 in 2024-09-21T13:52:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:24 smithi002 ceph-mon[30076]: pgmap v946: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:24.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:24.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:24 smithi002 ceph-mon[40622]: osdmap e618: 8 total, 8 up, 8 in 2024-09-21T13:52:24.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:24.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:24 smithi002 ceph-mon[40622]: pgmap v946: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:24.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:24 smithi162 ceph-mon[33046]: osdmap e618: 8 total, 8 up, 8 in 2024-09-21T13:52:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:24.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:24 smithi162 ceph-mon[33046]: pgmap v946: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:25.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:25.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:25 smithi002 ceph-mon[30076]: osdmap e619: 8 total, 8 up, 8 in 2024-09-21T13:52:25.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-126"} : dispatch 2024-09-21T13:52:25.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:25.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:25 smithi002 ceph-mon[40622]: osdmap e619: 8 total, 8 up, 8 in 2024-09-21T13:52:25.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-126"} : dispatch 2024-09-21T13:52:25.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:25.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:25 smithi162 ceph-mon[33046]: osdmap e619: 8 total, 8 up, 8 in 2024-09-21T13:52:25.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-126"} : dispatch 2024-09-21T13:52:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-126"}]': finished 2024-09-21T13:52:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[30076]: osdmap e620: 8 total, 8 up, 8 in 2024-09-21T13:52:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-126", "mode": "writeback"} : dispatch 2024-09-21T13:52:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[30076]: pgmap v949: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-126", "mode": "writeback"}]': finished 2024-09-21T13:52:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-126"}]': finished 2024-09-21T13:52:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[40622]: osdmap e620: 8 total, 8 up, 8 in 2024-09-21T13:52:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-126", "mode": "writeback"} : dispatch 2024-09-21T13:52:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[40622]: pgmap v949: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:26.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-126", "mode": "writeback"}]': finished 2024-09-21T13:52:26.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-126"}]': finished 2024-09-21T13:52:26.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:26 smithi162 ceph-mon[33046]: osdmap e620: 8 total, 8 up, 8 in 2024-09-21T13:52:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-126", "mode": "writeback"} : dispatch 2024-09-21T13:52:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:26 smithi162 ceph-mon[33046]: pgmap v949: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:26 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-126", "mode": "writeback"}]': finished 2024-09-21T13:52:27.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:27 smithi002 ceph-mon[30076]: osdmap e621: 8 total, 8 up, 8 in 2024-09-21T13:52:27.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:27.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:27 smithi002 ceph-mon[40622]: osdmap e621: 8 total, 8 up, 8 in 2024-09-21T13:52:27.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:27.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:27 smithi162 ceph-mon[33046]: osdmap e621: 8 total, 8 up, 8 in 2024-09-21T13:52:27.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:28.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:28.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:28 smithi162 ceph-mon[33046]: osdmap e622: 8 total, 8 up, 8 in 2024-09-21T13:52:28.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126"} : dispatch 2024-09-21T13:52:28.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:28 smithi162 ceph-mon[33046]: pgmap v952: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:28 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126"}]': finished 2024-09-21T13:52:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:28 smithi162 ceph-mon[33046]: osdmap e623: 8 total, 8 up, 8 in 2024-09-21T13:52:29.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[30076]: osdmap e622: 8 total, 8 up, 8 in 2024-09-21T13:52:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126"} : dispatch 2024-09-21T13:52:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[30076]: pgmap v952: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126"}]': finished 2024-09-21T13:52:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[30076]: osdmap e623: 8 total, 8 up, 8 in 2024-09-21T13:52:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[40622]: osdmap e622: 8 total, 8 up, 8 in 2024-09-21T13:52:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126"} : dispatch 2024-09-21T13:52:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[40622]: pgmap v952: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-126"}]': finished 2024-09-21T13:52:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:28 smithi002 ceph-mon[40622]: osdmap e623: 8 total, 8 up, 8 in 2024-09-21T13:52:29.469 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:52:29.469 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9047 ms) 2024-09-21T13:52:29.469 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-21T13:52:29.469 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:52:29.469 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6046 ms) 2024-09-21T13:52:29.469 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5040 ms) 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25718 ms) 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (14047 ms) 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12078 ms) 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-09-21T13:52:29.470 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: 00000010 69 73 |is| 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: 00000012 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12068 ms) 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: require_osd_release = squid 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6038 ms) 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (556629 ms total) 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1010 ms) 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (11052 ms) 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18068 ms) 2024-09-21T13:52:29.471 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (2 ms) 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30133 ms total) 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7044 ms) 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8049 ms) 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: waiting for scrub... 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: done waiting 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (24556 ms) 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9767 ms) 2024-09-21T13:52:29.472 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-21T13:52:29.473 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (7954 ms) 2024-09-21T13:52:29.473 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-21T13:52:29.473 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8037 ms) 2024-09-21T13:52:29.473 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-21T13:52:29.473 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10061 ms) 2024-09-21T13:52:29.473 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-21T13:52:29.610 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:52:29 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:52:29.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:29.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:29 smithi162 ceph-mon[33046]: osdmap e624: 8 total, 8 up, 8 in 2024-09-21T13:52:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:29 smithi002 ceph-mon[30076]: osdmap e624: 8 total, 8 up, 8 in 2024-09-21T13:52:30.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:52:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:52:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:52:30.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:30.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:29 smithi002 ceph-mon[40622]: osdmap e624: 8 total, 8 up, 8 in 2024-09-21T13:52:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:30 smithi162 ceph-mon[33046]: pgmap v955: 172 pgs: 172 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:30 smithi162 ceph-mon[33046]: osdmap e625: 8 total, 8 up, 8 in 2024-09-21T13:52:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-128","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:31.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:30 smithi002 ceph-mon[30076]: pgmap v955: 172 pgs: 172 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:30 smithi002 ceph-mon[30076]: osdmap e625: 8 total, 8 up, 8 in 2024-09-21T13:52:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-128","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:30 smithi002 ceph-mon[40622]: pgmap v955: 172 pgs: 172 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:30 smithi002 ceph-mon[40622]: osdmap e625: 8 total, 8 up, 8 in 2024-09-21T13:52:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-128","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:32.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:32.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:32 smithi162 ceph-mon[33046]: osdmap e626: 8 total, 8 up, 8 in 2024-09-21T13:52:32.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:32.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:32 smithi162 ceph-mon[33046]: pgmap v958: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:32.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:32 smithi002 ceph-mon[30076]: osdmap e626: 8 total, 8 up, 8 in 2024-09-21T13:52:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:32 smithi002 ceph-mon[30076]: pgmap v958: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:32.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:32.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:32 smithi002 ceph-mon[40622]: osdmap e626: 8 total, 8 up, 8 in 2024-09-21T13:52:32.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:32.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:32 smithi002 ceph-mon[40622]: pgmap v958: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:33.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:33.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:33 smithi002 ceph-mon[30076]: osdmap e627: 8 total, 8 up, 8 in 2024-09-21T13:52:33.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-128"} : dispatch 2024-09-21T13:52:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:33 smithi002 ceph-mon[40622]: osdmap e627: 8 total, 8 up, 8 in 2024-09-21T13:52:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-128"} : dispatch 2024-09-21T13:52:33.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:33 smithi162 ceph-mon[33046]: osdmap e627: 8 total, 8 up, 8 in 2024-09-21T13:52:33.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-128"} : dispatch 2024-09-21T13:52:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-128"}]': finished 2024-09-21T13:52:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[30076]: osdmap e628: 8 total, 8 up, 8 in 2024-09-21T13:52:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-128", "mode": "writeback"} : dispatch 2024-09-21T13:52:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[30076]: pgmap v961: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-128", "mode": "writeback"}]': finished 2024-09-21T13:52:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[30076]: osdmap e629: 8 total, 8 up, 8 in 2024-09-21T13:52:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-128"}]': finished 2024-09-21T13:52:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[40622]: osdmap e628: 8 total, 8 up, 8 in 2024-09-21T13:52:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-128", "mode": "writeback"} : dispatch 2024-09-21T13:52:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[40622]: pgmap v961: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-128", "mode": "writeback"}]': finished 2024-09-21T13:52:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:34 smithi002 ceph-mon[40622]: osdmap e629: 8 total, 8 up, 8 in 2024-09-21T13:52:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-128"}]': finished 2024-09-21T13:52:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:34 smithi162 ceph-mon[33046]: osdmap e628: 8 total, 8 up, 8 in 2024-09-21T13:52:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-128", "mode": "writeback"} : dispatch 2024-09-21T13:52:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:34 smithi162 ceph-mon[33046]: pgmap v961: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:34 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-128", "mode": "writeback"}]': finished 2024-09-21T13:52:34.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:34 smithi162 ceph-mon[33046]: osdmap e629: 8 total, 8 up, 8 in 2024-09-21T13:52:36.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:36 smithi162 ceph-mon[33046]: pgmap v963: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:37.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:36 smithi002 ceph-mon[30076]: pgmap v963: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:36 smithi002 ceph-mon[40622]: pgmap v963: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:38.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:38 smithi162 ceph-mon[33046]: pgmap v964: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:52:39.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:38 smithi002 ceph-mon[30076]: pgmap v964: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:52:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:38 smithi002 ceph-mon[40622]: pgmap v964: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:52:39.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:52:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:52:39.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:40.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:40.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:52:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:52:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:52:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:40 smithi002 ceph-mon[30076]: pgmap v965: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 284 B/s wr, 1 op/s 2024-09-21T13:52:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:40 smithi002 ceph-mon[30076]: osdmap e630: 8 total, 8 up, 8 in 2024-09-21T13:52:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128"} : dispatch 2024-09-21T13:52:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:40 smithi002 ceph-mon[40622]: pgmap v965: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 284 B/s wr, 1 op/s 2024-09-21T13:52:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:40 smithi002 ceph-mon[40622]: osdmap e630: 8 total, 8 up, 8 in 2024-09-21T13:52:41.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128"} : dispatch 2024-09-21T13:52:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:40 smithi162 ceph-mon[33046]: pgmap v965: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 284 B/s wr, 1 op/s 2024-09-21T13:52:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:40 smithi162 ceph-mon[33046]: osdmap e630: 8 total, 8 up, 8 in 2024-09-21T13:52:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128"} : dispatch 2024-09-21T13:52:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:41 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128"}]': finished 2024-09-21T13:52:42.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:41 smithi002 ceph-mon[30076]: osdmap e631: 8 total, 8 up, 8 in 2024-09-21T13:52:42.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:41 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:42.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128"}]': finished 2024-09-21T13:52:42.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:41 smithi002 ceph-mon[40622]: osdmap e631: 8 total, 8 up, 8 in 2024-09-21T13:52:42.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:41 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:42.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-128"}]': finished 2024-09-21T13:52:42.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:41 smithi162 ceph-mon[33046]: osdmap e631: 8 total, 8 up, 8 in 2024-09-21T13:52:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:42 smithi002 ceph-mon[30076]: pgmap v968: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 284 B/s wr, 1 op/s 2024-09-21T13:52:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:42 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:42 smithi002 ceph-mon[30076]: osdmap e632: 8 total, 8 up, 8 in 2024-09-21T13:52:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:42 smithi002 ceph-mon[30076]: osdmap e633: 8 total, 8 up, 8 in 2024-09-21T13:52:43.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:42 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-130","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:42 smithi002 ceph-mon[40622]: pgmap v968: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 284 B/s wr, 1 op/s 2024-09-21T13:52:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:42 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:42 smithi002 ceph-mon[40622]: osdmap e632: 8 total, 8 up, 8 in 2024-09-21T13:52:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:42 smithi002 ceph-mon[40622]: osdmap e633: 8 total, 8 up, 8 in 2024-09-21T13:52:43.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:42 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-130","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:42 smithi162 ceph-mon[33046]: pgmap v968: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 284 B/s wr, 1 op/s 2024-09-21T13:52:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:42 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:42 smithi162 ceph-mon[33046]: osdmap e632: 8 total, 8 up, 8 in 2024-09-21T13:52:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:42 smithi162 ceph-mon[33046]: osdmap e633: 8 total, 8 up, 8 in 2024-09-21T13:52:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:42 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-130","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:44.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:43 smithi002 ceph-mon[30076]: osdmap e634: 8 total, 8 up, 8 in 2024-09-21T13:52:44.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:43 smithi002 ceph-mon[40622]: osdmap e634: 8 total, 8 up, 8 in 2024-09-21T13:52:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:44.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:44.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:44.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:43 smithi162 ceph-mon[33046]: osdmap e634: 8 total, 8 up, 8 in 2024-09-21T13:52:44.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:44 smithi002 ceph-mon[30076]: pgmap v971: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:52:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:44 smithi002 ceph-mon[30076]: osdmap e635: 8 total, 8 up, 8 in 2024-09-21T13:52:45.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-130"} : dispatch 2024-09-21T13:52:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:44 smithi002 ceph-mon[40622]: pgmap v971: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:52:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:44 smithi002 ceph-mon[40622]: osdmap e635: 8 total, 8 up, 8 in 2024-09-21T13:52:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-130"} : dispatch 2024-09-21T13:52:45.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:44 smithi162 ceph-mon[33046]: pgmap v971: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:52:45.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:45.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:44 smithi162 ceph-mon[33046]: osdmap e635: 8 total, 8 up, 8 in 2024-09-21T13:52:45.134 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-130"} : dispatch 2024-09-21T13:52:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:46 smithi002 ceph-mon[30076]: pgmap v974: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:52:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-130"}]': finished 2024-09-21T13:52:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:46 smithi002 ceph-mon[30076]: osdmap e636: 8 total, 8 up, 8 in 2024-09-21T13:52:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-130", "mode": "writeback"} : dispatch 2024-09-21T13:52:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:46 smithi002 ceph-mon[40622]: pgmap v974: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:52:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-130"}]': finished 2024-09-21T13:52:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:46 smithi002 ceph-mon[40622]: osdmap e636: 8 total, 8 up, 8 in 2024-09-21T13:52:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-130", "mode": "writeback"} : dispatch 2024-09-21T13:52:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:46 smithi162 ceph-mon[33046]: pgmap v974: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:52:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-130"}]': finished 2024-09-21T13:52:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:46 smithi162 ceph-mon[33046]: osdmap e636: 8 total, 8 up, 8 in 2024-09-21T13:52:47.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-130", "mode": "writeback"} : dispatch 2024-09-21T13:52:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:47 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-130", "mode": "writeback"}]': finished 2024-09-21T13:52:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:47 smithi002 ceph-mon[30076]: osdmap e637: 8 total, 8 up, 8 in 2024-09-21T13:52:48.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:47 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-130", "mode": "writeback"}]': finished 2024-09-21T13:52:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:47 smithi002 ceph-mon[40622]: osdmap e637: 8 total, 8 up, 8 in 2024-09-21T13:52:48.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:48.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:47 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:48.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-130", "mode": "writeback"}]': finished 2024-09-21T13:52:48.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:47 smithi162 ceph-mon[33046]: osdmap e637: 8 total, 8 up, 8 in 2024-09-21T13:52:48.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:48 smithi002 ceph-mon[30076]: pgmap v977: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 657 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:48 smithi002 ceph-mon[30076]: osdmap e638: 8 total, 8 up, 8 in 2024-09-21T13:52:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130"} : dispatch 2024-09-21T13:52:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:48 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:48 smithi002 ceph-mon[40622]: pgmap v977: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 657 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:48 smithi002 ceph-mon[40622]: osdmap e638: 8 total, 8 up, 8 in 2024-09-21T13:52:49.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130"} : dispatch 2024-09-21T13:52:49.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:48 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:48 smithi162 ceph-mon[33046]: pgmap v977: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 657 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:49.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:48 smithi162 ceph-mon[33046]: osdmap e638: 8 total, 8 up, 8 in 2024-09-21T13:52:49.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130"} : dispatch 2024-09-21T13:52:49.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:48 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:49.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:52:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:52:50.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:52:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:52:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:52:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:49 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130"}]': finished 2024-09-21T13:52:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:49 smithi002 ceph-mon[30076]: osdmap e639: 8 total, 8 up, 8 in 2024-09-21T13:52:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:49 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130"}]': finished 2024-09-21T13:52:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:49 smithi002 ceph-mon[40622]: osdmap e639: 8 total, 8 up, 8 in 2024-09-21T13:52:50.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:49 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:52:50.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-130"}]': finished 2024-09-21T13:52:50.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:49 smithi162 ceph-mon[33046]: osdmap e639: 8 total, 8 up, 8 in 2024-09-21T13:52:51.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:50 smithi002 ceph-mon[30076]: pgmap v980: 204 pgs: 204 active+clean; 583 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-21T13:52:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:50 smithi002 ceph-mon[30076]: osdmap e640: 8 total, 8 up, 8 in 2024-09-21T13:52:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:50 smithi002 ceph-mon[30076]: osdmap e641: 8 total, 8 up, 8 in 2024-09-21T13:52:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-132","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:50 smithi002 ceph-mon[40622]: pgmap v980: 204 pgs: 204 active+clean; 583 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-21T13:52:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:50 smithi002 ceph-mon[40622]: osdmap e640: 8 total, 8 up, 8 in 2024-09-21T13:52:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:50 smithi002 ceph-mon[40622]: osdmap e641: 8 total, 8 up, 8 in 2024-09-21T13:52:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-132","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:52:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:50 smithi162 ceph-mon[33046]: pgmap v980: 204 pgs: 204 active+clean; 583 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-21T13:52:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:50 smithi162 ceph-mon[33046]: osdmap e640: 8 total, 8 up, 8 in 2024-09-21T13:52:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:50 smithi162 ceph-mon[33046]: osdmap e641: 8 total, 8 up, 8 in 2024-09-21T13:52:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-132","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:52:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[30076]: pgmap v983: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[30076]: osdmap e642: 8 total, 8 up, 8 in 2024-09-21T13:52:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:52:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:52:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:52:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:52:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[40622]: pgmap v983: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[40622]: osdmap e642: 8 total, 8 up, 8 in 2024-09-21T13:52:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:52:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:52:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:52:53.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:52:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:52 smithi162 ceph-mon[33046]: pgmap v983: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-21T13:52:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:52:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:52 smithi162 ceph-mon[33046]: osdmap e642: 8 total, 8 up, 8 in 2024-09-21T13:52:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:52:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:52:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:52:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:52:53.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:52:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:53 smithi002 ceph-mon[30076]: osdmap e643: 8 total, 8 up, 8 in 2024-09-21T13:52:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"} : dispatch 2024-09-21T13:52:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:53 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"}]': finished 2024-09-21T13:52:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:53 smithi002 ceph-mon[40622]: osdmap e643: 8 total, 8 up, 8 in 2024-09-21T13:52:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"} : dispatch 2024-09-21T13:52:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:53 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"}]': finished 2024-09-21T13:52:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:52:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:53 smithi162 ceph-mon[33046]: osdmap e643: 8 total, 8 up, 8 in 2024-09-21T13:52:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"} : dispatch 2024-09-21T13:52:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:53 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"}]': finished 2024-09-21T13:52:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:54 smithi002 ceph-mon[30076]: pgmap v986: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:52:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:54 smithi002 ceph-mon[30076]: osdmap e644: 8 total, 8 up, 8 in 2024-09-21T13:52:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-132", "mode": "writeback"} : dispatch 2024-09-21T13:52:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:54 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-132", "mode": "writeback"}]': finished 2024-09-21T13:52:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:54 smithi002 ceph-mon[40622]: pgmap v986: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:52:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:54 smithi002 ceph-mon[40622]: osdmap e644: 8 total, 8 up, 8 in 2024-09-21T13:52:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-132", "mode": "writeback"} : dispatch 2024-09-21T13:52:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:54 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:55.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-132", "mode": "writeback"}]': finished 2024-09-21T13:52:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:54 smithi162 ceph-mon[33046]: pgmap v986: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:52:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:54 smithi162 ceph-mon[33046]: osdmap e644: 8 total, 8 up, 8 in 2024-09-21T13:52:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-132", "mode": "writeback"} : dispatch 2024-09-21T13:52:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:54 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:52:55.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-132", "mode": "writeback"}]': finished 2024-09-21T13:52:56.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:55 smithi002 ceph-mon[30076]: osdmap e645: 8 total, 8 up, 8 in 2024-09-21T13:52:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:55 smithi002 ceph-mon[40622]: osdmap e645: 8 total, 8 up, 8 in 2024-09-21T13:52:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:55 smithi162 ceph-mon[33046]: osdmap e645: 8 total, 8 up, 8 in 2024-09-21T13:52:57.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:56 smithi002 ceph-mon[30076]: pgmap v989: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:56 smithi002 ceph-mon[30076]: osdmap e646: 8 total, 8 up, 8 in 2024-09-21T13:52:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:56 smithi002 ceph-mon[40622]: pgmap v989: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:56 smithi002 ceph-mon[40622]: osdmap e646: 8 total, 8 up, 8 in 2024-09-21T13:52:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:56 smithi162 ceph-mon[33046]: pgmap v989: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:52:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:56 smithi162 ceph-mon[33046]: osdmap e646: 8 total, 8 up, 8 in 2024-09-21T13:52:58.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:57 smithi002 ceph-mon[30076]: osdmap e647: 8 total, 8 up, 8 in 2024-09-21T13:52:58.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:57 smithi002 ceph-mon[40622]: osdmap e647: 8 total, 8 up, 8 in 2024-09-21T13:52:58.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:58.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:57 smithi162 ceph-mon[33046]: osdmap e647: 8 total, 8 up, 8 in 2024-09-21T13:52:58.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:57 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:52:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[40622]: pgmap v992: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[40622]: osdmap e648: 8 total, 8 up, 8 in 2024-09-21T13:52:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"} : dispatch 2024-09-21T13:52:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:52:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[30076]: pgmap v992: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[30076]: osdmap e648: 8 total, 8 up, 8 in 2024-09-21T13:52:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"} : dispatch 2024-09-21T13:52:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:52:59.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:59.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:58 smithi162 ceph-mon[33046]: pgmap v992: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:52:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:52:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:58 smithi162 ceph-mon[33046]: osdmap e648: 8 total, 8 up, 8 in 2024-09-21T13:52:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"} : dispatch 2024-09-21T13:52:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:58 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:52:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:52:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:52:59.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:52:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:53:00.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"}]': finished 2024-09-21T13:53:00.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:52:59 smithi002 ceph-mon[30076]: osdmap e649: 8 total, 8 up, 8 in 2024-09-21T13:53:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:52:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:52:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:53:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"}]': finished 2024-09-21T13:53:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:52:59 smithi002 ceph-mon[40622]: osdmap e649: 8 total, 8 up, 8 in 2024-09-21T13:53:00.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-132"}]': finished 2024-09-21T13:53:00.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:52:59 smithi162 ceph-mon[33046]: osdmap e649: 8 total, 8 up, 8 in 2024-09-21T13:53:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:00 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:00 smithi002 ceph-mon[30076]: pgmap v995: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:53:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:00 smithi002 ceph-mon[30076]: osdmap e650: 8 total, 8 up, 8 in 2024-09-21T13:53:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:00 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:00 smithi002 ceph-mon[40622]: pgmap v995: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:53:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:00 smithi002 ceph-mon[40622]: osdmap e650: 8 total, 8 up, 8 in 2024-09-21T13:53:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:00 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:00 smithi162 ceph-mon[33046]: pgmap v995: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:53:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:00 smithi162 ceph-mon[33046]: osdmap e650: 8 total, 8 up, 8 in 2024-09-21T13:53:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:53:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:01 smithi002 ceph-mon[30076]: osdmap e651: 8 total, 8 up, 8 in 2024-09-21T13:53:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132"} : dispatch 2024-09-21T13:53:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:01 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132"}]': finished 2024-09-21T13:53:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:53:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:01 smithi002 ceph-mon[40622]: osdmap e651: 8 total, 8 up, 8 in 2024-09-21T13:53:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132"} : dispatch 2024-09-21T13:53:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:01 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:02.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132"}]': finished 2024-09-21T13:53:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:53:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:01 smithi162 ceph-mon[33046]: osdmap e651: 8 total, 8 up, 8 in 2024-09-21T13:53:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132"} : dispatch 2024-09-21T13:53:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:01 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-132"}]': finished 2024-09-21T13:53:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:02 smithi162 ceph-mon[33046]: pgmap v998: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:53:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:02 smithi162 ceph-mon[33046]: osdmap e652: 8 total, 8 up, 8 in 2024-09-21T13:53:03.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:02 smithi002 ceph-mon[30076]: pgmap v998: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:53:03.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:02 smithi002 ceph-mon[30076]: osdmap e652: 8 total, 8 up, 8 in 2024-09-21T13:53:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:02 smithi002 ceph-mon[40622]: pgmap v998: 204 pgs: 204 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T13:53:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:02 smithi002 ceph-mon[40622]: osdmap e652: 8 total, 8 up, 8 in 2024-09-21T13:53:04.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:03 smithi162 ceph-mon[33046]: osdmap e653: 8 total, 8 up, 8 in 2024-09-21T13:53:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:03 smithi002 ceph-mon[30076]: osdmap e653: 8 total, 8 up, 8 in 2024-09-21T13:53:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:03 smithi002 ceph-mon[40622]: osdmap e653: 8 total, 8 up, 8 in 2024-09-21T13:53:05.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:04 smithi162 ceph-mon[33046]: pgmap v1001: 172 pgs: 172 active+clean; 583 KiB data, 685 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T13:53:05.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:04 smithi162 ceph-mon[33046]: osdmap e654: 8 total, 8 up, 8 in 2024-09-21T13:53:05.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-134","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:05.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:04 smithi002 ceph-mon[30076]: pgmap v1001: 172 pgs: 172 active+clean; 583 KiB data, 685 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T13:53:05.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:04 smithi002 ceph-mon[30076]: osdmap e654: 8 total, 8 up, 8 in 2024-09-21T13:53:05.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-134","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:04 smithi002 ceph-mon[40622]: pgmap v1001: 172 pgs: 172 active+clean; 583 KiB data, 685 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T13:53:05.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:04 smithi002 ceph-mon[40622]: osdmap e654: 8 total, 8 up, 8 in 2024-09-21T13:53:05.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-134","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:05 smithi162 ceph-mon[33046]: osdmap e655: 8 total, 8 up, 8 in 2024-09-21T13:53:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:06.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:05 smithi162 ceph-mon[33046]: osdmap e656: 8 total, 8 up, 8 in 2024-09-21T13:53:06.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-134"} : dispatch 2024-09-21T13:53:06.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[40622]: osdmap e655: 8 total, 8 up, 8 in 2024-09-21T13:53:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[40622]: osdmap e656: 8 total, 8 up, 8 in 2024-09-21T13:53:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-134"} : dispatch 2024-09-21T13:53:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[30076]: osdmap e655: 8 total, 8 up, 8 in 2024-09-21T13:53:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[30076]: osdmap e656: 8 total, 8 up, 8 in 2024-09-21T13:53:06.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-134"} : dispatch 2024-09-21T13:53:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:06 smithi162 ceph-mon[33046]: pgmap v1004: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 685 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T13:53:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-134"}]': finished 2024-09-21T13:53:07.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:06 smithi162 ceph-mon[33046]: osdmap e657: 8 total, 8 up, 8 in 2024-09-21T13:53:07.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-134", "mode": "writeback"} : dispatch 2024-09-21T13:53:07.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:06 smithi002 ceph-mon[40622]: pgmap v1004: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 685 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T13:53:07.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-134"}]': finished 2024-09-21T13:53:07.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:06 smithi002 ceph-mon[40622]: osdmap e657: 8 total, 8 up, 8 in 2024-09-21T13:53:07.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-134", "mode": "writeback"} : dispatch 2024-09-21T13:53:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:06 smithi002 ceph-mon[30076]: pgmap v1004: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 685 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T13:53:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-134"}]': finished 2024-09-21T13:53:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:06 smithi002 ceph-mon[30076]: osdmap e657: 8 total, 8 up, 8 in 2024-09-21T13:53:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-134", "mode": "writeback"} : dispatch 2024-09-21T13:53:08.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:07 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:53:08.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-134", "mode": "writeback"}]': finished 2024-09-21T13:53:08.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:07 smithi162 ceph-mon[33046]: osdmap e658: 8 total, 8 up, 8 in 2024-09-21T13:53:08.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:07 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:53:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-134", "mode": "writeback"}]': finished 2024-09-21T13:53:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:07 smithi002 ceph-mon[40622]: osdmap e658: 8 total, 8 up, 8 in 2024-09-21T13:53:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:07 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:53:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-134", "mode": "writeback"}]': finished 2024-09-21T13:53:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:07 smithi002 ceph-mon[30076]: osdmap e658: 8 total, 8 up, 8 in 2024-09-21T13:53:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:08 smithi162 ceph-mon[33046]: pgmap v1007: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 685 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:53:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:53:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:08 smithi162 ceph-mon[33046]: osdmap e659: 8 total, 8 up, 8 in 2024-09-21T13:53:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:08 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134"} : dispatch 2024-09-21T13:53:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:08 smithi002 ceph-mon[30076]: pgmap v1007: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 685 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:53:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:53:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:08 smithi002 ceph-mon[30076]: osdmap e659: 8 total, 8 up, 8 in 2024-09-21T13:53:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:08 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134"} : dispatch 2024-09-21T13:53:09.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:08 smithi002 ceph-mon[40622]: pgmap v1007: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 685 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:53:09.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:09.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:53:09.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:08 smithi002 ceph-mon[40622]: osdmap e659: 8 total, 8 up, 8 in 2024-09-21T13:53:09.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:08 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134"} : dispatch 2024-09-21T13:53:09.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:53:09 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:53:10.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:53:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:53:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:53:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:09 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:09 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134"}]': finished 2024-09-21T13:53:10.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:09 smithi002 ceph-mon[30076]: osdmap e660: 8 total, 8 up, 8 in 2024-09-21T13:53:10.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:09 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:10.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:09 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134"}]': finished 2024-09-21T13:53:10.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:09 smithi002 ceph-mon[40622]: osdmap e660: 8 total, 8 up, 8 in 2024-09-21T13:53:10.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:09 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:10.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:09 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-134"}]': finished 2024-09-21T13:53:10.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:09 smithi162 ceph-mon[33046]: osdmap e660: 8 total, 8 up, 8 in 2024-09-21T13:53:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:10 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:10 smithi162 ceph-mon[33046]: pgmap v1011: 204 pgs: 204 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-21T13:53:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:10 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:11.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:10 smithi162 ceph-mon[33046]: osdmap e661: 8 total, 8 up, 8 in 2024-09-21T13:53:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:10 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:10 smithi002 ceph-mon[30076]: pgmap v1011: 204 pgs: 204 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-21T13:53:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:10 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:10 smithi002 ceph-mon[30076]: osdmap e661: 8 total, 8 up, 8 in 2024-09-21T13:53:11.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:10 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:11.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:10 smithi002 ceph-mon[40622]: pgmap v1011: 204 pgs: 204 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-21T13:53:11.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:10 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:11.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:10 smithi002 ceph-mon[40622]: osdmap e661: 8 total, 8 up, 8 in 2024-09-21T13:53:12.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:12 smithi002 ceph-mon[30076]: osdmap e662: 8 total, 8 up, 8 in 2024-09-21T13:53:12.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-136","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:12.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:12 smithi002 ceph-mon[30076]: pgmap v1014: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-09-21T13:53:12.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:12 smithi002 ceph-mon[40622]: osdmap e662: 8 total, 8 up, 8 in 2024-09-21T13:53:12.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-136","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:12.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:12 smithi002 ceph-mon[40622]: pgmap v1014: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-09-21T13:53:12.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:12 smithi162 ceph-mon[33046]: osdmap e662: 8 total, 8 up, 8 in 2024-09-21T13:53:12.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-136","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:12.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:12 smithi162 ceph-mon[33046]: pgmap v1014: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-09-21T13:53:13.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:13.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:13 smithi002 ceph-mon[30076]: osdmap e663: 8 total, 8 up, 8 in 2024-09-21T13:53:13.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:13 smithi002 ceph-mon[40622]: osdmap e663: 8 total, 8 up, 8 in 2024-09-21T13:53:13.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:13.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:13.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:13 smithi162 ceph-mon[33046]: osdmap e663: 8 total, 8 up, 8 in 2024-09-21T13:53:13.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:14.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:14.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[30076]: osdmap e664: 8 total, 8 up, 8 in 2024-09-21T13:53:14.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-136"} : dispatch 2024-09-21T13:53:14.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:53:14.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:14.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[30076]: pgmap v1017: 204 pgs: 204 active+clean; 583 KiB data, 705 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:14.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-136"}]': finished 2024-09-21T13:53:14.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[40622]: osdmap e664: 8 total, 8 up, 8 in 2024-09-21T13:53:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-136"} : dispatch 2024-09-21T13:53:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:53:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[40622]: pgmap v1017: 204 pgs: 204 active+clean; 583 KiB data, 705 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:14.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-136"}]': finished 2024-09-21T13:53:14.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:14.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:14 smithi162 ceph-mon[33046]: osdmap e664: 8 total, 8 up, 8 in 2024-09-21T13:53:14.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-136"} : dispatch 2024-09-21T13:53:14.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:53:14.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:14.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:14 smithi162 ceph-mon[33046]: pgmap v1017: 204 pgs: 204 active+clean; 583 KiB data, 705 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:14.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-136"}]': finished 2024-09-21T13:53:15.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:15 smithi002 ceph-mon[30076]: osdmap e665: 8 total, 8 up, 8 in 2024-09-21T13:53:15.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-136", "mode": "writeback"} : dispatch 2024-09-21T13:53:15.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:15 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:53:15.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:15 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-136", "mode": "writeback"}]': finished 2024-09-21T13:53:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:15 smithi002 ceph-mon[40622]: osdmap e665: 8 total, 8 up, 8 in 2024-09-21T13:53:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-136", "mode": "writeback"} : dispatch 2024-09-21T13:53:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:15 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:53:15.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:15 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-136", "mode": "writeback"}]': finished 2024-09-21T13:53:15.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:15 smithi162 ceph-mon[33046]: osdmap e665: 8 total, 8 up, 8 in 2024-09-21T13:53:15.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-136", "mode": "writeback"} : dispatch 2024-09-21T13:53:15.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:15 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:53:15.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:15 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-136", "mode": "writeback"}]': finished 2024-09-21T13:53:16.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:16 smithi002 ceph-mon[30076]: osdmap e666: 8 total, 8 up, 8 in 2024-09-21T13:53:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:16 smithi002 ceph-mon[30076]: pgmap v1020: 204 pgs: 204 active+clean; 583 KiB data, 705 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:16.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:16 smithi002 ceph-mon[40622]: osdmap e666: 8 total, 8 up, 8 in 2024-09-21T13:53:16.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:16.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:16 smithi002 ceph-mon[40622]: pgmap v1020: 204 pgs: 204 active+clean; 583 KiB data, 705 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:16.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:16 smithi162 ceph-mon[33046]: osdmap e666: 8 total, 8 up, 8 in 2024-09-21T13:53:16.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:16.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:16 smithi162 ceph-mon[33046]: pgmap v1020: 204 pgs: 204 active+clean; 583 KiB data, 705 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:17.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:53:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:17 smithi002 ceph-mon[30076]: osdmap e667: 8 total, 8 up, 8 in 2024-09-21T13:53:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136"} : dispatch 2024-09-21T13:53:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:53:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:17 smithi002 ceph-mon[40622]: osdmap e667: 8 total, 8 up, 8 in 2024-09-21T13:53:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136"} : dispatch 2024-09-21T13:53:17.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:53:17.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:17 smithi162 ceph-mon[33046]: osdmap e667: 8 total, 8 up, 8 in 2024-09-21T13:53:17.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136"} : dispatch 2024-09-21T13:53:18.849 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:18 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136"}]': finished 2024-09-21T13:53:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:18 smithi002 ceph-mon[40622]: osdmap e668: 8 total, 8 up, 8 in 2024-09-21T13:53:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:18 smithi002 ceph-mon[40622]: pgmap v1023: 204 pgs: 204 active+clean; 583 KiB data, 705 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:53:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:18 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:18 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136"}]': finished 2024-09-21T13:53:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:18 smithi002 ceph-mon[30076]: osdmap e668: 8 total, 8 up, 8 in 2024-09-21T13:53:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:18 smithi002 ceph-mon[30076]: pgmap v1023: 204 pgs: 204 active+clean; 583 KiB data, 705 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:53:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:18 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:18.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:18 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:18.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-136"}]': finished 2024-09-21T13:53:18.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:18 smithi162 ceph-mon[33046]: osdmap e668: 8 total, 8 up, 8 in 2024-09-21T13:53:18.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:18 smithi162 ceph-mon[33046]: pgmap v1023: 204 pgs: 204 active+clean; 583 KiB data, 705 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:53:18.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:18 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:19.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:19 smithi162 ceph-mon[33046]: osdmap e669: 8 total, 8 up, 8 in 2024-09-21T13:53:19.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:53:19 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:53:19.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:19 smithi002 ceph-mon[30076]: osdmap e669: 8 total, 8 up, 8 in 2024-09-21T13:53:19.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:19 smithi002 ceph-mon[40622]: osdmap e669: 8 total, 8 up, 8 in 2024-09-21T13:53:19.850 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:53:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:53:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:53:20.849 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:20.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:20 smithi002 ceph-mon[40622]: osdmap e670: 8 total, 8 up, 8 in 2024-09-21T13:53:20.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-138","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:20.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:20 smithi002 ceph-mon[40622]: pgmap v1026: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T13:53:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:20 smithi002 ceph-mon[30076]: osdmap e670: 8 total, 8 up, 8 in 2024-09-21T13:53:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-138","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:20 smithi002 ceph-mon[30076]: pgmap v1026: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T13:53:20.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:20.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:20 smithi162 ceph-mon[33046]: osdmap e670: 8 total, 8 up, 8 in 2024-09-21T13:53:20.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-138","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:20.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:20 smithi162 ceph-mon[33046]: pgmap v1026: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T13:53:21.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:21.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:21 smithi002 ceph-mon[30076]: osdmap e671: 8 total, 8 up, 8 in 2024-09-21T13:53:21.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:21.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:21.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:21 smithi002 ceph-mon[40622]: osdmap e671: 8 total, 8 up, 8 in 2024-09-21T13:53:21.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:21.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:21.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:21 smithi162 ceph-mon[33046]: osdmap e671: 8 total, 8 up, 8 in 2024-09-21T13:53:21.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:22.849 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:22.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[40622]: osdmap e672: 8 total, 8 up, 8 in 2024-09-21T13:53:22.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:53:22.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[40622]: pgmap v1029: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T13:53:22.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:53:22.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[40622]: osdmap e673: 8 total, 8 up, 8 in 2024-09-21T13:53:22.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:53:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[30076]: osdmap e672: 8 total, 8 up, 8 in 2024-09-21T13:53:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:53:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[30076]: pgmap v1029: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T13:53:22.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:53:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[30076]: osdmap e673: 8 total, 8 up, 8 in 2024-09-21T13:53:22.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:53:22.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:22 smithi162 ceph-mon[33046]: osdmap e672: 8 total, 8 up, 8 in 2024-09-21T13:53:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:53:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:22 smithi162 ceph-mon[33046]: pgmap v1029: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-21T13:53:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:53:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:22 smithi162 ceph-mon[33046]: osdmap e673: 8 total, 8 up, 8 in 2024-09-21T13:53:22.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:53:24.849 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:53:24.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:24 smithi002 ceph-mon[40622]: osdmap e674: 8 total, 8 up, 8 in 2024-09-21T13:53:24.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:53:24.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:24 smithi002 ceph-mon[40622]: pgmap v1032: 204 pgs: 204 active+clean; 4.4 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:53:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:24 smithi002 ceph-mon[30076]: osdmap e674: 8 total, 8 up, 8 in 2024-09-21T13:53:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:53:24.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:24 smithi002 ceph-mon[30076]: pgmap v1032: 204 pgs: 204 active+clean; 4.4 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:24.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:53:24.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:24 smithi162 ceph-mon[33046]: osdmap e674: 8 total, 8 up, 8 in 2024-09-21T13:53:24.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_type","val": "explicit_object"} : dispatch 2024-09-21T13:53:24.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:24 smithi162 ceph-mon[33046]: pgmap v1032: 204 pgs: 204 active+clean; 4.4 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:25.849 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:53:25.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:25 smithi002 ceph-mon[40622]: osdmap e675: 8 total, 8 up, 8 in 2024-09-21T13:53:25.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:53:25.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:25 smithi002 ceph-mon[30076]: osdmap e675: 8 total, 8 up, 8 in 2024-09-21T13:53:25.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-21T13:53:25.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:25 smithi162 ceph-mon[33046]: osdmap e675: 8 total, 8 up, 8 in 2024-09-21T13:53:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138"} : dispatch 2024-09-21T13:53:26.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:26 smithi002 ceph-mon[30076]: pgmap v1034: 204 pgs: 204 active+clean; 4.4 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:26.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:26.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138"} : dispatch 2024-09-21T13:53:26.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:26 smithi002 ceph-mon[40622]: pgmap v1034: 204 pgs: 204 active+clean; 4.4 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:26.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138"} : dispatch 2024-09-21T13:53:26.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:26 smithi162 ceph-mon[33046]: pgmap v1034: 204 pgs: 204 active+clean; 4.4 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:27.849 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138"}]': finished 2024-09-21T13:53:27.849 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:27 smithi002 ceph-mon[40622]: osdmap e676: 8 total, 8 up, 8 in 2024-09-21T13:53:27.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138"}]': finished 2024-09-21T13:53:27.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:27 smithi002 ceph-mon[30076]: osdmap e676: 8 total, 8 up, 8 in 2024-09-21T13:53:27.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-138"}]': finished 2024-09-21T13:53:27.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:27 smithi162 ceph-mon[33046]: osdmap e676: 8 total, 8 up, 8 in 2024-09-21T13:53:28.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:28 smithi002 ceph-mon[30076]: osdmap e677: 8 total, 8 up, 8 in 2024-09-21T13:53:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:28 smithi002 ceph-mon[30076]: pgmap v1037: 172 pgs: 172 active+clean; 4.4 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:28 smithi002 ceph-mon[30076]: osdmap e678: 8 total, 8 up, 8 in 2024-09-21T13:53:28.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-140","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:28.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:28 smithi002 ceph-mon[40622]: osdmap e677: 8 total, 8 up, 8 in 2024-09-21T13:53:28.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:28 smithi002 ceph-mon[40622]: pgmap v1037: 172 pgs: 172 active+clean; 4.4 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:28.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:28 smithi002 ceph-mon[40622]: osdmap e678: 8 total, 8 up, 8 in 2024-09-21T13:53:28.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-140","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:28.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:28 smithi162 ceph-mon[33046]: osdmap e677: 8 total, 8 up, 8 in 2024-09-21T13:53:28.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:28 smithi162 ceph-mon[33046]: pgmap v1037: 172 pgs: 172 active+clean; 4.4 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:28 smithi162 ceph-mon[33046]: osdmap e678: 8 total, 8 up, 8 in 2024-09-21T13:53:28.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-140","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:29.578 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:53:29 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:53:29.849 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:53:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:53:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:53:29.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:29.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:29.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:29 smithi002 ceph-mon[30076]: osdmap e679: 8 total, 8 up, 8 in 2024-09-21T13:53:29.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:29 smithi002 ceph-mon[40622]: osdmap e679: 8 total, 8 up, 8 in 2024-09-21T13:53:29.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:29.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:29.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:29 smithi162 ceph-mon[33046]: osdmap e679: 8 total, 8 up, 8 in 2024-09-21T13:53:29.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:30 smithi002 ceph-mon[40622]: pgmap v1040: 204 pgs: 12 creating+peering, 20 unknown, 172 active+clean; 4.4 MiB data, 721 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:30 smithi002 ceph-mon[40622]: osdmap e680: 8 total, 8 up, 8 in 2024-09-21T13:53:30.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T13:53:30.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:30.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:30 smithi002 ceph-mon[30076]: pgmap v1040: 204 pgs: 12 creating+peering, 20 unknown, 172 active+clean; 4.4 MiB data, 721 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:30.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:30.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:30 smithi002 ceph-mon[30076]: osdmap e680: 8 total, 8 up, 8 in 2024-09-21T13:53:30.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T13:53:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:30 smithi162 ceph-mon[33046]: pgmap v1040: 204 pgs: 12 creating+peering, 20 unknown, 172 active+clean; 4.4 MiB data, 721 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:30.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:30 smithi162 ceph-mon[33046]: osdmap e680: 8 total, 8 up, 8 in 2024-09-21T13:53:30.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_count","val": "3"} : dispatch 2024-09-21T13:53:32.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_count","val": "3"}]': finished 2024-09-21T13:53:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:32 smithi002 ceph-mon[30076]: osdmap e681: 8 total, 8 up, 8 in 2024-09-21T13:53:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:32 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T13:53:32.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:32 smithi002 ceph-mon[30076]: pgmap v1043: 204 pgs: 12 creating+peering, 20 unknown, 172 active+clean; 4.4 MiB data, 721 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:32.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_count","val": "3"}]': finished 2024-09-21T13:53:32.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:32 smithi002 ceph-mon[40622]: osdmap e681: 8 total, 8 up, 8 in 2024-09-21T13:53:32.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:32 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T13:53:32.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:32 smithi002 ceph-mon[40622]: pgmap v1043: 204 pgs: 12 creating+peering, 20 unknown, 172 active+clean; 4.4 MiB data, 721 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:32.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_count","val": "3"}]': finished 2024-09-21T13:53:32.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:32 smithi162 ceph-mon[33046]: osdmap e681: 8 total, 8 up, 8 in 2024-09-21T13:53:32.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:32 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_period","val": "3"} : dispatch 2024-09-21T13:53:32.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:32 smithi162 ceph-mon[33046]: pgmap v1043: 204 pgs: 12 creating+peering, 20 unknown, 172 active+clean; 4.4 MiB data, 721 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:33.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_period","val": "3"}]': finished 2024-09-21T13:53:33.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:33 smithi002 ceph-mon[30076]: osdmap e682: 8 total, 8 up, 8 in 2024-09-21T13:53:33.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:33 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:53:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_period","val": "3"}]': finished 2024-09-21T13:53:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:33 smithi002 ceph-mon[40622]: osdmap e682: 8 total, 8 up, 8 in 2024-09-21T13:53:33.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:33 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:53:33.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_period","val": "3"}]': finished 2024-09-21T13:53:33.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:33 smithi162 ceph-mon[33046]: osdmap e682: 8 total, 8 up, 8 in 2024-09-21T13:53:33.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:33 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:53:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:53:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:34 smithi002 ceph-mon[30076]: osdmap e683: 8 total, 8 up, 8 in 2024-09-21T13:53:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T13:53:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:34 smithi002 ceph-mon[30076]: pgmap v1046: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:34.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T13:53:34.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:53:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:34 smithi002 ceph-mon[40622]: osdmap e683: 8 total, 8 up, 8 in 2024-09-21T13:53:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T13:53:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:34 smithi002 ceph-mon[40622]: pgmap v1046: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:34.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T13:53:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:53:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:34 smithi162 ceph-mon[33046]: osdmap e683: 8 total, 8 up, 8 in 2024-09-21T13:53:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_fpp","val": ".01"} : dispatch 2024-09-21T13:53:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:34 smithi162 ceph-mon[33046]: pgmap v1046: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:34.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-21T13:53:35.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:35 smithi002 ceph-mon[30076]: osdmap e684: 8 total, 8 up, 8 in 2024-09-21T13:53:35.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:35 smithi002 ceph-mon[40622]: osdmap e684: 8 total, 8 up, 8 in 2024-09-21T13:53:35.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:35 smithi162 ceph-mon[33046]: osdmap e684: 8 total, 8 up, 8 in 2024-09-21T13:53:36.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:36 smithi002 ceph-mon[30076]: pgmap v1048: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:36.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:36 smithi002 ceph-mon[40622]: pgmap v1048: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:36.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:36 smithi162 ceph-mon[33046]: pgmap v1048: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:39.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:38 smithi002 ceph-mon[30076]: pgmap v1049: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:53:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:38 smithi002 ceph-mon[40622]: pgmap v1049: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:53:39.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:38 smithi162 ceph-mon[33046]: pgmap v1049: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:53:39.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:53:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:53:40.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:53:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:53:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:53:41.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:40 smithi002 ceph-mon[30076]: pgmap v1050: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.6 KiB/s wr, 2 op/s 2024-09-21T13:53:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:40 smithi002 ceph-mon[40622]: pgmap v1050: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.6 KiB/s wr, 2 op/s 2024-09-21T13:53:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:40 smithi162 ceph-mon[33046]: pgmap v1050: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.6 KiB/s wr, 2 op/s 2024-09-21T13:53:43.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:42 smithi002 ceph-mon[30076]: pgmap v1051: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 630 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-09-21T13:53:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:42 smithi002 ceph-mon[40622]: pgmap v1051: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 630 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-09-21T13:53:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:42 smithi162 ceph-mon[33046]: pgmap v1051: 204 pgs: 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 630 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-09-21T13:53:44.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:44.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:44.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:45.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:44 smithi002 ceph-mon[30076]: pgmap v1052: 204 pgs: 204 active+clean; 4.5 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-21T13:53:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:44 smithi002 ceph-mon[40622]: pgmap v1052: 204 pgs: 204 active+clean; 4.5 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-21T13:53:45.133 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:44 smithi162 ceph-mon[33046]: pgmap v1052: 204 pgs: 204 active+clean; 4.5 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-21T13:53:47.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:46 smithi002 ceph-mon[30076]: pgmap v1053: 204 pgs: 204 active+clean; 4.5 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 6.7 KiB/s wr, 1 op/s 2024-09-21T13:53:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:47.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140"} : dispatch 2024-09-21T13:53:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:46 smithi002 ceph-mon[40622]: pgmap v1053: 204 pgs: 204 active+clean; 4.5 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 6.7 KiB/s wr, 1 op/s 2024-09-21T13:53:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140"} : dispatch 2024-09-21T13:53:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:46 smithi162 ceph-mon[33046]: pgmap v1053: 204 pgs: 204 active+clean; 4.5 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 6.7 KiB/s wr, 1 op/s 2024-09-21T13:53:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:53:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140"} : dispatch 2024-09-21T13:53:48.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:47 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140"}]': finished 2024-09-21T13:53:48.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:47 smithi002 ceph-mon[30076]: osdmap e685: 8 total, 8 up, 8 in 2024-09-21T13:53:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:47 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140"}]': finished 2024-09-21T13:53:48.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:47 smithi002 ceph-mon[40622]: osdmap e685: 8 total, 8 up, 8 in 2024-09-21T13:53:48.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:47 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-140"}]': finished 2024-09-21T13:53:48.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:47 smithi162 ceph-mon[33046]: osdmap e685: 8 total, 8 up, 8 in 2024-09-21T13:53:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:48 smithi002 ceph-mon[30076]: pgmap v1055: 204 pgs: 204 active+clean; 4.5 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-21T13:53:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:48 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:49.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:48 smithi002 ceph-mon[30076]: osdmap e686: 8 total, 8 up, 8 in 2024-09-21T13:53:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:48 smithi002 ceph-mon[40622]: pgmap v1055: 204 pgs: 204 active+clean; 4.5 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-21T13:53:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:48 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:49.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:48 smithi002 ceph-mon[40622]: osdmap e686: 8 total, 8 up, 8 in 2024-09-21T13:53:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:48 smithi162 ceph-mon[33046]: pgmap v1055: 204 pgs: 204 active+clean; 4.5 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-21T13:53:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:48 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:48 smithi162 ceph-mon[33046]: osdmap e686: 8 total, 8 up, 8 in 2024-09-21T13:53:49.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:53:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:53:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:49 smithi002 ceph-mon[30076]: osdmap e687: 8 total, 8 up, 8 in 2024-09-21T13:53:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-142","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:50.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:49 smithi002 ceph-mon[30076]: osdmap e688: 8 total, 8 up, 8 in 2024-09-21T13:53:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:49 smithi002 ceph-mon[40622]: osdmap e687: 8 total, 8 up, 8 in 2024-09-21T13:53:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-142","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:50.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:49 smithi002 ceph-mon[40622]: osdmap e688: 8 total, 8 up, 8 in 2024-09-21T13:53:50.101 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:53:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:53:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:53:50.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:49 smithi162 ceph-mon[33046]: osdmap e687: 8 total, 8 up, 8 in 2024-09-21T13:53:50.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-142","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:53:50.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:53:50.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:49 smithi162 ceph-mon[33046]: osdmap e688: 8 total, 8 up, 8 in 2024-09-21T13:53:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[30076]: pgmap v1058: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:53:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[30076]: osdmap e689: 8 total, 8 up, 8 in 2024-09-21T13:53:51.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-142"} : dispatch 2024-09-21T13:53:51.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[40622]: pgmap v1058: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:53:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[40622]: osdmap e689: 8 total, 8 up, 8 in 2024-09-21T13:53:51.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:50 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-142"} : dispatch 2024-09-21T13:53:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:53:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:50 smithi162 ceph-mon[33046]: pgmap v1058: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:53:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:53:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:53:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:50 smithi162 ceph-mon[33046]: osdmap e689: 8 total, 8 up, 8 in 2024-09-21T13:53:51.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:50 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-142"} : dispatch 2024-09-21T13:53:53.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:52 smithi002 ceph-mon[30076]: pgmap v1061: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:53.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-142"}]': finished 2024-09-21T13:53:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:52 smithi002 ceph-mon[30076]: osdmap e690: 8 total, 8 up, 8 in 2024-09-21T13:53:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-142", "mode": "writeback"} : dispatch 2024-09-21T13:53:53.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:52 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:53:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:52 smithi002 ceph-mon[40622]: pgmap v1061: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-142"}]': finished 2024-09-21T13:53:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:52 smithi002 ceph-mon[40622]: osdmap e690: 8 total, 8 up, 8 in 2024-09-21T13:53:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-142", "mode": "writeback"} : dispatch 2024-09-21T13:53:53.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:52 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:53:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:52 smithi162 ceph-mon[33046]: pgmap v1061: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:53:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-142"}]': finished 2024-09-21T13:53:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:52 smithi162 ceph-mon[33046]: osdmap e690: 8 total, 8 up, 8 in 2024-09-21T13:53:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-142", "mode": "writeback"} : dispatch 2024-09-21T13:53:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:52 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:53:54.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-142", "mode": "writeback"}]': finished 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[40622]: osdmap e691: 8 total, 8 up, 8 in 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-142", "mode": "writeback"}]': finished 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[30076]: osdmap e691: 8 total, 8 up, 8 in 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:53:54.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:53:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:53:54.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:53 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:53 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:53:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-142", "mode": "writeback"}]': finished 2024-09-21T13:53:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:53 smithi162 ceph-mon[33046]: osdmap e691: 8 total, 8 up, 8 in 2024-09-21T13:53:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:53 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:53:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:53:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:53:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:53:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:53 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:53:55.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:54 smithi002 ceph-mon[40622]: pgmap v1064: 204 pgs: 204 active+clean; 4.4 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:53:55.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:53:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:54 smithi002 ceph-mon[40622]: osdmap e692: 8 total, 8 up, 8 in 2024-09-21T13:53:55.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:53:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:54 smithi002 ceph-mon[30076]: pgmap v1064: 204 pgs: 204 active+clean; 4.4 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:53:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:53:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:54 smithi002 ceph-mon[30076]: osdmap e692: 8 total, 8 up, 8 in 2024-09-21T13:53:55.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:53:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:54 smithi162 ceph-mon[33046]: pgmap v1064: 204 pgs: 204 active+clean; 4.4 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:53:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:53:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:54 smithi162 ceph-mon[33046]: osdmap e692: 8 total, 8 up, 8 in 2024-09-21T13:53:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:53:56.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:53:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:55 smithi002 ceph-mon[40622]: osdmap e693: 8 total, 8 up, 8 in 2024-09-21T13:53:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:53:56.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:55 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:53:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:55 smithi002 ceph-mon[30076]: osdmap e693: 8 total, 8 up, 8 in 2024-09-21T13:53:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:53:56.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:55 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:53:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:55 smithi162 ceph-mon[33046]: osdmap e693: 8 total, 8 up, 8 in 2024-09-21T13:53:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:53:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:55 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:53:57.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[40622]: pgmap v1067: 204 pgs: 204 active+clean; 4.4 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:53:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:53:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[40622]: osdmap e694: 8 total, 8 up, 8 in 2024-09-21T13:53:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:53:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:53:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[40622]: osdmap e695: 8 total, 8 up, 8 in 2024-09-21T13:53:57.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T13:53:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[30076]: pgmap v1067: 204 pgs: 204 active+clean; 4.4 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:53:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:53:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[30076]: osdmap e694: 8 total, 8 up, 8 in 2024-09-21T13:53:57.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:53:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:53:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[30076]: osdmap e695: 8 total, 8 up, 8 in 2024-09-21T13:53:57.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T13:53:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:56 smithi162 ceph-mon[33046]: pgmap v1067: 204 pgs: 204 active+clean; 4.4 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-21T13:53:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:53:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:56 smithi162 ceph-mon[33046]: osdmap e694: 8 total, 8 up, 8 in 2024-09-21T13:53:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:53:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:53:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:56 smithi162 ceph-mon[33046]: osdmap e695: 8 total, 8 up, 8 in 2024-09-21T13:53:57.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_grade_decay_rate","val": "20"} : dispatch 2024-09-21T13:53:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:58 smithi002 ceph-mon[30076]: pgmap v1070: 204 pgs: 204 active+clean; 4.4 MiB data, 727 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:53:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T13:53:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:58 smithi002 ceph-mon[30076]: osdmap e696: 8 total, 8 up, 8 in 2024-09-21T13:53:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:58 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T13:53:59.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:58 smithi002 ceph-mon[40622]: pgmap v1070: 204 pgs: 204 active+clean; 4.4 MiB data, 727 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:53:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T13:53:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:58 smithi002 ceph-mon[40622]: osdmap e696: 8 total, 8 up, 8 in 2024-09-21T13:53:59.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:58 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T13:53:59.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:59.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:58 smithi162 ceph-mon[33046]: pgmap v1070: 204 pgs: 204 active+clean; 4.4 MiB data, 727 MiB used, 715 GiB / 715 GiB avail 2024-09-21T13:53:59.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-21T13:53:59.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:58 smithi162 ceph-mon[33046]: osdmap e696: 8 total, 8 up, 8 in 2024-09-21T13:53:59.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_search_last_n","val": "1"} : dispatch 2024-09-21T13:53:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:53:59.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:53:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:54:00.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T13:54:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:59 smithi002 ceph-mon[30076]: osdmap e697: 8 total, 8 up, 8 in 2024-09-21T13:54:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:53:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:53:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:53:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:54:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T13:54:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:59 smithi002 ceph-mon[40622]: osdmap e697: 8 total, 8 up, 8 in 2024-09-21T13:54:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:53:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:00.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-21T13:54:00.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:59 smithi162 ceph-mon[33046]: osdmap e697: 8 total, 8 up, 8 in 2024-09-21T13:54:00.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:53:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:01.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:00 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:00 smithi002 ceph-mon[40622]: pgmap v1073: 204 pgs: 204 active+clean; 4.4 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:00 smithi002 ceph-mon[40622]: osdmap e698: 8 total, 8 up, 8 in 2024-09-21T13:54:01.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142"} : dispatch 2024-09-21T13:54:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:00 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:00 smithi002 ceph-mon[30076]: pgmap v1073: 204 pgs: 204 active+clean; 4.4 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:00 smithi002 ceph-mon[30076]: osdmap e698: 8 total, 8 up, 8 in 2024-09-21T13:54:01.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142"} : dispatch 2024-09-21T13:54:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:00 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:00 smithi162 ceph-mon[33046]: pgmap v1073: 204 pgs: 204 active+clean; 4.4 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:00 smithi162 ceph-mon[33046]: osdmap e698: 8 total, 8 up, 8 in 2024-09-21T13:54:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142"} : dispatch 2024-09-21T13:54:02.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142"}]': finished 2024-09-21T13:54:02.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:01 smithi002 ceph-mon[30076]: osdmap e699: 8 total, 8 up, 8 in 2024-09-21T13:54:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:02.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142"} : dispatch 2024-09-21T13:54:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142"}]': finished 2024-09-21T13:54:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:01 smithi002 ceph-mon[40622]: osdmap e699: 8 total, 8 up, 8 in 2024-09-21T13:54:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:02.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142"} : dispatch 2024-09-21T13:54:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142"}]': finished 2024-09-21T13:54:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:01 smithi162 ceph-mon[33046]: osdmap e699: 8 total, 8 up, 8 in 2024-09-21T13:54:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:02.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-142"} : dispatch 2024-09-21T13:54:03.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:02 smithi002 ceph-mon[30076]: pgmap v1076: 204 pgs: 204 active+clean; 4.4 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:02 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:03.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:02 smithi002 ceph-mon[30076]: osdmap e700: 8 total, 8 up, 8 in 2024-09-21T13:54:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:02 smithi002 ceph-mon[40622]: pgmap v1076: 204 pgs: 204 active+clean; 4.4 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:02 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:03.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:02 smithi002 ceph-mon[40622]: osdmap e700: 8 total, 8 up, 8 in 2024-09-21T13:54:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:02 smithi162 ceph-mon[33046]: pgmap v1076: 204 pgs: 204 active+clean; 4.4 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:02 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:02 smithi162 ceph-mon[33046]: osdmap e700: 8 total, 8 up, 8 in 2024-09-21T13:54:04.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:03 smithi162 ceph-mon[33046]: osdmap e701: 8 total, 8 up, 8 in 2024-09-21T13:54:04.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-144","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:03 smithi002 ceph-mon[30076]: osdmap e701: 8 total, 8 up, 8 in 2024-09-21T13:54:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-144","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:03 smithi002 ceph-mon[40622]: osdmap e701: 8 total, 8 up, 8 in 2024-09-21T13:54:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-144","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:05.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:04 smithi162 ceph-mon[33046]: pgmap v1079: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:54:05.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:05.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:04 smithi162 ceph-mon[33046]: osdmap e702: 8 total, 8 up, 8 in 2024-09-21T13:54:05.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:54:05.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:04 smithi002 ceph-mon[30076]: pgmap v1079: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:54:05.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:05.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:04 smithi002 ceph-mon[30076]: osdmap e702: 8 total, 8 up, 8 in 2024-09-21T13:54:05.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:54:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:04 smithi002 ceph-mon[40622]: pgmap v1079: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:54:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:04 smithi002 ceph-mon[40622]: osdmap e702: 8 total, 8 up, 8 in 2024-09-21T13:54:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:54:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:54:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:05 smithi162 ceph-mon[33046]: osdmap e703: 8 total, 8 up, 8 in 2024-09-21T13:54:06.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:05 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-144"} : dispatch 2024-09-21T13:54:06.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:54:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:05 smithi002 ceph-mon[30076]: osdmap e703: 8 total, 8 up, 8 in 2024-09-21T13:54:06.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:05 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-144"} : dispatch 2024-09-21T13:54:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:54:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:05 smithi002 ceph-mon[40622]: osdmap e703: 8 total, 8 up, 8 in 2024-09-21T13:54:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:05 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-144"} : dispatch 2024-09-21T13:54:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:06 smithi162 ceph-mon[33046]: pgmap v1082: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:54:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-144"}]': finished 2024-09-21T13:54:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:06 smithi162 ceph-mon[33046]: osdmap e704: 8 total, 8 up, 8 in 2024-09-21T13:54:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:06 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-144", "mode": "readproxy"} : dispatch 2024-09-21T13:54:07.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:06 smithi002 ceph-mon[40622]: pgmap v1082: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:54:07.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-144"}]': finished 2024-09-21T13:54:07.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:06 smithi002 ceph-mon[40622]: osdmap e704: 8 total, 8 up, 8 in 2024-09-21T13:54:07.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:06 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-144", "mode": "readproxy"} : dispatch 2024-09-21T13:54:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:06 smithi002 ceph-mon[30076]: pgmap v1082: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T13:54:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-144"}]': finished 2024-09-21T13:54:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:06 smithi002 ceph-mon[30076]: osdmap e704: 8 total, 8 up, 8 in 2024-09-21T13:54:07.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:06 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-144", "mode": "readproxy"} : dispatch 2024-09-21T13:54:08.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:07 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:54:08.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:07 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-144", "mode": "readproxy"}]': finished 2024-09-21T13:54:08.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:07 smithi162 ceph-mon[33046]: osdmap e705: 8 total, 8 up, 8 in 2024-09-21T13:54:08.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:07 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:54:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:07 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-144", "mode": "readproxy"}]': finished 2024-09-21T13:54:08.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:07 smithi002 ceph-mon[40622]: osdmap e705: 8 total, 8 up, 8 in 2024-09-21T13:54:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:07 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:54:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:07 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-144", "mode": "readproxy"}]': finished 2024-09-21T13:54:08.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:07 smithi002 ceph-mon[30076]: osdmap e705: 8 total, 8 up, 8 in 2024-09-21T13:54:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:08 smithi162 ceph-mon[33046]: pgmap v1085: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:08 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:09.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:08 smithi002 ceph-mon[30076]: pgmap v1085: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:08 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:09.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:08 smithi002 ceph-mon[40622]: pgmap v1085: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:09.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:08 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:09.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:54:09 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:54:10.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:54:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:54:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:54:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:10 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:10 smithi162 ceph-mon[33046]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 175 B/s wr, 1 op/s 2024-09-21T13:54:11.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:10 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:11.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:10 smithi002 ceph-mon[40622]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 175 B/s wr, 1 op/s 2024-09-21T13:54:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:10 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:10 smithi002 ceph-mon[30076]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 175 B/s wr, 1 op/s 2024-09-21T13:54:13.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:12 smithi162 ceph-mon[33046]: pgmap v1087: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 897 B/s rd, 149 B/s wr, 1 op/s 2024-09-21T13:54:13.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:12 smithi002 ceph-mon[30076]: pgmap v1087: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 897 B/s rd, 149 B/s wr, 1 op/s 2024-09-21T13:54:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:12 smithi002 ceph-mon[40622]: pgmap v1087: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 897 B/s rd, 149 B/s wr, 1 op/s 2024-09-21T13:54:14.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:14 smithi162 ceph-mon[33046]: pgmap v1088: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 127 B/s wr, 1 op/s 2024-09-21T13:54:14.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:14.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:14 smithi002 ceph-mon[30076]: pgmap v1088: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 127 B/s wr, 1 op/s 2024-09-21T13:54:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:14 smithi002 ceph-mon[40622]: pgmap v1088: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 127 B/s wr, 1 op/s 2024-09-21T13:54:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:16.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:16 smithi162 ceph-mon[33046]: pgmap v1089: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 104 B/s wr, 1 op/s 2024-09-21T13:54:17.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:16 smithi002 ceph-mon[30076]: pgmap v1089: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 104 B/s wr, 1 op/s 2024-09-21T13:54:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:16 smithi002 ceph-mon[40622]: pgmap v1089: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 104 B/s wr, 1 op/s 2024-09-21T13:54:18.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:18.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:18.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:19.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:18 smithi002 ceph-mon[40622]: pgmap v1090: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 94 B/s wr, 1 op/s 2024-09-21T13:54:19.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:19.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:18 smithi002 ceph-mon[40622]: osdmap e706: 8 total, 8 up, 8 in 2024-09-21T13:54:19.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144"} : dispatch 2024-09-21T13:54:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:18 smithi002 ceph-mon[30076]: pgmap v1090: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 94 B/s wr, 1 op/s 2024-09-21T13:54:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:18 smithi002 ceph-mon[30076]: osdmap e706: 8 total, 8 up, 8 in 2024-09-21T13:54:19.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144"} : dispatch 2024-09-21T13:54:19.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:18 smithi162 ceph-mon[33046]: pgmap v1090: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 94 B/s wr, 1 op/s 2024-09-21T13:54:19.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:19.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:18 smithi162 ceph-mon[33046]: osdmap e706: 8 total, 8 up, 8 in 2024-09-21T13:54:19.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144"} : dispatch 2024-09-21T13:54:19.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:54:19 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:54:20.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:54:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:54:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:54:20.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:19 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:54:20.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144"}]': finished 2024-09-21T13:54:20.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:19 smithi002 ceph-mon[30076]: osdmap e707: 8 total, 8 up, 8 in 2024-09-21T13:54:20.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:20.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144"} : dispatch 2024-09-21T13:54:20.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:19 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:54:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144"}]': finished 2024-09-21T13:54:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:19 smithi002 ceph-mon[40622]: osdmap e707: 8 total, 8 up, 8 in 2024-09-21T13:54:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:20.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144"} : dispatch 2024-09-21T13:54:20.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:19 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:54:20.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144"}]': finished 2024-09-21T13:54:20.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:19 smithi162 ceph-mon[33046]: osdmap e707: 8 total, 8 up, 8 in 2024-09-21T13:54:20.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:20.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-144"} : dispatch 2024-09-21T13:54:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[40622]: pgmap v1093: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[40622]: osdmap e708: 8 total, 8 up, 8 in 2024-09-21T13:54:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[40622]: osdmap e709: 8 total, 8 up, 8 in 2024-09-21T13:54:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-146","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:21.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[30076]: pgmap v1093: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[30076]: osdmap e708: 8 total, 8 up, 8 in 2024-09-21T13:54:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[30076]: osdmap e709: 8 total, 8 up, 8 in 2024-09-21T13:54:21.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-146","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:20 smithi162 ceph-mon[33046]: pgmap v1093: 204 pgs: 204 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:20 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:20 smithi162 ceph-mon[33046]: osdmap e708: 8 total, 8 up, 8 in 2024-09-21T13:54:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:20 smithi162 ceph-mon[33046]: osdmap e709: 8 total, 8 up, 8 in 2024-09-21T13:54:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-146","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:23.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:22 smithi002 ceph-mon[30076]: pgmap v1096: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:23.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:23.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:22 smithi002 ceph-mon[30076]: osdmap e710: 8 total, 8 up, 8 in 2024-09-21T13:54:23.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:54:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:22 smithi002 ceph-mon[40622]: pgmap v1096: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:22 smithi002 ceph-mon[40622]: osdmap e710: 8 total, 8 up, 8 in 2024-09-21T13:54:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:54:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:22 smithi162 ceph-mon[33046]: pgmap v1096: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:54:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:22 smithi162 ceph-mon[33046]: osdmap e710: 8 total, 8 up, 8 in 2024-09-21T13:54:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:54:24.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:54:24.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:23 smithi002 ceph-mon[30076]: osdmap e711: 8 total, 8 up, 8 in 2024-09-21T13:54:24.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-146"} : dispatch 2024-09-21T13:54:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:54:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:23 smithi002 ceph-mon[40622]: osdmap e711: 8 total, 8 up, 8 in 2024-09-21T13:54:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-146"} : dispatch 2024-09-21T13:54:24.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:54:24.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:23 smithi162 ceph-mon[33046]: osdmap e711: 8 total, 8 up, 8 in 2024-09-21T13:54:24.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-146"} : dispatch 2024-09-21T13:54:25.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:24 smithi002 ceph-mon[40622]: pgmap v1099: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:54:25.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-146"}]': finished 2024-09-21T13:54:25.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:24 smithi002 ceph-mon[40622]: osdmap e712: 8 total, 8 up, 8 in 2024-09-21T13:54:25.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:24 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-146", "mode": "writeback"} : dispatch 2024-09-21T13:54:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:24 smithi002 ceph-mon[30076]: pgmap v1099: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:54:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-146"}]': finished 2024-09-21T13:54:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:24 smithi002 ceph-mon[30076]: osdmap e712: 8 total, 8 up, 8 in 2024-09-21T13:54:25.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:24 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-146", "mode": "writeback"} : dispatch 2024-09-21T13:54:25.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:24 smithi162 ceph-mon[33046]: pgmap v1099: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:54:25.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi002-76734-111", "overlaypool": "test-rados-api-smithi002-76734-146"}]': finished 2024-09-21T13:54:25.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:24 smithi162 ceph-mon[33046]: osdmap e712: 8 total, 8 up, 8 in 2024-09-21T13:54:25.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:24 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-146", "mode": "writeback"} : dispatch 2024-09-21T13:54:26.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:25 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:54:26.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-146", "mode": "writeback"}]': finished 2024-09-21T13:54:26.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:25 smithi002 ceph-mon[30076]: osdmap e713: 8 total, 8 up, 8 in 2024-09-21T13:54:26.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:25 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:54:26.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:25 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:54:26.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-146", "mode": "writeback"}]': finished 2024-09-21T13:54:26.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:25 smithi002 ceph-mon[40622]: osdmap e713: 8 total, 8 up, 8 in 2024-09-21T13:54:26.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:25 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:54:26.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:25 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-21T13:54:26.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi002-76734-146", "mode": "writeback"}]': finished 2024-09-21T13:54:26.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:25 smithi162 ceph-mon[33046]: osdmap e713: 8 total, 8 up, 8 in 2024-09-21T13:54:26.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:25 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_count","val": "2"} : dispatch 2024-09-21T13:54:27.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:26 smithi002 ceph-mon[30076]: pgmap v1102: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:54:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:54:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:26 smithi002 ceph-mon[30076]: osdmap e714: 8 total, 8 up, 8 in 2024-09-21T13:54:27.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:26 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:54:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:26 smithi002 ceph-mon[40622]: pgmap v1102: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:54:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:54:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:26 smithi002 ceph-mon[40622]: osdmap e714: 8 total, 8 up, 8 in 2024-09-21T13:54:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:26 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:54:27.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:26 smithi162 ceph-mon[33046]: pgmap v1102: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T13:54:27.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_count","val": "2"}]': finished 2024-09-21T13:54:27.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:26 smithi162 ceph-mon[33046]: osdmap e714: 8 total, 8 up, 8 in 2024-09-21T13:54:27.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:26 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_period","val": "600"} : dispatch 2024-09-21T13:54:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:54:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:27 smithi002 ceph-mon[30076]: osdmap e715: 8 total, 8 up, 8 in 2024-09-21T13:54:28.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:27 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:54:28.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:54:28.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:27 smithi002 ceph-mon[40622]: osdmap e715: 8 total, 8 up, 8 in 2024-09-21T13:54:28.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:27 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:54:28.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_period","val": "600"}]': finished 2024-09-21T13:54:28.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:27 smithi162 ceph-mon[33046]: osdmap e715: 8 total, 8 up, 8 in 2024-09-21T13:54:28.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:27 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_type","val": "bloom"} : dispatch 2024-09-21T13:54:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[30076]: pgmap v1105: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:54:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:54:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[30076]: osdmap e716: 8 total, 8 up, 8 in 2024-09-21T13:54:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:54:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:29.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[40622]: pgmap v1105: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:54:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:54:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[40622]: osdmap e716: 8 total, 8 up, 8 in 2024-09-21T13:54:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:54:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:29.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:28 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:29.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:28 smithi162 ceph-mon[33046]: pgmap v1105: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:29.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:28 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-21T13:54:29.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-21T13:54:29.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:28 smithi162 ceph-mon[33046]: osdmap e716: 8 total, 8 up, 8 in 2024-09-21T13:54:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:28 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "min_read_recency_for_promote","val": "1"} : dispatch 2024-09-21T13:54:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:28 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:29.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:28 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:29.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:54:29 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:54:30.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:54:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:54:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:54:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:54:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:29 smithi002 ceph-mon[30076]: osdmap e717: 8 total, 8 up, 8 in 2024-09-21T13:54:30.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:29 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T13:54:30.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:54:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:29 smithi002 ceph-mon[40622]: osdmap e717: 8 total, 8 up, 8 in 2024-09-21T13:54:30.101 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:29 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T13:54:30.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-21T13:54:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:29 smithi162 ceph-mon[33046]: osdmap e717: 8 total, 8 up, 8 in 2024-09-21T13:54:30.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:29 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "target_max_objects","val": "1"} : dispatch 2024-09-21T13:54:31.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:30 smithi002 ceph-mon[40622]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:54:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:30 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "target_max_objects","val": "1"}]': finished 2024-09-21T13:54:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:30 smithi002 ceph-mon[40622]: osdmap e718: 8 total, 8 up, 8 in 2024-09-21T13:54:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:30 smithi002 ceph-mon[30076]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:54:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:30 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "target_max_objects","val": "1"}]': finished 2024-09-21T13:54:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:30 smithi002 ceph-mon[30076]: osdmap e718: 8 total, 8 up, 8 in 2024-09-21T13:54:31.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:31.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:30 smithi162 ceph-mon[33046]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:54:31.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:30 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-146","var": "target_max_objects","val": "1"}]': finished 2024-09-21T13:54:31.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:30 smithi162 ceph-mon[33046]: osdmap e718: 8 total, 8 up, 8 in 2024-09-21T13:54:32.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:31 smithi162 ceph-mon[33046]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T13:54:32.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:31 smithi002 ceph-mon[30076]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T13:54:32.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:31 smithi002 ceph-mon[40622]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-21T13:54:33.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:32 smithi162 ceph-mon[33046]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:54:33.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:32 smithi002 ceph-mon[30076]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:54:33.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:32 smithi002 ceph-mon[40622]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:54:35.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:34 smithi162 ceph-mon[33046]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:54:35.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:34 smithi002 ceph-mon[40622]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:54:35.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:34 smithi002 ceph-mon[30076]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T13:54:37.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:36 smithi162 ceph-mon[33046]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:54:37.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:36 smithi002 ceph-mon[30076]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:54:37.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:36 smithi002 ceph-mon[40622]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T13:54:39.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:38 smithi162 ceph-mon[33046]: pgmap v1113: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 574 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T13:54:39.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:38 smithi002 ceph-mon[30076]: pgmap v1113: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 574 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T13:54:39.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:38 smithi002 ceph-mon[40622]: pgmap v1113: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 574 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T13:54:39.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:54:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:54:40.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:40.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:40.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:54:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:54:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:54:40.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:40 smithi162 ceph-mon[33046]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:54:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:40 smithi162 ceph-mon[33046]: osdmap e719: 8 total, 8 up, 8 in 2024-09-21T13:54:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146"} : dispatch 2024-09-21T13:54:41.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:40 smithi002 ceph-mon[30076]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:54:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:40 smithi002 ceph-mon[30076]: osdmap e719: 8 total, 8 up, 8 in 2024-09-21T13:54:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146"} : dispatch 2024-09-21T13:54:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:40 smithi002 ceph-mon[40622]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T13:54:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:40 smithi002 ceph-mon[40622]: osdmap e719: 8 total, 8 up, 8 in 2024-09-21T13:54:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146"} : dispatch 2024-09-21T13:54:42.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146"}]': finished 2024-09-21T13:54:42.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:41 smithi162 ceph-mon[33046]: osdmap e720: 8 total, 8 up, 8 in 2024-09-21T13:54:42.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:42.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:41 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146"} : dispatch 2024-09-21T13:54:42.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146"}]': finished 2024-09-21T13:54:42.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:41 smithi002 ceph-mon[30076]: osdmap e720: 8 total, 8 up, 8 in 2024-09-21T13:54:42.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:42.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:41 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146"} : dispatch 2024-09-21T13:54:42.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146"}]': finished 2024-09-21T13:54:42.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:41 smithi002 ceph-mon[40622]: osdmap e720: 8 total, 8 up, 8 in 2024-09-21T13:54:42.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:42.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:41 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-146"} : dispatch 2024-09-21T13:54:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:42 smithi162 ceph-mon[33046]: pgmap v1117: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:54:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:42 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:42 smithi162 ceph-mon[33046]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T13:54:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:42 smithi162 ceph-mon[33046]: osdmap e721: 8 total, 8 up, 8 in 2024-09-21T13:54:43.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:42 smithi002 ceph-mon[40622]: pgmap v1117: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:54:43.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:42 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:43.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:42 smithi002 ceph-mon[40622]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T13:54:43.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:42 smithi002 ceph-mon[40622]: osdmap e721: 8 total, 8 up, 8 in 2024-09-21T13:54:43.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:42 smithi002 ceph-mon[30076]: pgmap v1117: 204 pgs: 204 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:54:43.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:42 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:43.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:42 smithi002 ceph-mon[30076]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-21T13:54:43.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:42 smithi002 ceph-mon[30076]: osdmap e721: 8 total, 8 up, 8 in 2024-09-21T13:54:44.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:43 smithi162 ceph-mon[33046]: osdmap e722: 8 total, 8 up, 8 in 2024-09-21T13:54:44.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:43 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-148","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:44.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:44.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:43 smithi002 ceph-mon[30076]: osdmap e722: 8 total, 8 up, 8 in 2024-09-21T13:54:44.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:43 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-148","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:44.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:44.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:43 smithi002 ceph-mon[40622]: osdmap e722: 8 total, 8 up, 8 in 2024-09-21T13:54:44.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:43 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-148","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:44.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:45.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:44 smithi162 ceph-mon[33046]: pgmap v1120: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T13:54:45.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:45.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:44 smithi162 ceph-mon[33046]: osdmap e723: 8 total, 8 up, 8 in 2024-09-21T13:54:45.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:44 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:54:45.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:44 smithi002 ceph-mon[40622]: pgmap v1120: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T13:54:45.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:45.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:44 smithi002 ceph-mon[40622]: osdmap e723: 8 total, 8 up, 8 in 2024-09-21T13:54:45.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:44 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:54:45.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:44 smithi002 ceph-mon[30076]: pgmap v1120: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T13:54:45.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:45.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:44 smithi002 ceph-mon[30076]: osdmap e723: 8 total, 8 up, 8 in 2024-09-21T13:54:45.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:44 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148", "force_nonempty": "--force-nonempty" } : dispatch 2024-09-21T13:54:46.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:45 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:54:46.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:45 smithi162 ceph-mon[33046]: osdmap e724: 8 total, 8 up, 8 in 2024-09-21T13:54:46.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:45 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148"} : dispatch 2024-09-21T13:54:46.251 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:45 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:54:46.251 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:45 smithi002 ceph-mon[30076]: osdmap e724: 8 total, 8 up, 8 in 2024-09-21T13:54:46.251 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:45 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148"} : dispatch 2024-09-21T13:54:46.251 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:45 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-21T13:54:46.251 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:45 smithi002 ceph-mon[40622]: osdmap e724: 8 total, 8 up, 8 in 2024-09-21T13:54:46.251 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:45 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148"} : dispatch 2024-09-21T13:54:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:46 smithi162 ceph-mon[33046]: pgmap v1123: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T13:54:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148"}]': finished 2024-09-21T13:54:47.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:46 smithi162 ceph-mon[33046]: osdmap e725: 8 total, 8 up, 8 in 2024-09-21T13:54:47.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:47.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:46 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148"} : dispatch 2024-09-21T13:54:47.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:46 smithi002 ceph-mon[30076]: pgmap v1123: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T13:54:47.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148"}]': finished 2024-09-21T13:54:47.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:46 smithi002 ceph-mon[30076]: osdmap e725: 8 total, 8 up, 8 in 2024-09-21T13:54:47.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:47.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:46 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148"} : dispatch 2024-09-21T13:54:47.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:46 smithi002 ceph-mon[40622]: pgmap v1123: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-21T13:54:47.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148"}]': finished 2024-09-21T13:54:47.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:46 smithi002 ceph-mon[40622]: osdmap e725: 8 total, 8 up, 8 in 2024-09-21T13:54:47.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:47.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:46 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-148"} : dispatch 2024-09-21T13:54:48.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:47 smithi162 ceph-mon[33046]: osdmap e726: 8 total, 8 up, 8 in 2024-09-21T13:54:48.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:47 smithi002 ceph-mon[30076]: osdmap e726: 8 total, 8 up, 8 in 2024-09-21T13:54:48.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:47 smithi002 ceph-mon[40622]: osdmap e726: 8 total, 8 up, 8 in 2024-09-21T13:54:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:48 smithi162 ceph-mon[33046]: pgmap v1126: 172 pgs: 172 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:48 smithi162 ceph-mon[33046]: osdmap e727: 8 total, 8 up, 8 in 2024-09-21T13:54:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:48 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-150","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:48 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:49.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:48 smithi002 ceph-mon[30076]: pgmap v1126: 172 pgs: 172 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:49.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:48 smithi002 ceph-mon[30076]: osdmap e727: 8 total, 8 up, 8 in 2024-09-21T13:54:49.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:48 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-150","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:49.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:48 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:49.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:48 smithi002 ceph-mon[40622]: pgmap v1126: 172 pgs: 172 active+clean; 4.4 MiB data, 784 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:49.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:48 smithi002 ceph-mon[40622]: osdmap e727: 8 total, 8 up, 8 in 2024-09-21T13:54:49.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:48 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-150","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:49.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:48 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:49.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:54:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:54:49.942 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:54:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:54:50.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:50.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:49 smithi162 ceph-mon[33046]: osdmap e728: 8 total, 8 up, 8 in 2024-09-21T13:54:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:49 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-150"} : dispatch 2024-09-21T13:54:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:49 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:50.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:49 smithi162 ceph-mon[33046]: pgmap v1129: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:54:50.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:50.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[30076]: osdmap e728: 8 total, 8 up, 8 in 2024-09-21T13:54:50.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:50.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-150"} : dispatch 2024-09-21T13:54:50.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:50.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[30076]: pgmap v1129: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:54:50.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:50.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[40622]: osdmap e728: 8 total, 8 up, 8 in 2024-09-21T13:54:50.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:50.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-150"} : dispatch 2024-09-21T13:54:50.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:54:50.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:49 smithi002 ceph-mon[40622]: pgmap v1129: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:54:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:50 smithi162 ceph-mon[33046]: osdmap e729: 8 total, 8 up, 8 in 2024-09-21T13:54:51.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:50 smithi002 ceph-mon[30076]: osdmap e729: 8 total, 8 up, 8 in 2024-09-21T13:54:51.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:50 smithi002 ceph-mon[40622]: osdmap e729: 8 total, 8 up, 8 in 2024-09-21T13:54:52.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:51 smithi162 ceph-mon[33046]: osdmap e730: 8 total, 8 up, 8 in 2024-09-21T13:54:52.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:51 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-152","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:52.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:51 smithi162 ceph-mon[33046]: pgmap v1132: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:54:52.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:51 smithi002 ceph-mon[30076]: osdmap e730: 8 total, 8 up, 8 in 2024-09-21T13:54:52.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:51 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-152","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:52.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:51 smithi002 ceph-mon[30076]: pgmap v1132: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:54:52.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:51 smithi002 ceph-mon[40622]: osdmap e730: 8 total, 8 up, 8 in 2024-09-21T13:54:52.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:51 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-152","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:52.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:51 smithi002 ceph-mon[40622]: pgmap v1132: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T13:54:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:52 smithi162 ceph-mon[33046]: osdmap e731: 8 total, 8 up, 8 in 2024-09-21T13:54:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:52 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-152"} : dispatch 2024-09-21T13:54:53.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:53.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:52 smithi002 ceph-mon[30076]: osdmap e731: 8 total, 8 up, 8 in 2024-09-21T13:54:53.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:53.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:52 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-152"} : dispatch 2024-09-21T13:54:53.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:53.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:52 smithi002 ceph-mon[40622]: osdmap e731: 8 total, 8 up, 8 in 2024-09-21T13:54:53.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:53.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:52 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-152"} : dispatch 2024-09-21T13:54:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:53 smithi162 ceph-mon[33046]: osdmap e732: 8 total, 8 up, 8 in 2024-09-21T13:54:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:53 smithi162 ceph-mon[33046]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:54.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:54:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:53 smithi162 ceph-mon[33046]: pgmap v1135: 172 pgs: 172 active+clean; 4.4 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-21T13:54:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:54.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:53 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:54.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[40622]: osdmap e732: 8 total, 8 up, 8 in 2024-09-21T13:54:54.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[40622]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:54.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:54:54.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[40622]: pgmap v1135: 172 pgs: 172 active+clean; 4.4 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-21T13:54:54.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:54.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:54.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:54.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:54.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[30076]: osdmap e732: 8 total, 8 up, 8 in 2024-09-21T13:54:54.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[30076]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:54.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:54:54.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[30076]: pgmap v1135: 172 pgs: 172 active+clean; 4.4 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-21T13:54:54.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:54.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:54.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:54.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:53 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:54 smithi162 ceph-mon[33046]: osdmap e733: 8 total, 8 up, 8 in 2024-09-21T13:54:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-154","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:54 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:54:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:54 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:54:55.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:54 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:55.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:54 smithi002 ceph-mon[30076]: osdmap e733: 8 total, 8 up, 8 in 2024-09-21T13:54:55.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-154","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:55.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:54 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:54:55.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:54 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:54:55.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:54 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:55.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:54 smithi002 ceph-mon[40622]: osdmap e733: 8 total, 8 up, 8 in 2024-09-21T13:54:55.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-154","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-21T13:54:55.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:54 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:54:55.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:54 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:54:55.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:54 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:54:56.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[30076]: osdmap e734: 8 total, 8 up, 8 in 2024-09-21T13:54:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-111","var": "dedup_tier","val": "test-rados-api-smithi002-76734-154"} : dispatch 2024-09-21T13:54:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-154"} : dispatch 2024-09-21T13:54:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[30076]: pgmap v1138: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-21T13:54:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[40622]: osdmap e734: 8 total, 8 up, 8 in 2024-09-21T13:54:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-111","var": "dedup_tier","val": "test-rados-api-smithi002-76734-154"} : dispatch 2024-09-21T13:54:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:56.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-154"} : dispatch 2024-09-21T13:54:56.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:55 smithi002 ceph-mon[40622]: pgmap v1138: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-21T13:54:56.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi002-76734-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T13:54:56.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:55 smithi162 ceph-mon[33046]: osdmap e734: 8 total, 8 up, 8 in 2024-09-21T13:54:56.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd pool set","pool":"test-rados-api-smithi002-76734-111","var": "dedup_tier","val": "test-rados-api-smithi002-76734-154"} : dispatch 2024-09-21T13:54:56.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:56.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd tier remove", "pool": "test-rados-api-smithi002-76734-111", "tierpool": "test-rados-api-smithi002-76734-154"} : dispatch 2024-09-21T13:54:56.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:55 smithi162 ceph-mon[33046]: pgmap v1138: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-21T13:54:57.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:56 smithi002 ceph-mon[30076]: osdmap e735: 8 total, 8 up, 8 in 2024-09-21T13:54:57.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:56 smithi002 ceph-mon[40622]: osdmap e735: 8 total, 8 up, 8 in 2024-09-21T13:54:57.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:56 smithi162 ceph-mon[33046]: osdmap e735: 8 total, 8 up, 8 in 2024-09-21T13:54:58.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:57 smithi002 ceph-mon[30076]: osdmap e736: 8 total, 8 up, 8 in 2024-09-21T13:54:58.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:57 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:58.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:57 smithi002 ceph-mon[30076]: pgmap v1141: 164 pgs: 164 active+clean; 583 KiB data, 793 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:58.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:57 smithi002 ceph-mon[40622]: osdmap e736: 8 total, 8 up, 8 in 2024-09-21T13:54:58.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:57 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:58.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:57 smithi002 ceph-mon[40622]: pgmap v1141: 164 pgs: 164 active+clean; 583 KiB data, 793 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:58.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:58 smithi162 ceph-mon[33046]: osdmap e736: 8 total, 8 up, 8 in 2024-09-21T13:54:58.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:58 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:58.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:58 smithi162 ceph-mon[33046]: pgmap v1141: 164 pgs: 164 active+clean; 583 KiB data, 793 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:54:59.009 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7895 ms) 2024-09-21T13:54:59.009 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-21T13:54:59.009 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (12286 ms) 2024-09-21T13:54:59.009 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-21T13:54:59.009 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8032 ms) 2024-09-21T13:54:59.009 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-21T13:54:59.009 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13073 ms) 2024-09-21T13:54:59.009 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-21T13:54:59.009 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7624 ms) 2024-09-21T13:54:59.009 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-21T13:54:59.009 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8040 ms) 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: hmm, no HitSet yet 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: ok, hit_set contains 336:602f83fe:::foo:head 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9036 ms) 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,0 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: first is 1726926815 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,0 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,0 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,1726926817,1726926818,0 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,1726926817,1726926818,0 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,1726926817,1726926818,0 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,1726926817,1726926818,1726926820,1726926821,0 2024-09-21T13:54:59.010 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,1726926817,1726926818,1726926820,1726926821,0 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,1726926817,1726926818,1726926820,1726926821,0 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,1726926817,1726926818,1726926820,1726926821,1726926823,1726926824,0 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,1726926817,1726926818,1726926820,1726926821,1726926823,1726926824,0 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926815,1726926817,1726926818,1726926820,1726926821,1726926823,1726926824,0 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: got ls 1726926818,1726926820,1726926821,1726926823,1726926824,1726926826,1726926827,0 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: first now 1726926818, trimmed 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (20223 ms) 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: foo0 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14063 ms) 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-21T13:54:59.011 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (17902 ms) 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (22145 ms) 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5032 ms) 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3024 ms) 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3019 ms) 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3016 ms) 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (229879 ms total) 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-09-21T13:54:59.012 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (844987 ms total) 2024-09-21T13:54:59.013 INFO:tasks.workunit.client.0.smithi002.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-09-21T13:54:59.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76358 2024-09-21T13:54:59.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76358 2024-09-21T13:54:59.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76555 2024-09-21T13:54:59.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76555 2024-09-21T13:54:59.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77100 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77100 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76839 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76839 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76659 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76659 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76439 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76439 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76751 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76751 2024-09-21T13:54:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77215 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77215 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77258 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77258 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76459 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76459 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77143 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77143 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76330 2024-09-21T13:54:59.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76330 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76392 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76392 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77051 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77051 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76321 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76321 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76343 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76343 2024-09-21T13:54:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77420 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77420 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76602 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76602 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77507 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77507 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76707 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76707 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77195 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77195 2024-09-21T13:54:59.023 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77644 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77644 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76625 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76625 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77081 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77081 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77343 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77343 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77168 2024-09-21T13:54:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77168 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77470 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77470 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77026 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77026 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76496 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76496 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77597 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77597 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76875 2024-09-21T13:54:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76875 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76314 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76314 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76375 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76375 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76823 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76823 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76413 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76413 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=76911 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 76911 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77005 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77005 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77301 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77301 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ for t in "${!pids[@]}" 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=77663 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 77663 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ exit 0 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ cleanup 2024-09-21T13:54:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:+ pkill -P 76308 2024-09-21T13:54:59.028 INFO:tasks.workunit.client.0.smithi002.stderr:+ true 2024-09-21T13:54:59.028 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T13:54:59.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T13:54:59.060 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-21T13:54:59.062 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-21T13:54:59.062 DEBUG:teuthology.orchestra.run.smithi002:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=441784946648ff53dd310293f9dd752afeeea72a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-21T13:54:59.123 INFO:tasks.workunit.client.0.smithi002.stderr:++ uuidgen 2024-09-21T13:54:59.130 INFO:tasks.workunit.client.0.smithi002.stderr:+ p=38aaefc6-8a1e-49b1-92ce-d87544792aec 2024-09-21T13:54:59.130 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool create 38aaefc6-8a1e-49b1-92ce-d87544792aec 12 2024-09-21T13:54:59.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.218+0000 7f9546d89640 1 -- 172.21.15.2:0/1825419828 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9540103ca0 msgr2=0x7f9540104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:54:59.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.218+0000 7f9546d89640 1 --2- 172.21.15.2:0/1825419828 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9540103ca0 0x7f9540104080 secure :-1 s=READY pgs=2950 cs=0 l=1 rev1=1 crypto rx=0x7f9528009860 tx=0x7f952802a340 comp rx=0 tx=0).stop 2024-09-21T13:54:59.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.218+0000 7f9546d89640 1 -- 172.21.15.2:0/1825419828 shutdown_connections 2024-09-21T13:54:59.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.218+0000 7f9546d89640 1 --2- 172.21.15.2:0/1825419828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954010d0f0 0x7f954010f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:54:59.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.218+0000 7f9546d89640 1 --2- 172.21.15.2:0/1825419828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95401045c0 0x7f954010caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:54:59.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.218+0000 7f9546d89640 1 --2- 172.21.15.2:0/1825419828 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f9540103ca0 0x7f9540104080 unknown :-1 s=CLOSED pgs=2950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:54:59.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.218+0000 7f9546d89640 1 -- 172.21.15.2:0/1825419828 >> 172.21.15.2:0/1825419828 conn(0x7f95400fd690 msgr2=0x7f95400ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:54:59.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.218+0000 7f9546d89640 1 -- 172.21.15.2:0/1825419828 shutdown_connections 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.218+0000 7f9546d89640 1 -- 172.21.15.2:0/1825419828 wait complete. 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f9546d89640 1 Processor -- start 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f9546d89640 1 -- start start 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f9546d89640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9540103ca0 0x7f95401989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f9546d89640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f95401045c0 0x7f9540198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f9546d89640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954010d0f0 0x7f954019e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f9546d89640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9540112490 con 0x7f9540103ca0 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f9546d89640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9540112310 con 0x7f954010d0f0 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f9546d89640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f9540112610 con 0x7f95401045c0 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f953ffff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f95401045c0 0x7f9540198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f9544b25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9540103ca0 0x7f95401989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f953ffff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f95401045c0 0x7f9540198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:48280/0 (socket says 172.21.15.2:48280) 2024-09-21T13:54:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.219+0000 7f953ffff640 1 -- 172.21.15.2:0/1500377311 learned_addr learned my addr 172.21.15.2:0/1500377311 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f953ffff640 1 -- 172.21.15.2:0/1500377311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954010d0f0 msgr2=0x7f954019e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f953ffff640 1 --2- 172.21.15.2:0/1500377311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954010d0f0 0x7f954019e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f953ffff640 1 -- 172.21.15.2:0/1500377311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9540103ca0 msgr2=0x7f95401989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f953ffff640 1 --2- 172.21.15.2:0/1500377311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9540103ca0 0x7f95401989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f953ffff640 1 -- 172.21.15.2:0/1500377311 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954019ea50 con 0x7f95401045c0 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f9544b25640 1 --2- 172.21.15.2:0/1500377311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9540103ca0 0x7f95401989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f953ffff640 1 --2- 172.21.15.2:0/1500377311 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f95401045c0 0x7f9540198ef0 secure :-1 s=READY pgs=2951 cs=0 l=1 rev1=1 crypto rx=0x7f953000ef80 tx=0x7f953000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f953dffb640 1 -- 172.21.15.2:0/1500377311 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953000b570 con 0x7f95401045c0 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f953dffb640 1 -- 172.21.15.2:0/1500377311 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f953000bb90 con 0x7f95401045c0 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f9546d89640 1 -- 172.21.15.2:0/1500377311 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954019ed40 con 0x7f95401045c0 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f953dffb640 1 -- 172.21.15.2:0/1500377311 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9530016c20 con 0x7f95401045c0 2024-09-21T13:54:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.220+0000 7f9546d89640 1 -- 172.21.15.2:0/1500377311 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f95401a5400 con 0x7f95401045c0 2024-09-21T13:54:59.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.221+0000 7f9546d89640 1 -- 172.21.15.2:0/1500377311 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9540104080 con 0x7f95401045c0 2024-09-21T13:54:59.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.222+0000 7f953dffb640 1 -- 172.21.15.2:0/1500377311 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f953001d020 con 0x7f95401045c0 2024-09-21T13:54:59.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.222+0000 7f953dffb640 1 --2- 172.21.15.2:0/1500377311 >> v2:172.21.15.2:6800/2394073254 conn(0x7f952c07b110 0x7f952c07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:54:59.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.222+0000 7f953dffb640 1 -- 172.21.15.2:0/1500377311 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(738..738 src has 1..738) ==== 7442+0+0 (secure 0 0 0) 0x7f953009e5d0 con 0x7f95401045c0 2024-09-21T13:54:59.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.222+0000 7f9544b25640 1 --2- 172.21.15.2:0/1500377311 >> v2:172.21.15.2:6800/2394073254 conn(0x7f952c07b110 0x7f952c07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:54:59.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.223+0000 7f9544b25640 1 --2- 172.21.15.2:0/1500377311 >> v2:172.21.15.2:6800/2394073254 conn(0x7f952c07b110 0x7f952c07d5d0 secure :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0x7f952802a930 tx=0x7f95280058d0 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:54:59.226 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.227+0000 7f953dffb640 1 -- 172.21.15.2:0/1500377311 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f95300696c0 con 0x7f95401045c0 2024-09-21T13:54:59.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:59 smithi002 ceph-mon[30076]: osdmap e737: 8 total, 8 up, 8 in 2024-09-21T13:54:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:59 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:59 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:54:59 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:59 smithi002 ceph-mon[40622]: osdmap e737: 8 total, 8 up, 8 in 2024-09-21T13:54:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:59 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:59 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:54:59 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:59.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:54:59.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:59 smithi162 ceph-mon[33046]: osdmap e737: 8 total, 8 up, 8 in 2024-09-21T13:54:59.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:59 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-111"} : dispatch 2024-09-21T13:54:59.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:59 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:54:59.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:54:59 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:54:59.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:54:59.416+0000 7f9546d89640 1 -- 172.21.15.2:0/1500377311 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} v 0) -- 0x7f95401080c0 con 0x7f95401045c0 2024-09-21T13:54:59.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:54:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:55:00.010 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:54:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:54:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:55:00.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.015+0000 7f953dffb640 1 -- 172.21.15.2:0/1500377311 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12}]=0 pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' created v739) ==== 176+0+0 (secure 0 0 0) 0x7f953006e570 con 0x7f95401045c0 2024-09-21T13:55:00.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.133+0000 7f9546d89640 1 -- 172.21.15.2:0/1500377311 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} v 0) -- 0x7f9540107c90 con 0x7f95401045c0 2024-09-21T13:55:00.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.134+0000 7f953dffb640 1 -- 172.21.15.2:0/1500377311 <== mon.2 v2:172.21.15.2:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12}]=0 pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' already exists v739) ==== 183+0+0 (secure 0 0 0) 0x7f953009c540 con 0x7f95401045c0 2024-09-21T13:55:00.133 INFO:tasks.workunit.client.0.smithi002.stderr:pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' already exists 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 -- 172.21.15.2:0/1500377311 >> v2:172.21.15.2:6800/2394073254 conn(0x7f952c07b110 msgr2=0x7f952c07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 --2- 172.21.15.2:0/1500377311 >> v2:172.21.15.2:6800/2394073254 conn(0x7f952c07b110 0x7f952c07d5d0 secure :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0x7f952802a930 tx=0x7f95280058d0 comp rx=0 tx=0).stop 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 -- 172.21.15.2:0/1500377311 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f95401045c0 msgr2=0x7f9540198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 --2- 172.21.15.2:0/1500377311 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f95401045c0 0x7f9540198ef0 secure :-1 s=READY pgs=2951 cs=0 l=1 rev1=1 crypto rx=0x7f953000ef80 tx=0x7f953000c800 comp rx=0 tx=0).stop 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 -- 172.21.15.2:0/1500377311 shutdown_connections 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 --2- 172.21.15.2:0/1500377311 >> v2:172.21.15.2:6800/2394073254 conn(0x7f952c07b110 0x7f952c07d5d0 unknown :-1 s=CLOSED pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 --2- 172.21.15.2:0/1500377311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954010d0f0 0x7f954019e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 --2- 172.21.15.2:0/1500377311 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f95401045c0 0x7f9540198ef0 unknown :-1 s=CLOSED pgs=2951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 --2- 172.21.15.2:0/1500377311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9540103ca0 0x7f95401989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 -- 172.21.15.2:0/1500377311 >> 172.21.15.2:0/1500377311 conn(0x7f95400fd690 msgr2=0x7f95400fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 -- 172.21.15.2:0/1500377311 shutdown_connections 2024-09-21T13:55:00.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.136+0000 7f9546d89640 1 -- 172.21.15.2:0/1500377311 wait complete. 2024-09-21T13:55:00.145 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool set-quota 38aaefc6-8a1e-49b1-92ce-d87544792aec max_objects 10 2024-09-21T13:55:00.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.231+0000 7fdca4057640 1 -- 172.21.15.2:0/3198152917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c108180 msgr2=0x7fdc9c10e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:00.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.231+0000 7fdca4057640 1 --2- 172.21.15.2:0/3198152917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c108180 0x7fdc9c10e8b0 secure :-1 s=READY pgs=2830 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009ca0 tx=0x7fdc9402a8c0 comp rx=0 tx=0).stop 2024-09-21T13:55:00.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.231+0000 7fdca4057640 1 -- 172.21.15.2:0/3198152917 shutdown_connections 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.231+0000 7fdca4057640 1 --2- 172.21.15.2:0/3198152917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c108180 0x7fdc9c10e8b0 unknown :-1 s=CLOSED pgs=2830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.231+0000 7fdca4057640 1 --2- 172.21.15.2:0/3198152917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc9c107800 0x7fdc9c107c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.231+0000 7fdca4057640 1 --2- 172.21.15.2:0/3198152917 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdc9c1029b0 0x7fdc9c102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.231+0000 7fdca4057640 1 -- 172.21.15.2:0/3198152917 >> 172.21.15.2:0/3198152917 conn(0x7fdc9c076de0 msgr2=0x7fdc9c0771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.231+0000 7fdca4057640 1 -- 172.21.15.2:0/3198152917 shutdown_connections 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.231+0000 7fdca4057640 1 -- 172.21.15.2:0/3198152917 wait complete. 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.231+0000 7fdca4057640 1 Processor -- start 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.231+0000 7fdca4057640 1 -- start start 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca4057640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdc9c1029b0 0x7fdc9c198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca4057640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c107800 0x7fdc9c198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca4057640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc9c108180 0x7fdc9c19e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:00.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca4057640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c112580 con 0x7fdc9c107800 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca4057640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c112400 con 0x7fdc9c108180 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca4057640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9c112700 con 0x7fdc9c1029b0 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca1df3640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdc9c1029b0 0x7fdc9c198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca1df3640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdc9c1029b0 0x7fdc9c198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:48304/0 (socket says 172.21.15.2:48304) 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca15f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c107800 0x7fdc9c198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca1df3640 1 -- 172.21.15.2:0/2173155523 learned_addr learned my addr 172.21.15.2:0/2173155523 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca25f4640 1 --2- 172.21.15.2:0/2173155523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc9c108180 0x7fdc9c19e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca1df3640 1 -- 172.21.15.2:0/2173155523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc9c108180 msgr2=0x7fdc9c19e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca1df3640 1 --2- 172.21.15.2:0/2173155523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc9c108180 0x7fdc9c19e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca1df3640 1 -- 172.21.15.2:0/2173155523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c107800 msgr2=0x7fdc9c198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca1df3640 1 --2- 172.21.15.2:0/2173155523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c107800 0x7fdc9c198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca1df3640 1 -- 172.21.15.2:0/2173155523 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c19eae0 con 0x7fdc9c1029b0 2024-09-21T13:55:00.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca25f4640 1 --2- 172.21.15.2:0/2173155523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc9c108180 0x7fdc9c19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:55:00.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca15f2640 1 --2- 172.21.15.2:0/2173155523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c107800 0x7fdc9c198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:55:00.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca1df3640 1 --2- 172.21.15.2:0/2173155523 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdc9c1029b0 0x7fdc9c198a40 secure :-1 s=READY pgs=2952 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800ea60 tx=0x7fdc9800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:55:00.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdc92ffd640 1 -- 172.21.15.2:0/2173155523 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9800cde0 con 0x7fdc9c1029b0 2024-09-21T13:55:00.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca4057640 1 -- 172.21.15.2:0/2173155523 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c19edd0 con 0x7fdc9c1029b0 2024-09-21T13:55:00.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdc92ffd640 1 -- 172.21.15.2:0/2173155523 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fdc980035f0 con 0x7fdc9c1029b0 2024-09-21T13:55:00.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdc92ffd640 1 -- 172.21.15.2:0/2173155523 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc980044a0 con 0x7fdc9c1029b0 2024-09-21T13:55:00.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.232+0000 7fdca4057640 1 -- 172.21.15.2:0/2173155523 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c1a5670 con 0x7fdc9c1029b0 2024-09-21T13:55:00.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.233+0000 7fdca4057640 1 -- 172.21.15.2:0/2173155523 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9c102d90 con 0x7fdc9c1029b0 2024-09-21T13:55:00.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.234+0000 7fdc92ffd640 1 -- 172.21.15.2:0/2173155523 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7fdc98004000 con 0x7fdc9c1029b0 2024-09-21T13:55:00.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.235+0000 7fdc92ffd640 1 --2- 172.21.15.2:0/2173155523 >> v2:172.21.15.2:6800/2394073254 conn(0x7fdc8807b110 0x7fdc8807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:00.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.235+0000 7fdc92ffd640 1 -- 172.21.15.2:0/2173155523 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(739..739 src has 1..739) ==== 7817+0+0 (secure 0 0 0) 0x7fdc9809ed70 con 0x7fdc9c1029b0 2024-09-21T13:55:00.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.235+0000 7fdca15f2640 1 --2- 172.21.15.2:0/2173155523 >> v2:172.21.15.2:6800/2394073254 conn(0x7fdc8807b110 0x7fdc8807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:00.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.235+0000 7fdca15f2640 1 --2- 172.21.15.2:0/2173155523 >> v2:172.21.15.2:6800/2394073254 conn(0x7fdc8807b110 0x7fdc8807d5d0 secure :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0ff770 tx=0x7fdc8c005f90 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:55:00.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.239+0000 7fdc92ffd640 1 -- 172.21.15.2:0/2173155523 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc98069cf0 con 0x7fdc9c1029b0 2024-09-21T13:55:00.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:55:00.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[30076]: osdmap e738: 8 total, 8 up, 8 in 2024-09-21T13:55:00.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:00.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1500377311' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:00.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:00.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[30076]: pgmap v1144: 164 pgs: 164 active+clean; 583 KiB data, 809 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:55:00.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:55:00.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[40622]: osdmap e738: 8 total, 8 up, 8 in 2024-09-21T13:55:00.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:00.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1500377311' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:00.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:00.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:00 smithi002 ceph-mon[40622]: pgmap v1144: 164 pgs: 164 active+clean; 583 KiB data, 809 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:55:00.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:00.428+0000 7fdca4057640 1 -- 172.21.15.2:0/2173155523 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} v 0) -- 0x7fdc9c199b60 con 0x7fdc9c1029b0 2024-09-21T13:55:00.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/3382456582' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi002-76734-111"}]': finished 2024-09-21T13:55:00.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:00 smithi162 ceph-mon[33046]: osdmap e738: 8 total, 8 up, 8 in 2024-09-21T13:55:00.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:00 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:00.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:00 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1500377311' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:00.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:00 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:00.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:00 smithi162 ceph-mon[33046]: pgmap v1144: 164 pgs: 164 active+clean; 583 KiB data, 809 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:55:01.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:01.016+0000 7fdc92ffd640 1 -- 172.21.15.2:0/2173155523 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v740) ==== 223+0+0 (secure 0 0 0) 0x7fdc9806eba0 con 0x7fdc9c1029b0 2024-09-21T13:55:01.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:01.140+0000 7fdca4057640 1 -- 172.21.15.2:0/2173155523 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} v 0) -- 0x7fdc9c1a5840 con 0x7fdc9c1029b0 2024-09-21T13:55:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12}]': finished 2024-09-21T13:55:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[40622]: osdmap e739: 8 total, 8 up, 8 in 2024-09-21T13:55:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1500377311' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2173155523' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12}]': finished 2024-09-21T13:55:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[30076]: osdmap e739: 8 total, 8 up, 8 in 2024-09-21T13:55:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1500377311' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:01.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2173155523' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:01.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:01 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:01.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12}]': finished 2024-09-21T13:55:01.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:01 smithi162 ceph-mon[33046]: osdmap e739: 8 total, 8 up, 8 in 2024-09-21T13:55:01.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1500377311' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:01.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pg_num": 12} : dispatch 2024-09-21T13:55:01.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:01 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2173155523' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:01.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:01 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:02.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.028+0000 7fdc92ffd640 1 -- 172.21.15.2:0/2173155523 <== mon.2 v2:172.21.15.2:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v741) ==== 223+0+0 (secure 0 0 0) 0x7fdc9809cb70 con 0x7fdc9c1029b0 2024-09-21T13:55:02.029 INFO:tasks.workunit.client.0.smithi002.stderr:set-quota max_objects = 10 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec 2024-09-21T13:55:02.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.031+0000 7fdca4057640 1 -- 172.21.15.2:0/2173155523 >> v2:172.21.15.2:6800/2394073254 conn(0x7fdc8807b110 msgr2=0x7fdc8807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:02.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.031+0000 7fdca4057640 1 --2- 172.21.15.2:0/2173155523 >> v2:172.21.15.2:6800/2394073254 conn(0x7fdc8807b110 0x7fdc8807d5d0 secure :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0ff770 tx=0x7fdc8c005f90 comp rx=0 tx=0).stop 2024-09-21T13:55:02.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.031+0000 7fdca4057640 1 -- 172.21.15.2:0/2173155523 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdc9c1029b0 msgr2=0x7fdc9c198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:02.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.031+0000 7fdca4057640 1 --2- 172.21.15.2:0/2173155523 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdc9c1029b0 0x7fdc9c198a40 secure :-1 s=READY pgs=2952 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800ea60 tx=0x7fdc9800ef20 comp rx=0 tx=0).stop 2024-09-21T13:55:02.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.032+0000 7fdca4057640 1 -- 172.21.15.2:0/2173155523 shutdown_connections 2024-09-21T13:55:02.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.032+0000 7fdca4057640 1 --2- 172.21.15.2:0/2173155523 >> v2:172.21.15.2:6800/2394073254 conn(0x7fdc8807b110 0x7fdc8807d5d0 unknown :-1 s=CLOSED pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:02.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.032+0000 7fdca4057640 1 --2- 172.21.15.2:0/2173155523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc9c108180 0x7fdc9c19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:02.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.032+0000 7fdca4057640 1 --2- 172.21.15.2:0/2173155523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c107800 0x7fdc9c198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:02.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.032+0000 7fdca4057640 1 --2- 172.21.15.2:0/2173155523 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fdc9c1029b0 0x7fdc9c198a40 unknown :-1 s=CLOSED pgs=2952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:02.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.032+0000 7fdca4057640 1 -- 172.21.15.2:0/2173155523 >> 172.21.15.2:0/2173155523 conn(0x7fdc9c076de0 msgr2=0x7fdc9c100290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:55:02.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.032+0000 7fdca4057640 1 -- 172.21.15.2:0/2173155523 shutdown_connections 2024-09-21T13:55:02.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.032+0000 7fdca4057640 1 -- 172.21.15.2:0/2173155523 wait complete. 2024-09-21T13:55:02.042 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool application enable 38aaefc6-8a1e-49b1-92ce-d87544792aec rados 2024-09-21T13:55:02.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.133+0000 7f4f76abd640 1 -- 172.21.15.2:0/3982256690 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4f70107690 msgr2=0x7f4f70107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:02.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.133+0000 7f4f76abd640 1 --2- 172.21.15.2:0/3982256690 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4f70107690 0x7f4f70107ad0 secure :-1 s=READY pgs=2953 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009900 tx=0x7f4f6402a410 comp rx=0 tx=0).stop 2024-09-21T13:55:02.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.133+0000 7f4f76abd640 1 -- 172.21.15.2:0/3982256690 shutdown_connections 2024-09-21T13:55:02.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.133+0000 7f4f76abd640 1 --2- 172.21.15.2:0/3982256690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f70108010 0x7f4f7010e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:02.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.133+0000 7f4f76abd640 1 --2- 172.21.15.2:0/3982256690 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4f70107690 0x7f4f70107ad0 unknown :-1 s=CLOSED pgs=2953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:02.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.133+0000 7f4f76abd640 1 --2- 172.21.15.2:0/3982256690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f70101c90 0x7f4f70102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:02.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.133+0000 7f4f76abd640 1 -- 172.21.15.2:0/3982256690 >> 172.21.15.2:0/3982256690 conn(0x7f4f700fd690 msgr2=0x7f4f700ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:55:02.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f76abd640 1 -- 172.21.15.2:0/3982256690 shutdown_connections 2024-09-21T13:55:02.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f76abd640 1 -- 172.21.15.2:0/3982256690 wait complete. 2024-09-21T13:55:02.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f76abd640 1 Processor -- start 2024-09-21T13:55:02.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f76abd640 1 -- start start 2024-09-21T13:55:02.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f76abd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f70101c90 0x7f4f70198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:02.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f76abd640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4f70107690 0x7f4f70198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:02.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f76abd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f70108010 0x7f4f7019e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:02.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f76abd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f701113e0 con 0x7f4f70101c90 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f76abd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4f70111260 con 0x7f4f70108010 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f76abd640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f4f70111560 con 0x7f4f70107690 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f74859640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f70101c90 0x7f4f70198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f6ffff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4f70107690 0x7f4f70198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f74859640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f70101c90 0x7f4f70198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49192/0 (socket says 172.21.15.2:49192) 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f6ffff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4f70107690 0x7f4f70198f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:48320/0 (socket says 172.21.15.2:48320) 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.134+0000 7f4f74859640 1 -- 172.21.15.2:0/290535785 learned_addr learned my addr 172.21.15.2:0/290535785 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f7505a640 1 --2- 172.21.15.2:0/290535785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f70108010 0x7f4f7019e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f6ffff640 1 -- 172.21.15.2:0/290535785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f70108010 msgr2=0x7f4f7019e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f6ffff640 1 --2- 172.21.15.2:0/290535785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f70108010 0x7f4f7019e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f6ffff640 1 -- 172.21.15.2:0/290535785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f70101c90 msgr2=0x7f4f70198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f6ffff640 1 --2- 172.21.15.2:0/290535785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f70101c90 0x7f4f70198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:02.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f6ffff640 1 -- 172.21.15.2:0/290535785 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7019eac0 con 0x7f4f70107690 2024-09-21T13:55:02.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f74859640 1 --2- 172.21.15.2:0/290535785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f70101c90 0x7f4f70198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:55:02.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f6ffff640 1 --2- 172.21.15.2:0/290535785 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4f70107690 0x7f4f70198f60 secure :-1 s=READY pgs=2954 cs=0 l=1 rev1=1 crypto rx=0x7f4f6402a930 tx=0x7f4f640329c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:55:02.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f6dffb640 1 -- 172.21.15.2:0/290535785 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6403f030 con 0x7f4f70107690 2024-09-21T13:55:02.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f6dffb640 1 -- 172.21.15.2:0/290535785 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f4f640044c0 con 0x7f4f70107690 2024-09-21T13:55:02.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f76abd640 1 -- 172.21.15.2:0/290535785 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7019ed50 con 0x7f4f70107690 2024-09-21T13:55:02.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f6dffb640 1 -- 172.21.15.2:0/290535785 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f64035070 con 0x7f4f70107690 2024-09-21T13:55:02.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.135+0000 7f4f76abd640 1 -- 172.21.15.2:0/290535785 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f701a5470 con 0x7f4f70107690 2024-09-21T13:55:02.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.137+0000 7f4f76abd640 1 -- 172.21.15.2:0/290535785 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f70102070 con 0x7f4f70107690 2024-09-21T13:55:02.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.137+0000 7f4f6dffb640 1 -- 172.21.15.2:0/290535785 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f4f64042030 con 0x7f4f70107690 2024-09-21T13:55:02.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.138+0000 7f4f6dffb640 1 --2- 172.21.15.2:0/290535785 >> v2:172.21.15.2:6800/2394073254 conn(0x7f4f5807b110 0x7f4f5807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:02.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.138+0000 7f4f6dffb640 1 -- 172.21.15.2:0/290535785 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(741..741 src has 1..741) ==== 7817+0+0 (secure 0 0 0) 0x7f4f640beb90 con 0x7f4f70107690 2024-09-21T13:55:02.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.138+0000 7f4f74859640 1 --2- 172.21.15.2:0/290535785 >> v2:172.21.15.2:6800/2394073254 conn(0x7f4f5807b110 0x7f4f5807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:02.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.138+0000 7f4f74859640 1 --2- 172.21.15.2:0/290535785 >> v2:172.21.15.2:6800/2394073254 conn(0x7f4f5807b110 0x7f4f5807d5d0 secure :-1 s=READY pgs=3873 cs=0 l=1 rev1=1 crypto rx=0x7f4f60005fd0 tx=0x7f4f6000b480 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:55:02.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.142+0000 7f4f6dffb640 1 -- 172.21.15.2:0/290535785 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f64089b90 con 0x7f4f70107690 2024-09-21T13:55:02.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:02.336+0000 7f4f76abd640 1 -- 172.21.15.2:0/290535785 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} v 0) -- 0x7f4f7010ae00 con 0x7f4f70107690 2024-09-21T13:55:02.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:55:02.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:02 smithi002 ceph-mon[40622]: osdmap e740: 8 total, 8 up, 8 in 2024-09-21T13:55:02.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:02 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2173155523' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:02.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:02 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:02.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:02 smithi002 ceph-mon[40622]: pgmap v1147: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:55:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:02 smithi002 ceph-mon[30076]: osdmap e740: 8 total, 8 up, 8 in 2024-09-21T13:55:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:02 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2173155523' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:02 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:02.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:02 smithi002 ceph-mon[30076]: pgmap v1147: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:02.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:55:02.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:02 smithi162 ceph-mon[33046]: osdmap e740: 8 total, 8 up, 8 in 2024-09-21T13:55:02.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:02 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2173155523' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:02.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:02 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:55:02.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:02 smithi162 ceph-mon[33046]: pgmap v1147: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:03.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:03.031+0000 7f4f6dffb640 1 -- 172.21.15.2:0/290535785 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"}]=0 enabled application 'rados' on pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' v742) ==== 213+0+0 (secure 0 0 0) 0x7f4f6408ea40 con 0x7f4f70107690 2024-09-21T13:55:03.148 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:03.148+0000 7f4f76abd640 1 -- 172.21.15.2:0/290535785 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} v 0) -- 0x7f4f7010aa10 con 0x7f4f70107690 2024-09-21T13:55:03.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:55:03.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:03 smithi002 ceph-mon[30076]: osdmap e741: 8 total, 8 up, 8 in 2024-09-21T13:55:03.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:03 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/290535785' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:03.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:03 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:55:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:03 smithi002 ceph-mon[40622]: osdmap e741: 8 total, 8 up, 8 in 2024-09-21T13:55:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:03 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/290535785' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:03 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:03.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:55:03.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:03 smithi162 ceph-mon[33046]: osdmap e741: 8 total, 8 up, 8 in 2024-09-21T13:55:03.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:03 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/290535785' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:03.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:03 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:04.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.051+0000 7f4f6dffb640 1 -- 172.21.15.2:0/290535785 <== mon.2 v2:172.21.15.2:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"}]=0 enabled application 'rados' on pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' v743) ==== 213+0+0 (secure 0 0 0) 0x7f4f64004750 con 0x7f4f70107690 2024-09-21T13:55:04.051 INFO:tasks.workunit.client.0.smithi002.stderr:enabled application 'rados' on pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' 2024-09-21T13:55:04.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 -- 172.21.15.2:0/290535785 >> v2:172.21.15.2:6800/2394073254 conn(0x7f4f5807b110 msgr2=0x7f4f5807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:04.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 --2- 172.21.15.2:0/290535785 >> v2:172.21.15.2:6800/2394073254 conn(0x7f4f5807b110 0x7f4f5807d5d0 secure :-1 s=READY pgs=3873 cs=0 l=1 rev1=1 crypto rx=0x7f4f60005fd0 tx=0x7f4f6000b480 comp rx=0 tx=0).stop 2024-09-21T13:55:04.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 -- 172.21.15.2:0/290535785 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4f70107690 msgr2=0x7f4f70198f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:04.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 --2- 172.21.15.2:0/290535785 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4f70107690 0x7f4f70198f60 secure :-1 s=READY pgs=2954 cs=0 l=1 rev1=1 crypto rx=0x7f4f6402a930 tx=0x7f4f640329c0 comp rx=0 tx=0).stop 2024-09-21T13:55:04.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 -- 172.21.15.2:0/290535785 shutdown_connections 2024-09-21T13:55:04.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 --2- 172.21.15.2:0/290535785 >> v2:172.21.15.2:6800/2394073254 conn(0x7f4f5807b110 0x7f4f5807d5d0 unknown :-1 s=CLOSED pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:04.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 --2- 172.21.15.2:0/290535785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f70108010 0x7f4f7019e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:04.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 --2- 172.21.15.2:0/290535785 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f4f70107690 0x7f4f70198f60 unknown :-1 s=CLOSED pgs=2954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:04.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 --2- 172.21.15.2:0/290535785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f70101c90 0x7f4f70198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:04.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 -- 172.21.15.2:0/290535785 >> 172.21.15.2:0/290535785 conn(0x7f4f700fd690 msgr2=0x7f4f7006b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:55:04.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 -- 172.21.15.2:0/290535785 shutdown_connections 2024-09-21T13:55:04.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:04.055+0000 7f4f76abd640 1 -- 172.21.15.2:0/290535785 wait complete. 2024-09-21T13:55:04.067 INFO:tasks.workunit.client.0.smithi002.stderr:++ seq 1 10 2024-09-21T13:55:04.080 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:55:04.080 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put obj1 /etc/passwd 2024-09-21T13:55:04.121 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:55:04.121 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put obj2 /etc/passwd 2024-09-21T13:55:04.160 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:55:04.160 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put obj3 /etc/passwd 2024-09-21T13:55:04.197 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:55:04.197 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put obj4 /etc/passwd 2024-09-21T13:55:04.234 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:55:04.234 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put obj5 /etc/passwd 2024-09-21T13:55:04.270 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:55:04.271 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put obj6 /etc/passwd 2024-09-21T13:55:04.308 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:55:04.308 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put obj7 /etc/passwd 2024-09-21T13:55:04.345 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:55:04.345 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put obj8 /etc/passwd 2024-09-21T13:55:04.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"}]': finished 2024-09-21T13:55:04.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[30076]: osdmap e742: 8 total, 8 up, 8 in 2024-09-21T13:55:04.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/290535785' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:04.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:04.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:55:04.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[30076]: pgmap v1150: 176 pgs: 176 active+clean; 583 KiB data, 806 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"}]': finished 2024-09-21T13:55:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[40622]: osdmap e742: 8 total, 8 up, 8 in 2024-09-21T13:55:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/290535785' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:55:04.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:04 smithi002 ceph-mon[40622]: pgmap v1150: 176 pgs: 176 active+clean; 583 KiB data, 806 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:04.382 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:55:04.382 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put obj9 /etc/passwd 2024-09-21T13:55:04.419 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:55:04.419 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put obj10 /etc/passwd 2024-09-21T13:55:04.456 INFO:tasks.workunit.client.0.smithi002.stderr:+ sleep 30 2024-09-21T13:55:04.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"}]': finished 2024-09-21T13:55:04.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:04 smithi162 ceph-mon[33046]: osdmap e742: 8 total, 8 up, 8 in 2024-09-21T13:55:04.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:04 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/290535785' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:04.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:04 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"} : dispatch 2024-09-21T13:55:04.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:04 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:55:04.483 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:04 smithi162 ceph-mon[33046]: pgmap v1150: 176 pgs: 176 active+clean; 583 KiB data, 806 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:05.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:05 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"}]': finished 2024-09-21T13:55:05.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:05 smithi002 ceph-mon[30076]: osdmap e743: 8 total, 8 up, 8 in 2024-09-21T13:55:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:05 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"}]': finished 2024-09-21T13:55:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:05 smithi002 ceph-mon[40622]: osdmap e743: 8 total, 8 up, 8 in 2024-09-21T13:55:05.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:05 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "app": "rados"}]': finished 2024-09-21T13:55:05.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:05 smithi162 ceph-mon[33046]: osdmap e743: 8 total, 8 up, 8 in 2024-09-21T13:55:05.482 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:55:05 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=sqlstore.transactions t=2024-09-21T13:55:05.035770339Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T13:55:06.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:06 smithi002 ceph-mon[30076]: pgmap v1152: 176 pgs: 176 active+clean; 583 KiB data, 806 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:55:06.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:06 smithi002 ceph-mon[40622]: pgmap v1152: 176 pgs: 176 active+clean; 583 KiB data, 806 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:55:06.482 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:06 smithi162 ceph-mon[33046]: pgmap v1152: 176 pgs: 176 active+clean; 583 KiB data, 806 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:55:09.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:08 smithi002 ceph-mon[30076]: pgmap v1153: 176 pgs: 176 active+clean; 583 KiB data, 806 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:09.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:08 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:55:09.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:08 smithi002 ceph-mon[40622]: pgmap v1153: 176 pgs: 176 active+clean; 583 KiB data, 806 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:09.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:08 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:55:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:08 smithi162 ceph-mon[33046]: pgmap v1153: 176 pgs: 176 active+clean; 583 KiB data, 806 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:08 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:55:09.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:55:09 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:55:10.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:55:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:55:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:55:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:10 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:11.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:10 smithi002 ceph-mon[30076]: pgmap v1154: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-09-21T13:55:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:10 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:11.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:10 smithi002 ceph-mon[40622]: pgmap v1154: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-09-21T13:55:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:10 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:10 smithi162 ceph-mon[33046]: pgmap v1154: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-09-21T13:55:13.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:12 smithi002 ceph-mon[30076]: pgmap v1155: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-09-21T13:55:13.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:12 smithi002 ceph-mon[40622]: pgmap v1155: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-09-21T13:55:13.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:12 smithi162 ceph-mon[33046]: pgmap v1155: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-09-21T13:55:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:13 smithi002 ceph-mon[30076]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' is full (reached quota's max_objects: 10) 2024-09-21T13:55:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:13 smithi002 ceph-mon[30076]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:55:14.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:13 smithi002 ceph-mon[30076]: osdmap e744: 8 total, 8 up, 8 in 2024-09-21T13:55:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:13 smithi002 ceph-mon[40622]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' is full (reached quota's max_objects: 10) 2024-09-21T13:55:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:13 smithi002 ceph-mon[40622]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:55:14.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:13 smithi002 ceph-mon[40622]: osdmap e744: 8 total, 8 up, 8 in 2024-09-21T13:55:14.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:13 smithi162 ceph-mon[33046]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' is full (reached quota's max_objects: 10) 2024-09-21T13:55:14.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:13 smithi162 ceph-mon[33046]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:55:14.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:13 smithi162 ceph-mon[33046]: osdmap e744: 8 total, 8 up, 8 in 2024-09-21T13:55:15.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:14 smithi002 ceph-mon[30076]: pgmap v1157: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 13 KiB/s wr, 2 op/s 2024-09-21T13:55:15.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:55:15.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:14 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:14 smithi002 ceph-mon[40622]: pgmap v1157: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 13 KiB/s wr, 2 op/s 2024-09-21T13:55:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:55:15.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:14 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:15.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:14 smithi162 ceph-mon[33046]: pgmap v1157: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 13 KiB/s wr, 2 op/s 2024-09-21T13:55:15.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:55:15.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:14 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:17.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:16 smithi002 ceph-mon[30076]: pgmap v1158: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:55:17.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:16 smithi002 ceph-mon[40622]: pgmap v1158: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:55:17.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:16 smithi162 ceph-mon[33046]: pgmap v1158: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:55:19.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:18 smithi002 ceph-mon[30076]: pgmap v1159: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:55:19.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:18 smithi002 ceph-mon[40622]: pgmap v1159: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:55:19.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:18 smithi162 ceph-mon[33046]: pgmap v1159: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:55:19.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:55:19 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:55:20.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:55:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:55:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:55:21.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:21.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:20 smithi002 ceph-mon[40622]: pgmap v1160: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:21.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:21.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:20 smithi002 ceph-mon[30076]: pgmap v1160: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:20 smithi162 ceph-mon[33046]: pgmap v1160: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:23.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:22 smithi002 ceph-mon[30076]: pgmap v1161: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:22 smithi002 ceph-mon[40622]: pgmap v1161: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:22 smithi162 ceph-mon[33046]: pgmap v1161: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:25.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:24 smithi002 ceph-mon[30076]: pgmap v1162: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:55:25.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:24 smithi002 ceph-mon[40622]: pgmap v1162: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:55:25.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:24 smithi162 ceph-mon[33046]: pgmap v1162: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:55:27.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:26 smithi002 ceph-mon[30076]: pgmap v1163: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:26 smithi002 ceph-mon[40622]: pgmap v1163: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:27.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:26 smithi162 ceph-mon[33046]: pgmap v1163: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:29.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:28 smithi002 ceph-mon[30076]: pgmap v1164: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:28 smithi002 ceph-mon[40622]: pgmap v1164: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:29.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:28 smithi162 ceph-mon[33046]: pgmap v1164: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:29.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:55:29 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:55:30.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:30.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:30.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:55:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:55:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:55:30.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:31.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:31.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:30 smithi002 ceph-mon[30076]: pgmap v1165: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:30 smithi002 ceph-mon[40622]: pgmap v1165: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:31.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:31.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:30 smithi162 ceph-mon[33046]: pgmap v1165: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:33.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:32 smithi002 ceph-mon[30076]: pgmap v1166: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:32 smithi002 ceph-mon[40622]: pgmap v1166: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:33.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:32 smithi162 ceph-mon[33046]: pgmap v1166: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=146511 2024-09-21T13:55:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool set-quota 38aaefc6-8a1e-49b1-92ce-d87544792aec max_objects 100 2024-09-21T13:55:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put onemore /etc/passwd 2024-09-21T13:55:34.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.557+0000 7f7d91d84640 1 -- 172.21.15.2:0/4066344621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d8c101c90 msgr2=0x7f7d8c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:34.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.557+0000 7f7d91d84640 1 --2- 172.21.15.2:0/4066344621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d8c101c90 0x7f7d8c102070 secure :-1 s=READY pgs=2847 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009860 tx=0x7f7d7c02a340 comp rx=0 tx=0).stop 2024-09-21T13:55:34.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.557+0000 7f7d91d84640 1 -- 172.21.15.2:0/4066344621 shutdown_connections 2024-09-21T13:55:34.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.557+0000 7f7d91d84640 1 --2- 172.21.15.2:0/4066344621 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7d8c108010 0x7f7d8c10e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:34.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.557+0000 7f7d91d84640 1 --2- 172.21.15.2:0/4066344621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d8c107690 0x7f7d8c107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:34.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.557+0000 7f7d91d84640 1 --2- 172.21.15.2:0/4066344621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d8c101c90 0x7f7d8c102070 unknown :-1 s=CLOSED pgs=2847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:34.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.557+0000 7f7d91d84640 1 -- 172.21.15.2:0/4066344621 >> 172.21.15.2:0/4066344621 conn(0x7f7d8c0fd690 msgr2=0x7f7d8c0ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:55:34.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.557+0000 7f7d91d84640 1 -- 172.21.15.2:0/4066344621 shutdown_connections 2024-09-21T13:55:34.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.557+0000 7f7d91d84640 1 -- 172.21.15.2:0/4066344621 wait complete. 2024-09-21T13:55:34.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d91d84640 1 Processor -- start 2024-09-21T13:55:34.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d91d84640 1 -- start start 2024-09-21T13:55:34.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d91d84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d8c101c90 0x7f7d8c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:34.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d91d84640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7d8c107690 0x7f7d8c199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:34.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d91d84640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d8c108010 0x7f7d8c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:34.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d91d84640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c1113e0 con 0x7f7d8c101c90 2024-09-21T13:55:34.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d91d84640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c111260 con 0x7f7d8c108010 2024-09-21T13:55:34.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d91d84640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c111560 con 0x7f7d8c107690 2024-09-21T13:55:34.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d8b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d8c101c90 0x7f7d8c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:34.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d8affd640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7d8c107690 0x7f7d8c199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d8b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d8c101c90 0x7f7d8c199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56830/0 (socket says 172.21.15.2:56830) 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d8b7fe640 1 -- 172.21.15.2:0/1040077846 learned_addr learned my addr 172.21.15.2:0/1040077846 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.558+0000 7f7d8bfff640 1 --2- 172.21.15.2:0/1040077846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d8c108010 0x7f7d8c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d8b7fe640 1 -- 172.21.15.2:0/1040077846 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7d8c107690 msgr2=0x7f7d8c199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d8b7fe640 1 --2- 172.21.15.2:0/1040077846 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7d8c107690 0x7f7d8c199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d8b7fe640 1 -- 172.21.15.2:0/1040077846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d8c108010 msgr2=0x7f7d8c19a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d8b7fe640 1 --2- 172.21.15.2:0/1040077846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d8c108010 0x7f7d8c19a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d8b7fe640 1 -- 172.21.15.2:0/1040077846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c1a4c70 con 0x7f7d8c101c90 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d8affd640 1 --2- 172.21.15.2:0/1040077846 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7d8c107690 0x7f7d8c199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d8bfff640 1 --2- 172.21.15.2:0/1040077846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d8c108010 0x7f7d8c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d8b7fe640 1 --2- 172.21.15.2:0/1040077846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d8c101c90 0x7f7d8c199870 secure :-1 s=READY pgs=2848 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009980 tx=0x7f7d7c033d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c03f020 con 0x7f7d8c101c90 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7d7c0044c0 con 0x7f7d8c101c90 2024-09-21T13:55:34.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d91d84640 1 -- 172.21.15.2:0/1040077846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c1a4f00 con 0x7f7d8c101c90 2024-09-21T13:55:34.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c037040 con 0x7f7d8c101c90 2024-09-21T13:55:34.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.559+0000 7f7d91d84640 1 -- 172.21.15.2:0/1040077846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c1a5410 con 0x7f7d8c101c90 2024-09-21T13:55:34.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.560+0000 7f7d91d84640 1 -- 172.21.15.2:0/1040077846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8c102070 con 0x7f7d8c101c90 2024-09-21T13:55:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.561+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f7d7c042020 con 0x7f7d8c101c90 2024-09-21T13:55:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.561+0000 7f7d88ff9640 1 --2- 172.21.15.2:0/1040077846 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7d7407b110 0x7f7d7407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.561+0000 7f7d8affd640 1 --2- 172.21.15.2:0/1040077846 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7d7407b110 0x7f7d7407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.561+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(744..744 src has 1..744) ==== 7830+0+0 (secure 0 0 0) 0x7f7d7c0be650 con 0x7f7d8c101c90 2024-09-21T13:55:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.562+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=745}) -- 0x7f7d740866f0 con 0x7f7d8c101c90 2024-09-21T13:55:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.562+0000 7f7d8affd640 1 --2- 172.21.15.2:0/1040077846 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7d7407b110 0x7f7d7407d5d0 secure :-1 s=READY pgs=3885 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c06bf20 tx=0x7f7d8000b410 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:55:34.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.566+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d7c049030 con 0x7f7d8c101c90 2024-09-21T13:55:34.759 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.759+0000 7f7d91d84640 1 -- 172.21.15.2:0/1040077846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"} v 0) -- 0x7f7d8c109df0 con 0x7f7d8c101c90 2024-09-21T13:55:34.821 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.820+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v745) ==== 225+0+0 (secure 0 0 0) 0x7f7d7c089640 con 0x7f7d8c101c90 2024-09-21T13:55:34.821 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.821+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 <== mon.0 v2:172.21.15.2:3300/0 8 ==== osd_map(745..745 src has 1..745) ==== 628+0+0 (secure 0 0 0) 0x7f7d7c0f5710 con 0x7f7d8c101c90 2024-09-21T13:55:34.821 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.821+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=746}) -- 0x7f7d74087610 con 0x7f7d8c101c90 2024-09-21T13:55:34.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:34.938+0000 7f7d91d84640 1 -- 172.21.15.2:0/1040077846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"} v 0) -- 0x7f7d8c109a00 con 0x7f7d8c101c90 2024-09-21T13:55:35.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:34 smithi002 ceph-mon[30076]: pgmap v1167: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:35.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:34 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T13:55:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:34 smithi002 ceph-mon[40622]: pgmap v1167: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:34 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T13:55:35.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:34 smithi162 ceph-mon[33046]: pgmap v1167: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:55:35.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:34 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T13:55:35.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.830+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 <== mon.0 v2:172.21.15.2:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v746) ==== 225+0+0 (secure 0 0 0) 0x7f7d7c08e4f0 con 0x7f7d8c101c90 2024-09-21T13:55:35.831 INFO:tasks.workunit.client.0.smithi002.stderr:set-quota max_objects = 100 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec 2024-09-21T13:55:35.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.831+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 <== mon.0 v2:172.21.15.2:3300/0 10 ==== osd_map(746..746 src has 1..746) ==== 628+0+0 (secure 0 0 0) 0x7f7d7c0bc440 con 0x7f7d8c101c90 2024-09-21T13:55:35.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.831+0000 7f7d88ff9640 1 -- 172.21.15.2:0/1040077846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=747}) -- 0x7f7d74087650 con 0x7f7d8c101c90 2024-09-21T13:55:35.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.835+0000 7f7d91d84640 1 -- 172.21.15.2:0/1040077846 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7d7407b110 msgr2=0x7f7d7407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:35.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.835+0000 7f7d91d84640 1 --2- 172.21.15.2:0/1040077846 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7d7407b110 0x7f7d7407d5d0 secure :-1 s=READY pgs=3885 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c06bf20 tx=0x7f7d8000b410 comp rx=0 tx=0).stop 2024-09-21T13:55:35.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.835+0000 7f7d91d84640 1 -- 172.21.15.2:0/1040077846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d8c101c90 msgr2=0x7f7d8c199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:35.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.835+0000 7f7d91d84640 1 --2- 172.21.15.2:0/1040077846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d8c101c90 0x7f7d8c199870 secure :-1 s=READY pgs=2848 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009980 tx=0x7f7d7c033d30 comp rx=0 tx=0).stop 2024-09-21T13:55:35.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.835+0000 7f7d91d84640 1 -- 172.21.15.2:0/1040077846 shutdown_connections 2024-09-21T13:55:35.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.835+0000 7f7d91d84640 1 --2- 172.21.15.2:0/1040077846 >> v2:172.21.15.2:6800/2394073254 conn(0x7f7d7407b110 0x7f7d7407d5d0 unknown :-1 s=CLOSED pgs=3885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:35.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.836+0000 7f7d91d84640 1 --2- 172.21.15.2:0/1040077846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d8c108010 0x7f7d8c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:35.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.836+0000 7f7d91d84640 1 --2- 172.21.15.2:0/1040077846 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f7d8c107690 0x7f7d8c199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:35.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.836+0000 7f7d91d84640 1 --2- 172.21.15.2:0/1040077846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d8c101c90 0x7f7d8c199870 unknown :-1 s=CLOSED pgs=2848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:35.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.836+0000 7f7d91d84640 1 -- 172.21.15.2:0/1040077846 >> 172.21.15.2:0/1040077846 conn(0x7f7d8c0fd690 msgr2=0x7f7d8c0ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:55:35.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.836+0000 7f7d91d84640 1 -- 172.21.15.2:0/1040077846 shutdown_connections 2024-09-21T13:55:35.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:35.836+0000 7f7d91d84640 1 -- 172.21.15.2:0/1040077846 wait complete. 2024-09-21T13:55:35.851 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 146511 2024-09-21T13:55:36.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"}]': finished 2024-09-21T13:55:36.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:35 smithi002 ceph-mon[30076]: osdmap e745: 8 total, 8 up, 8 in 2024-09-21T13:55:36.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:35 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T13:55:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"}]': finished 2024-09-21T13:55:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:35 smithi002 ceph-mon[40622]: osdmap e745: 8 total, 8 up, 8 in 2024-09-21T13:55:36.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:35 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T13:55:36.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"}]': finished 2024-09-21T13:55:36.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:35 smithi162 ceph-mon[33046]: osdmap e745: 8 total, 8 up, 8 in 2024-09-21T13:55:36.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:35 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"} : dispatch 2024-09-21T13:55:37.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:36 smithi002 ceph-mon[30076]: pgmap v1169: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:36 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"}]': finished 2024-09-21T13:55:37.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:36 smithi002 ceph-mon[30076]: osdmap e746: 8 total, 8 up, 8 in 2024-09-21T13:55:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:36 smithi002 ceph-mon[40622]: pgmap v1169: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:36 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"}]': finished 2024-09-21T13:55:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:36 smithi002 ceph-mon[40622]: osdmap e746: 8 total, 8 up, 8 in 2024-09-21T13:55:37.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:36 smithi162 ceph-mon[33046]: pgmap v1169: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:37.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:36 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1040077846' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "100"}]': finished 2024-09-21T13:55:37.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:36 smithi162 ceph-mon[33046]: osdmap e746: 8 total, 8 up, 8 in 2024-09-21T13:55:38.517 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 0 -ne 0 ']' 2024-09-21T13:55:38.518 INFO:tasks.workunit.client.0.smithi002.stderr:+ true 2024-09-21T13:55:38.518 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put twomore /etc/passwd 2024-09-21T13:55:38.559 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool set-quota 38aaefc6-8a1e-49b1-92ce-d87544792aec max_bytes 100 2024-09-21T13:55:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.647+0000 7fd32f76b640 1 -- 172.21.15.2:0/3374417249 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fd328101c90 msgr2=0x7fd328102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.647+0000 7fd32f76b640 1 --2- 172.21.15.2:0/3374417249 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fd328101c90 0x7fd328102070 secure :-1 s=READY pgs=2973 cs=0 l=1 rev1=1 crypto rx=0x7fd324009900 tx=0x7fd32402a410 comp rx=0 tx=0).stop 2024-09-21T13:55:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.647+0000 7fd32f76b640 1 -- 172.21.15.2:0/3374417249 shutdown_connections 2024-09-21T13:55:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.647+0000 7fd32f76b640 1 --2- 172.21.15.2:0/3374417249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd328108010 0x7fd32810e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.647+0000 7fd32f76b640 1 --2- 172.21.15.2:0/3374417249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd328107690 0x7fd328107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.647+0000 7fd32f76b640 1 --2- 172.21.15.2:0/3374417249 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fd328101c90 0x7fd328102070 unknown :-1 s=CLOSED pgs=2973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.647+0000 7fd32f76b640 1 -- 172.21.15.2:0/3374417249 >> 172.21.15.2:0/3374417249 conn(0x7fd3280fd690 msgr2=0x7fd3280ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.647+0000 7fd32f76b640 1 -- 172.21.15.2:0/3374417249 shutdown_connections 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.647+0000 7fd32f76b640 1 -- 172.21.15.2:0/3374417249 wait complete. 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32f76b640 1 Processor -- start 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32f76b640 1 -- start start 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32f76b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd328101c90 0x7fd3281978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32f76b640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fd328107690 0x7fd328197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32f76b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd328108010 0x7fd32819d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32f76b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd3281113e0 con 0x7fd328108010 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32f76b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd328111260 con 0x7fd328101c90 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32f76b640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fd328111560 con 0x7fd328107690 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32cd06640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fd328107690 0x7fd328197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32dd08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd328108010 0x7fd32819d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:38.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32cd06640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fd328107690 0x7fd328197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:55424/0 (socket says 172.21.15.2:55424) 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32dd08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd328108010 0x7fd32819d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58262/0 (socket says 172.21.15.2:58262) 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32cd06640 1 -- 172.21.15.2:0/728993656 learned_addr learned my addr 172.21.15.2:0/728993656 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.648+0000 7fd32d507640 1 --2- 172.21.15.2:0/728993656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd328101c90 0x7fd3281978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd32cd06640 1 -- 172.21.15.2:0/728993656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd328101c90 msgr2=0x7fd3281978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd32cd06640 1 --2- 172.21.15.2:0/728993656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd328101c90 0x7fd3281978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd32cd06640 1 -- 172.21.15.2:0/728993656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd328108010 msgr2=0x7fd32819d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd32cd06640 1 --2- 172.21.15.2:0/728993656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd328108010 0x7fd32819d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd32cd06640 1 -- 172.21.15.2:0/728993656 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32819d960 con 0x7fd328107690 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd32dd08640 1 --2- 172.21.15.2:0/728993656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd328108010 0x7fd32819d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd32cd06640 1 --2- 172.21.15.2:0/728993656 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fd328107690 0x7fd328197e00 secure :-1 s=READY pgs=2974 cs=0 l=1 rev1=1 crypto rx=0x7fd31800eb70 tx=0x7fd31800b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd31e7fc640 1 -- 172.21.15.2:0/728993656 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31800be60 con 0x7fd328107690 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd31e7fc640 1 -- 172.21.15.2:0/728993656 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fd3180035f0 con 0x7fd328107690 2024-09-21T13:55:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd32f76b640 1 -- 172.21.15.2:0/728993656 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32819dc50 con 0x7fd328107690 2024-09-21T13:55:38.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd31e7fc640 1 -- 172.21.15.2:0/728993656 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3180044a0 con 0x7fd328107690 2024-09-21T13:55:38.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.649+0000 7fd32f76b640 1 -- 172.21.15.2:0/728993656 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32806b320 con 0x7fd328107690 2024-09-21T13:55:38.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.650+0000 7fd32f76b640 1 -- 172.21.15.2:0/728993656 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd328102070 con 0x7fd328107690 2024-09-21T13:55:38.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.651+0000 7fd31e7fc640 1 -- 172.21.15.2:0/728993656 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7fd318004000 con 0x7fd328107690 2024-09-21T13:55:38.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.651+0000 7fd31e7fc640 1 --2- 172.21.15.2:0/728993656 >> v2:172.21.15.2:6800/2394073254 conn(0x7fd31407b110 0x7fd31407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:55:38.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.651+0000 7fd31e7fc640 1 -- 172.21.15.2:0/728993656 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(747..747 src has 1..747) ==== 7830+0+0 (secure 0 0 0) 0x7fd3180a0490 con 0x7fd328107690 2024-09-21T13:55:38.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.651+0000 7fd32d507640 1 --2- 172.21.15.2:0/728993656 >> v2:172.21.15.2:6800/2394073254 conn(0x7fd31407b110 0x7fd31407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:55:38.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.652+0000 7fd32d507640 1 --2- 172.21.15.2:0/728993656 >> v2:172.21.15.2:6800/2394073254 conn(0x7fd31407b110 0x7fd31407d5d0 secure :-1 s=READY pgs=3887 cs=0 l=1 rev1=1 crypto rx=0x7fd324031440 tx=0x7fd3240095f0 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:55:38.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.656+0000 7fd31e7fc640 1 -- 172.21.15.2:0/728993656 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd31806b400 con 0x7fd328107690 2024-09-21T13:55:38.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:38.844+0000 7fd32f76b640 1 -- 172.21.15.2:0/728993656 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} v 0) -- 0x7fd32806bd40 con 0x7fd328107690 2024-09-21T13:55:39.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:38 smithi002 ceph-mon[40622]: pgmap v1171: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:55:39.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:38 smithi002 ceph-mon[40622]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' no longer out of quota; removing NO_QUOTA flag 2024-09-21T13:55:39.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:38 smithi002 ceph-mon[40622]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:55:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:38 smithi002 ceph-mon[40622]: osdmap e747: 8 total, 8 up, 8 in 2024-09-21T13:55:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:38 smithi002 ceph-mon[30076]: pgmap v1171: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:55:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:38 smithi002 ceph-mon[30076]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' no longer out of quota; removing NO_QUOTA flag 2024-09-21T13:55:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:38 smithi002 ceph-mon[30076]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:55:39.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:38 smithi002 ceph-mon[30076]: osdmap e747: 8 total, 8 up, 8 in 2024-09-21T13:55:39.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:38 smithi162 ceph-mon[33046]: pgmap v1171: 176 pgs: 176 active+clean; 708 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T13:55:39.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:38 smithi162 ceph-mon[33046]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' no longer out of quota; removing NO_QUOTA flag 2024-09-21T13:55:39.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:38 smithi162 ceph-mon[33046]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:55:39.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:38 smithi162 ceph-mon[33046]: osdmap e747: 8 total, 8 up, 8 in 2024-09-21T13:55:39.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:55:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:55:39.858 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:39.858+0000 7fd31e7fc640 1 -- 172.21.15.2:0/728993656 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v748) ==== 221+0+0 (secure 0 0 0) 0x7fd3180702b0 con 0x7fd328107690 2024-09-21T13:55:39.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:39.974+0000 7fd32f76b640 1 -- 172.21.15.2:0/728993656 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} v 0) -- 0x7fd32806c0f0 con 0x7fd328107690 2024-09-21T13:55:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:39 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/728993656' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:40.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:39 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:40.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:55:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:55:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:55:40.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:39 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/728993656' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:40.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:39 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:40.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:39 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/728993656' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:40.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:39 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:40.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.863+0000 7fd31e7fc640 1 -- 172.21.15.2:0/728993656 <== mon.2 v2:172.21.15.2:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v749) ==== 221+0+0 (secure 0 0 0) 0x7fd31809e280 con 0x7fd328107690 2024-09-21T13:55:40.863 INFO:tasks.workunit.client.0.smithi002.stderr:set-quota max_bytes = 100 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec 2024-09-21T13:55:40.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.866+0000 7fd32f76b640 1 -- 172.21.15.2:0/728993656 >> v2:172.21.15.2:6800/2394073254 conn(0x7fd31407b110 msgr2=0x7fd31407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:40.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.866+0000 7fd32f76b640 1 --2- 172.21.15.2:0/728993656 >> v2:172.21.15.2:6800/2394073254 conn(0x7fd31407b110 0x7fd31407d5d0 secure :-1 s=READY pgs=3887 cs=0 l=1 rev1=1 crypto rx=0x7fd324031440 tx=0x7fd3240095f0 comp rx=0 tx=0).stop 2024-09-21T13:55:40.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.866+0000 7fd32f76b640 1 -- 172.21.15.2:0/728993656 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fd328107690 msgr2=0x7fd328197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:55:40.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.866+0000 7fd32f76b640 1 --2- 172.21.15.2:0/728993656 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fd328107690 0x7fd328197e00 secure :-1 s=READY pgs=2974 cs=0 l=1 rev1=1 crypto rx=0x7fd31800eb70 tx=0x7fd31800b690 comp rx=0 tx=0).stop 2024-09-21T13:55:40.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.866+0000 7fd32f76b640 1 -- 172.21.15.2:0/728993656 shutdown_connections 2024-09-21T13:55:40.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.866+0000 7fd32f76b640 1 --2- 172.21.15.2:0/728993656 >> v2:172.21.15.2:6800/2394073254 conn(0x7fd31407b110 0x7fd31407d5d0 unknown :-1 s=CLOSED pgs=3887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:40.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.867+0000 7fd32f76b640 1 --2- 172.21.15.2:0/728993656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd328108010 0x7fd32819d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:40.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.867+0000 7fd32f76b640 1 --2- 172.21.15.2:0/728993656 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fd328107690 0x7fd328197e00 unknown :-1 s=CLOSED pgs=2974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:40.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.867+0000 7fd32f76b640 1 --2- 172.21.15.2:0/728993656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd328101c90 0x7fd3281978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:55:40.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.867+0000 7fd32f76b640 1 -- 172.21.15.2:0/728993656 >> 172.21.15.2:0/728993656 conn(0x7fd3280fd690 msgr2=0x7fd3280ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:55:40.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.867+0000 7fd32f76b640 1 -- 172.21.15.2:0/728993656 shutdown_connections 2024-09-21T13:55:40.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:55:40.867+0000 7fd32f76b640 1 -- 172.21.15.2:0/728993656 wait complete. 2024-09-21T13:55:40.877 INFO:tasks.workunit.client.0.smithi002.stderr:+ sleep 30 2024-09-21T13:55:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:40 smithi162 ceph-mon[33046]: pgmap v1173: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-21T13:55:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T13:55:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:40 smithi162 ceph-mon[33046]: osdmap e748: 8 total, 8 up, 8 in 2024-09-21T13:55:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:40 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/728993656' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:41.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:40 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:41.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[30076]: pgmap v1173: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-21T13:55:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T13:55:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[30076]: osdmap e748: 8 total, 8 up, 8 in 2024-09-21T13:55:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/728993656' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:41.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[40622]: pgmap v1173: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-21T13:55:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T13:55:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[40622]: osdmap e748: 8 total, 8 up, 8 in 2024-09-21T13:55:41.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/728993656' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:41.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:40 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"} : dispatch 2024-09-21T13:55:42.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:41 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T13:55:42.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:41 smithi162 ceph-mon[33046]: osdmap e749: 8 total, 8 up, 8 in 2024-09-21T13:55:42.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:41 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T13:55:42.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:41 smithi002 ceph-mon[40622]: osdmap e749: 8 total, 8 up, 8 in 2024-09-21T13:55:42.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:41 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "100"}]': finished 2024-09-21T13:55:42.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:41 smithi002 ceph-mon[30076]: osdmap e749: 8 total, 8 up, 8 in 2024-09-21T13:55:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:42 smithi162 ceph-mon[33046]: pgmap v1176: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 867 B/s rd, 4.4 KiB/s wr, 1 op/s 2024-09-21T13:55:43.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:42 smithi002 ceph-mon[30076]: pgmap v1176: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 867 B/s rd, 4.4 KiB/s wr, 1 op/s 2024-09-21T13:55:43.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:42 smithi002 ceph-mon[40622]: pgmap v1176: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 867 B/s rd, 4.4 KiB/s wr, 1 op/s 2024-09-21T13:55:44.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:43 smithi162 ceph-mon[33046]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' is full (reached quota's max_bytes: 100 B) 2024-09-21T13:55:44.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:43 smithi162 ceph-mon[33046]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:55:44.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:43 smithi162 ceph-mon[33046]: osdmap e750: 8 total, 8 up, 8 in 2024-09-21T13:55:44.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:43 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:44.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:43 smithi002 ceph-mon[40622]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' is full (reached quota's max_bytes: 100 B) 2024-09-21T13:55:44.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:43 smithi002 ceph-mon[40622]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:55:44.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:43 smithi002 ceph-mon[40622]: osdmap e750: 8 total, 8 up, 8 in 2024-09-21T13:55:44.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:43 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:44.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:43 smithi002 ceph-mon[30076]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' is full (reached quota's max_bytes: 100 B) 2024-09-21T13:55:44.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:43 smithi002 ceph-mon[30076]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:55:44.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:43 smithi002 ceph-mon[30076]: osdmap e750: 8 total, 8 up, 8 in 2024-09-21T13:55:44.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:43 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:45.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:44 smithi162 ceph-mon[33046]: pgmap v1178: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 5.0 KiB/s wr, 2 op/s 2024-09-21T13:55:45.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:44 smithi002 ceph-mon[30076]: pgmap v1178: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 5.0 KiB/s wr, 2 op/s 2024-09-21T13:55:45.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:44 smithi002 ceph-mon[40622]: pgmap v1178: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 5.0 KiB/s wr, 2 op/s 2024-09-21T13:55:47.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:46 smithi002 ceph-mon[30076]: pgmap v1179: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:47.152 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:46 smithi002 ceph-mon[40622]: pgmap v1179: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:46 smithi162 ceph-mon[33046]: pgmap v1179: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:48 smithi162 ceph-mon[33046]: pgmap v1180: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 649 B/s rd, 0 op/s 2024-09-21T13:55:49.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:48 smithi002 ceph-mon[40622]: pgmap v1180: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 649 B/s rd, 0 op/s 2024-09-21T13:55:49.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:48 smithi002 ceph-mon[30076]: pgmap v1180: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 649 B/s rd, 0 op/s 2024-09-21T13:55:49.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:55:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:55:50.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:55:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:55:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:55:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:50 smithi162 ceph-mon[33046]: pgmap v1181: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:55:51.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:51.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:50 smithi002 ceph-mon[30076]: pgmap v1181: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:55:51.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:55:51.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:50 smithi002 ceph-mon[40622]: pgmap v1181: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T13:55:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:52 smithi162 ceph-mon[33046]: pgmap v1182: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:53.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:52 smithi002 ceph-mon[30076]: pgmap v1182: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:53.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:52 smithi002 ceph-mon[40622]: pgmap v1182: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:55:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:54 smithi162 ceph-mon[33046]: pgmap v1183: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:55:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:54 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:55:55.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:54 smithi002 ceph-mon[30076]: pgmap v1183: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:55:55.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:54 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:55:55.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:54 smithi002 ceph-mon[40622]: pgmap v1183: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T13:55:55.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:54 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:55:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:55 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:55:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:55 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:55:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:55 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:55:56.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:55 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:55:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:55 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:55:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:55 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:55:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:55 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:55:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:55 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:55:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:55 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:55:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:56 smithi162 ceph-mon[33046]: pgmap v1184: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:57.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:56 smithi002 ceph-mon[30076]: pgmap v1184: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:57.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:56 smithi002 ceph-mon[40622]: pgmap v1184: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:59.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:58 smithi162 ceph-mon[33046]: pgmap v1185: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:59.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:55:58 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:58 smithi002 ceph-mon[30076]: pgmap v1185: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:55:58 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:58 smithi002 ceph-mon[40622]: pgmap v1185: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:55:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:55:58 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:55:59.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:55:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:56:00.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:55:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:55:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:56:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:00 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:00 smithi162 ceph-mon[33046]: pgmap v1186: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:01.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:00 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:00 smithi002 ceph-mon[30076]: pgmap v1186: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:00 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:00 smithi002 ceph-mon[40622]: pgmap v1186: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:02 smithi162 ceph-mon[33046]: pgmap v1187: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:03.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:02 smithi002 ceph-mon[30076]: pgmap v1187: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:03.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:02 smithi002 ceph-mon[40622]: pgmap v1187: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:05.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:04 smithi162 ceph-mon[33046]: pgmap v1188: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:05.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:04 smithi002 ceph-mon[30076]: pgmap v1188: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:04 smithi002 ceph-mon[40622]: pgmap v1188: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:06 smithi162 ceph-mon[33046]: pgmap v1189: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:07.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:06 smithi002 ceph-mon[30076]: pgmap v1189: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:07.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:06 smithi002 ceph-mon[40622]: pgmap v1189: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:08 smithi162 ceph-mon[33046]: pgmap v1190: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:09.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:08 smithi002 ceph-mon[30076]: pgmap v1190: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:09.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:08 smithi002 ceph-mon[40622]: pgmap v1190: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:09.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:56:09 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:56:10.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:56:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:56:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:56:10.879 INFO:tasks.workunit.client.0.smithi002.stderr:+ pid=146680 2024-09-21T13:56:10.879 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool set-quota 38aaefc6-8a1e-49b1-92ce-d87544792aec max_bytes 0 2024-09-21T13:56:10.879 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put two /etc/passwd 2024-09-21T13:56:10.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.979+0000 7f2dec4b0640 1 -- 172.21.15.2:0/1536284200 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2de4103ca0 msgr2=0x7f2de4104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:10.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.979+0000 7f2dec4b0640 1 --2- 172.21.15.2:0/1536284200 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2de4103ca0 0x7f2de4104080 secure :-1 s=READY pgs=2977 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009860 tx=0x7f2de002a340 comp rx=0 tx=0).stop 2024-09-21T13:56:10.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.979+0000 7f2dec4b0640 1 -- 172.21.15.2:0/1536284200 shutdown_connections 2024-09-21T13:56:10.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.979+0000 7f2dec4b0640 1 --2- 172.21.15.2:0/1536284200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2de410d0f0 0x7f2de410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:10.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.979+0000 7f2dec4b0640 1 --2- 172.21.15.2:0/1536284200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2de41045c0 0x7f2de410caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:10.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.979+0000 7f2dec4b0640 1 --2- 172.21.15.2:0/1536284200 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2de4103ca0 0x7f2de4104080 unknown :-1 s=CLOSED pgs=2977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:10.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.979+0000 7f2dec4b0640 1 -- 172.21.15.2:0/1536284200 >> 172.21.15.2:0/1536284200 conn(0x7f2de40fd690 msgr2=0x7f2de40ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:56:10.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.979+0000 7f2dec4b0640 1 -- 172.21.15.2:0/1536284200 shutdown_connections 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.979+0000 7f2dec4b0640 1 -- 172.21.15.2:0/1536284200 wait complete. 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2dec4b0640 1 Processor -- start 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2dec4b0640 1 -- start start 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2dec4b0640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2de4103ca0 0x7f2de4101940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2dec4b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2de41045c0 0x7f2de4101e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2dec4b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2de410d0f0 0x7f2de41023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2dec4b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4112490 con 0x7f2de41045c0 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2dec4b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4112310 con 0x7f2de410d0f0 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2dec4b0640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f2de4112610 con 0x7f2de4103ca0 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2dea24c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2de4103ca0 0x7f2de4101940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2de9a4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2de41045c0 0x7f2de4101e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2dea24c640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2de4103ca0 0x7f2de4101940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:45298/0 (socket says 172.21.15.2:45298) 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2de9a4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2de41045c0 0x7f2de4101e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59448/0 (socket says 172.21.15.2:59448) 2024-09-21T13:56:10.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2dea24c640 1 -- 172.21.15.2:0/262972049 learned_addr learned my addr 172.21.15.2:0/262972049 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.980+0000 7f2deaa4d640 1 --2- 172.21.15.2:0/262972049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2de410d0f0 0x7f2de41023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2dea24c640 1 -- 172.21.15.2:0/262972049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2de410d0f0 msgr2=0x7f2de41023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2dea24c640 1 --2- 172.21.15.2:0/262972049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2de410d0f0 0x7f2de41023c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2dea24c640 1 -- 172.21.15.2:0/262972049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2de41045c0 msgr2=0x7f2de4101e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2dea24c640 1 --2- 172.21.15.2:0/262972049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2de41045c0 0x7f2de4101e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2dea24c640 1 -- 172.21.15.2:0/262972049 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de41a6e70 con 0x7f2de4103ca0 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2de9a4b640 1 --2- 172.21.15.2:0/262972049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2de41045c0 0x7f2de4101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2dea24c640 1 --2- 172.21.15.2:0/262972049 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2de4103ca0 0x7f2de4101940 secure :-1 s=READY pgs=2978 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009980 tx=0x7f2de0033b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de003f020 con 0x7f2de4103ca0 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2dec4b0640 1 -- 172.21.15.2:0/262972049 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de41a7100 con 0x7f2de4103ca0 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2de0004040 con 0x7f2de4103ca0 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0037040 con 0x7f2de4103ca0 2024-09-21T13:56:10.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.981+0000 7f2dec4b0640 1 -- 172.21.15.2:0/262972049 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de41a7640 con 0x7f2de4103ca0 2024-09-21T13:56:10.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.982+0000 7f2dec4b0640 1 -- 172.21.15.2:0/262972049 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de4104080 con 0x7f2de4103ca0 2024-09-21T13:56:10.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.983+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f2de0042020 con 0x7f2de4103ca0 2024-09-21T13:56:10.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.983+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/262972049 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2dd007b110 0x7f2dd007d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:10.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.983+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(750..750 src has 1..750) ==== 7830+0+0 (secure 0 0 0) 0x7f2de00be7e0 con 0x7f2de4103ca0 2024-09-21T13:56:10.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.983+0000 7f2de9a4b640 1 --2- 172.21.15.2:0/262972049 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2dd007b110 0x7f2dd007d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:10.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.984+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=751}) -- 0x7f2dd0086670 con 0x7f2de4103ca0 2024-09-21T13:56:10.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.984+0000 7f2de9a4b640 1 --2- 172.21.15.2:0/262972049 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2dd007b110 0x7f2dd007d5d0 secure :-1 s=READY pgs=3889 cs=0 l=1 rev1=1 crypto rx=0x7f2de4103430 tx=0x7f2dd4005f90 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:56:10.988 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:10.988+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2de0049020 con 0x7f2de4103ca0 2024-09-21T13:56:11.177 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:11.176+0000 7f2dec4b0640 1 -- 172.21.15.2:0/262972049 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} v 0) -- 0x7f2de4107830 con 0x7f2de4103ca0 2024-09-21T13:56:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:10 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:10 smithi162 ceph-mon[33046]: pgmap v1191: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:11.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:10 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:11.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:10 smithi002 ceph-mon[40622]: pgmap v1191: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:10 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:10 smithi002 ceph-mon[30076]: pgmap v1191: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:11.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:11.912+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 <== mon.2 v2:172.21.15.2:3301/0 7 ==== osd_map(751..751 src has 1..751) ==== 628+0+0 (secure 0 0 0) 0x7f2de00bc5d0 con 0x7f2de4103ca0 2024-09-21T13:56:11.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:11.912+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=752}) -- 0x7f2dd00871e0 con 0x7f2de4103ca0 2024-09-21T13:56:11.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:11.918+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 <== mon.2 v2:172.21.15.2:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v751) ==== 217+0+0 (secure 0 0 0) 0x7f2de0089750 con 0x7f2de4103ca0 2024-09-21T13:56:12.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.035+0000 7f2dec4b0640 1 -- 172.21.15.2:0/262972049 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} v 0) -- 0x7f2de4107830 con 0x7f2de4103ca0 2024-09-21T13:56:12.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:11 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/262972049' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:12.234 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:11 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:12.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:11 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/262972049' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:12.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:11 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:11 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/262972049' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:12.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:11 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:12.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.914+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 <== mon.2 v2:172.21.15.2:3301/0 9 ==== osd_map(752..752 src has 1..752) ==== 628+0+0 (secure 0 0 0) 0x7f2de0004460 con 0x7f2de4103ca0 2024-09-21T13:56:12.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.914+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=753}) -- 0x7f2dd00875d0 con 0x7f2de4103ca0 2024-09-21T13:56:12.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.918+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/262972049 <== mon.2 v2:172.21.15.2:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v752) ==== 217+0+0 (secure 0 0 0) 0x7f2de008e600 con 0x7f2de4103ca0 2024-09-21T13:56:12.919 INFO:tasks.workunit.client.0.smithi002.stderr:set-quota max_bytes = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec 2024-09-21T13:56:12.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 -- 172.21.15.2:0/262972049 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2dd007b110 msgr2=0x7f2dd007d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:12.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 --2- 172.21.15.2:0/262972049 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2dd007b110 0x7f2dd007d5d0 secure :-1 s=READY pgs=3889 cs=0 l=1 rev1=1 crypto rx=0x7f2de4103430 tx=0x7f2dd4005f90 comp rx=0 tx=0).stop 2024-09-21T13:56:12.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 -- 172.21.15.2:0/262972049 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2de4103ca0 msgr2=0x7f2de4101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:12.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 --2- 172.21.15.2:0/262972049 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2de4103ca0 0x7f2de4101940 secure :-1 s=READY pgs=2978 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009980 tx=0x7f2de0033b00 comp rx=0 tx=0).stop 2024-09-21T13:56:12.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 -- 172.21.15.2:0/262972049 shutdown_connections 2024-09-21T13:56:12.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 --2- 172.21.15.2:0/262972049 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2dd007b110 0x7f2dd007d5d0 unknown :-1 s=CLOSED pgs=3889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:12.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 --2- 172.21.15.2:0/262972049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2de410d0f0 0x7f2de41023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:12.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 --2- 172.21.15.2:0/262972049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2de41045c0 0x7f2de4101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:12.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 --2- 172.21.15.2:0/262972049 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f2de4103ca0 0x7f2de4101940 unknown :-1 s=CLOSED pgs=2978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:12.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 -- 172.21.15.2:0/262972049 >> 172.21.15.2:0/262972049 conn(0x7f2de40fd690 msgr2=0x7f2de4104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:56:12.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 -- 172.21.15.2:0/262972049 shutdown_connections 2024-09-21T13:56:12.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:12.923+0000 7f2dec4b0640 1 -- 172.21.15.2:0/262972049 wait complete. 2024-09-21T13:56:12.936 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool set-quota 38aaefc6-8a1e-49b1-92ce-d87544792aec max_objects 0 2024-09-21T13:56:13.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.027+0000 7fb92ac85640 1 -- 172.21.15.2:0/3269244428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9241044e0 msgr2=0x7fb924104920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:13.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.027+0000 7fb92ac85640 1 --2- 172.21.15.2:0/3269244428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9241044e0 0x7fb924104920 secure :-1 s=READY pgs=2852 cs=0 l=1 rev1=1 crypto rx=0x7fb914009ca0 tx=0x7fb91402a8c0 comp rx=0 tx=0).stop 2024-09-21T13:56:13.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.027+0000 7fb92ac85640 1 -- 172.21.15.2:0/3269244428 shutdown_connections 2024-09-21T13:56:13.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.027+0000 7fb92ac85640 1 --2- 172.21.15.2:0/3269244428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb924104e60 0x7fb92410e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:13.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.027+0000 7fb92ac85640 1 --2- 172.21.15.2:0/3269244428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9241044e0 0x7fb924104920 unknown :-1 s=CLOSED pgs=2852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:13.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.027+0000 7fb92ac85640 1 --2- 172.21.15.2:0/3269244428 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb924102120 0x7fb924102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:13.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.027+0000 7fb92ac85640 1 -- 172.21.15.2:0/3269244428 >> 172.21.15.2:0/3269244428 conn(0x7fb9240776c0 msgr2=0x7fb924077ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:56:13.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.027+0000 7fb92ac85640 1 -- 172.21.15.2:0/3269244428 shutdown_connections 2024-09-21T13:56:13.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.027+0000 7fb92ac85640 1 -- 172.21.15.2:0/3269244428 wait complete. 2024-09-21T13:56:13.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.027+0000 7fb92ac85640 1 Processor -- start 2024-09-21T13:56:13.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb92ac85640 1 -- start start 2024-09-21T13:56:13.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb92ac85640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb924102120 0x7fb924198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:13.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb92ac85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9241044e0 0x7fb924199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb92ac85640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb924104e60 0x7fb92419e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb92ac85640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb924111450 con 0x7fb9241044e0 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb92ac85640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb9241112d0 con 0x7fb924102120 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb92ac85640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fb9241115d0 con 0x7fb924104e60 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb929222640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb924104e60 0x7fb92419e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb923fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9241044e0 0x7fb924199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb929222640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb924104e60 0x7fb92419e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:45316/0 (socket says 172.21.15.2:45316) 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb929222640 1 -- 172.21.15.2:0/2284965239 learned_addr learned my addr 172.21.15.2:0/2284965239 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb928a21640 1 --2- 172.21.15.2:0/2284965239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb924102120 0x7fb924198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb929222640 1 -- 172.21.15.2:0/2284965239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb924102120 msgr2=0x7fb924198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb929222640 1 --2- 172.21.15.2:0/2284965239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb924102120 0x7fb924198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb929222640 1 -- 172.21.15.2:0/2284965239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9241044e0 msgr2=0x7fb924199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:13.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb929222640 1 --2- 172.21.15.2:0/2284965239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9241044e0 0x7fb924199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:13.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb929222640 1 -- 172.21.15.2:0/2284965239 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92419ebd0 con 0x7fb924104e60 2024-09-21T13:56:13.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb923fff640 1 --2- 172.21.15.2:0/2284965239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9241044e0 0x7fb924199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:56:13.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.028+0000 7fb929222640 1 --2- 172.21.15.2:0/2284965239 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb924104e60 0x7fb92419e400 secure :-1 s=READY pgs=2979 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d950 tx=0x7fb90c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:56:13.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.029+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c017030 con 0x7fb924104e60 2024-09-21T13:56:13.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.029+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fb90c004020 con 0x7fb924104e60 2024-09-21T13:56:13.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.029+0000 7fb92ac85640 1 -- 172.21.15.2:0/2284965239 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92419eec0 con 0x7fb924104e60 2024-09-21T13:56:13.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.029+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c003a20 con 0x7fb924104e60 2024-09-21T13:56:13.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.029+0000 7fb92ac85640 1 -- 172.21.15.2:0/2284965239 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9241a5580 con 0x7fb924104e60 2024-09-21T13:56:13.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.030+0000 7fb92ac85640 1 -- 172.21.15.2:0/2284965239 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb924102500 con 0x7fb924104e60 2024-09-21T13:56:13.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.030+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7fb90c01a070 con 0x7fb924104e60 2024-09-21T13:56:13.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.031+0000 7fb921ffb640 1 --2- 172.21.15.2:0/2284965239 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb91007b110 0x7fb91007d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:13.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.031+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(752..752 src has 1..752) ==== 7830+0+0 (secure 0 0 0) 0x7fb90c09e070 con 0x7fb924104e60 2024-09-21T13:56:13.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.031+0000 7fb928a21640 1 --2- 172.21.15.2:0/2284965239 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb91007b110 0x7fb91007d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:13.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.031+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=753}) -- 0x7fb910086670 con 0x7fb924104e60 2024-09-21T13:56:13.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.031+0000 7fb928a21640 1 --2- 172.21.15.2:0/2284965239 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb91007b110 0x7fb91007d5d0 secure :-1 s=READY pgs=3890 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0095f0 tx=0x7fb91c005f90 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:56:13.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.035+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb90c021070 con 0x7fb924104e60 2024-09-21T13:56:13.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.228+0000 7fb92ac85640 1 -- 172.21.15.2:0/2284965239 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} v 0) -- 0x7fb9241a5810 con 0x7fb924104e60 2024-09-21T13:56:13.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:12 smithi162 ceph-mon[33046]: pgmap v1192: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:13.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:56:13.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:12 smithi162 ceph-mon[33046]: osdmap e751: 8 total, 8 up, 8 in 2024-09-21T13:56:13.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:12 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/262972049' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:13.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:12 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:13.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:12 smithi002 ceph-mon[30076]: pgmap v1192: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:13.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:56:13.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:12 smithi002 ceph-mon[30076]: osdmap e751: 8 total, 8 up, 8 in 2024-09-21T13:56:13.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:12 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/262972049' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:13.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:12 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:12 smithi002 ceph-mon[40622]: pgmap v1192: 176 pgs: 176 active+clean; 733 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:56:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:12 smithi002 ceph-mon[40622]: osdmap e751: 8 total, 8 up, 8 in 2024-09-21T13:56:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:12 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/262972049' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:12 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:56:13.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.511+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 <== mon.2 v2:172.21.15.2:3301/0 7 ==== osd_map(753..753 src has 1..753) ==== 628+0+0 (secure 0 0 0) 0x7fb90c0d5710 con 0x7fb924104e60 2024-09-21T13:56:13.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.511+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=754}) -- 0x7fb9100871e0 con 0x7fb924104e60 2024-09-21T13:56:13.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.517+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 <== mon.2 v2:172.21.15.2:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v753) ==== 221+0+0 (secure 0 0 0) 0x7fb90c068fe0 con 0x7fb924104e60 2024-09-21T13:56:13.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:13.631+0000 7fb92ac85640 1 -- 172.21.15.2:0/2284965239 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} v 0) -- 0x7fb9241a5a60 con 0x7fb924104e60 2024-09-21T13:56:14.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:56:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: osdmap e752: 8 total, 8 up, 8 in 2024-09-21T13:56:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2284965239' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' no longer out of quota; removing NO_QUOTA flag 2024-09-21T13:56:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:56:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:56:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: osdmap e753: 8 total, 8 up, 8 in 2024-09-21T13:56:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2284965239' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:56:14.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:56:14.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:56:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: osdmap e752: 8 total, 8 up, 8 in 2024-09-21T13:56:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2284965239' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' no longer out of quota; removing NO_QUOTA flag 2024-09-21T13:56:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:56:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:56:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: osdmap e753: 8 total, 8 up, 8 in 2024-09-21T13:56:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2284965239' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:56:14.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: osdmap e752: 8 total, 8 up, 8 in 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2284965239' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' no longer out of quota; removing NO_QUOTA flag 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: osdmap e753: 8 total, 8 up, 8 in 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2284965239' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:56:14.351 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:56:14.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.517+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 <== mon.2 v2:172.21.15.2:3301/0 9 ==== osd_map(754..754 src has 1..754) ==== 628+0+0 (secure 0 0 0) 0x7fb90c09be60 con 0x7fb924104e60 2024-09-21T13:56:14.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.521+0000 7fb921ffb640 1 -- 172.21.15.2:0/2284965239 <== mon.2 v2:172.21.15.2:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v754) ==== 221+0+0 (secure 0 0 0) 0x7fb90c06de90 con 0x7fb924104e60 2024-09-21T13:56:14.522 INFO:tasks.workunit.client.0.smithi002.stderr:set-quota max_objects = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec 2024-09-21T13:56:14.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.525+0000 7fb92ac85640 1 -- 172.21.15.2:0/2284965239 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb91007b110 msgr2=0x7fb91007d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:14.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.525+0000 7fb92ac85640 1 --2- 172.21.15.2:0/2284965239 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb91007b110 0x7fb91007d5d0 secure :-1 s=READY pgs=3890 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0095f0 tx=0x7fb91c005f90 comp rx=0 tx=0).stop 2024-09-21T13:56:14.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.525+0000 7fb92ac85640 1 -- 172.21.15.2:0/2284965239 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb924104e60 msgr2=0x7fb92419e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:14.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.525+0000 7fb92ac85640 1 --2- 172.21.15.2:0/2284965239 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb924104e60 0x7fb92419e400 secure :-1 s=READY pgs=2979 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d950 tx=0x7fb90c00de10 comp rx=0 tx=0).stop 2024-09-21T13:56:14.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.525+0000 7fb92ac85640 1 -- 172.21.15.2:0/2284965239 shutdown_connections 2024-09-21T13:56:14.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.525+0000 7fb92ac85640 1 --2- 172.21.15.2:0/2284965239 >> v2:172.21.15.2:6800/2394073254 conn(0x7fb91007b110 0x7fb91007d5d0 unknown :-1 s=CLOSED pgs=3890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:14.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.525+0000 7fb92ac85640 1 --2- 172.21.15.2:0/2284965239 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fb924104e60 0x7fb92419e400 unknown :-1 s=CLOSED pgs=2979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:14.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.525+0000 7fb92ac85640 1 --2- 172.21.15.2:0/2284965239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9241044e0 0x7fb924199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:14.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.525+0000 7fb92ac85640 1 --2- 172.21.15.2:0/2284965239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb924102120 0x7fb924198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:14.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.525+0000 7fb92ac85640 1 -- 172.21.15.2:0/2284965239 >> 172.21.15.2:0/2284965239 conn(0x7fb9240776c0 msgr2=0x7fb92406a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:56:14.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.526+0000 7fb92ac85640 1 -- 172.21.15.2:0/2284965239 shutdown_connections 2024-09-21T13:56:14.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.526+0000 7fb92ac85640 1 -- 172.21.15.2:0/2284965239 wait complete. 2024-09-21T13:56:14.538 INFO:tasks.workunit.client.0.smithi002.stderr:+ wait 146680 2024-09-21T13:56:14.538 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' 0 -ne 0 ']' 2024-09-21T13:56:14.538 INFO:tasks.workunit.client.0.smithi002.stderr:+ true 2024-09-21T13:56:14.538 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put three /etc/passwd 2024-09-21T13:56:14.578 INFO:tasks.workunit.client.0.smithi002.stderr:++ uuidgen 2024-09-21T13:56:14.579 INFO:tasks.workunit.client.0.smithi002.stderr:+ pp=9395fcd5-0867-411e-8183-9f38ae58245b 2024-09-21T13:56:14.579 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool create 9395fcd5-0867-411e-8183-9f38ae58245b 12 2024-09-21T13:56:14.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.666+0000 7f0c93893640 1 -- 172.21.15.2:0/574310085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c8c10f3d0 msgr2=0x7f0c8c1117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:14.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.666+0000 7f0c93893640 1 --2- 172.21.15.2:0/574310085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c8c10f3d0 0x7f0c8c1117c0 secure :-1 s=READY pgs=2856 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009900 tx=0x7f0c8402a480 comp rx=0 tx=0).stop 2024-09-21T13:56:14.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.666+0000 7f0c93893640 1 -- 172.21.15.2:0/574310085 shutdown_connections 2024-09-21T13:56:14.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.666+0000 7f0c93893640 1 --2- 172.21.15.2:0/574310085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c8c10f3d0 0x7f0c8c1117c0 unknown :-1 s=CLOSED pgs=2856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:14.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.666+0000 7f0c93893640 1 --2- 172.21.15.2:0/574310085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c102140 0x7f0c8c10ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:14.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.666+0000 7f0c93893640 1 --2- 172.21.15.2:0/574310085 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0c8c101820 0x7f0c8c101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:14.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.666+0000 7f0c93893640 1 -- 172.21.15.2:0/574310085 >> 172.21.15.2:0/574310085 conn(0x7f0c8c0fd690 msgr2=0x7f0c8c0ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:56:14.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.666+0000 7f0c93893640 1 -- 172.21.15.2:0/574310085 shutdown_connections 2024-09-21T13:56:14.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.666+0000 7f0c93893640 1 -- 172.21.15.2:0/574310085 wait complete. 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c93893640 1 Processor -- start 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c93893640 1 -- start start 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c93893640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0c8c101820 0x7f0c8c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c93893640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c102140 0x7f0c8c19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c93893640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c8c10f3d0 0x7f0c8c1a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c93893640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c114690 con 0x7f0c8c10f3d0 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c93893640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c114510 con 0x7f0c8c102140 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c93893640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f0c8c114810 con 0x7f0c8c101820 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c91e30640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c8c10f3d0 0x7f0c8c1a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c9162f640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0c8c101820 0x7f0c8c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c91e30640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c8c10f3d0 0x7f0c8c1a04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59512/0 (socket says 172.21.15.2:59512) 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.667+0000 7f0c91e30640 1 -- 172.21.15.2:0/2277785659 learned_addr learned my addr 172.21.15.2:0/2277785659 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:56:14.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c90e2e640 1 --2- 172.21.15.2:0/2277785659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c102140 0x7f0c8c19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c91e30640 1 -- 172.21.15.2:0/2277785659 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0c8c101820 msgr2=0x7f0c8c19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c91e30640 1 --2- 172.21.15.2:0/2277785659 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0c8c101820 0x7f0c8c19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c91e30640 1 -- 172.21.15.2:0/2277785659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c102140 msgr2=0x7f0c8c19b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c91e30640 1 --2- 172.21.15.2:0/2277785659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c102140 0x7f0c8c19b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c91e30640 1 -- 172.21.15.2:0/2277785659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c1a0c70 con 0x7f0c8c10f3d0 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c9162f640 1 --2- 172.21.15.2:0/2277785659 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0c8c101820 0x7f0c8c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c91e30640 1 --2- 172.21.15.2:0/2277785659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c8c10f3d0 0x7f0c8c1a04a0 secure :-1 s=READY pgs=2857 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009230 tx=0x7f0c84032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c827fc640 1 -- 172.21.15.2:0/2277785659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8403f030 con 0x7f0c8c10f3d0 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c93893640 1 -- 172.21.15.2:0/2277785659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8c1a0f00 con 0x7f0c8c10f3d0 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c827fc640 1 -- 172.21.15.2:0/2277785659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f0c840044c0 con 0x7f0c8c10f3d0 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c827fc640 1 -- 172.21.15.2:0/2277785659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c84035070 con 0x7f0c8c10f3d0 2024-09-21T13:56:14.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.668+0000 7f0c93893640 1 -- 172.21.15.2:0/2277785659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8c1a7620 con 0x7f0c8c10f3d0 2024-09-21T13:56:14.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.669+0000 7f0c93893640 1 -- 172.21.15.2:0/2277785659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8c101c00 con 0x7f0c8c10f3d0 2024-09-21T13:56:14.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.670+0000 7f0c827fc640 1 -- 172.21.15.2:0/2277785659 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f0c84042030 con 0x7f0c8c10f3d0 2024-09-21T13:56:14.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.670+0000 7f0c827fc640 1 --2- 172.21.15.2:0/2277785659 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0c7807b110 0x7f0c7807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:14.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.670+0000 7f0c827fc640 1 -- 172.21.15.2:0/2277785659 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(754..754 src has 1..754) ==== 7830+0+0 (secure 0 0 0) 0x7f0c840bf230 con 0x7f0c8c10f3d0 2024-09-21T13:56:14.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.670+0000 7f0c9162f640 1 --2- 172.21.15.2:0/2277785659 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0c7807b110 0x7f0c7807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:14.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.671+0000 7f0c9162f640 1 --2- 172.21.15.2:0/2277785659 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0c7807b110 0x7f0c7807d5d0 secure :-1 s=READY pgs=3892 cs=0 l=1 rev1=1 crypto rx=0x7f0c880099a0 tx=0x7f0c88009500 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:56:14.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.675+0000 7f0c827fc640 1 -- 172.21.15.2:0/2277785659 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c84004770 con 0x7f0c8c10f3d0 2024-09-21T13:56:14.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:14.865+0000 7f0c93893640 1 -- 172.21.15.2:0/2277785659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12} v 0) -- 0x7f0c8c10a560 con 0x7f0c8c10f3d0 2024-09-21T13:56:15.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:14 smithi162 ceph-mon[33046]: pgmap v1196: 176 pgs: 176 active+clean; 746 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T13:56:15.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:14 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:56:15.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:14 smithi162 ceph-mon[33046]: osdmap e754: 8 total, 8 up, 8 in 2024-09-21T13:56:15.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:14 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2277785659' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12} : dispatch 2024-09-21T13:56:15.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:14 smithi002 ceph-mon[30076]: pgmap v1196: 176 pgs: 176 active+clean; 746 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T13:56:15.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:14 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:56:15.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:14 smithi002 ceph-mon[30076]: osdmap e754: 8 total, 8 up, 8 in 2024-09-21T13:56:15.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:14 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2277785659' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12} : dispatch 2024-09-21T13:56:15.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:14 smithi002 ceph-mon[40622]: pgmap v1196: 176 pgs: 176 active+clean; 746 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T13:56:15.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:14 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:56:15.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:14 smithi002 ceph-mon[40622]: osdmap e754: 8 total, 8 up, 8 in 2024-09-21T13:56:15.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:14 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2277785659' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12} : dispatch 2024-09-21T13:56:15.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.518+0000 7f0c827fc640 1 -- 172.21.15.2:0/2277785659 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12}]=0 pool '9395fcd5-0867-411e-8183-9f38ae58245b' created v755) ==== 176+0+0 (secure 0 0 0) 0x7f0c8408a100 con 0x7f0c8c10f3d0 2024-09-21T13:56:15.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.639+0000 7f0c93893640 1 -- 172.21.15.2:0/2277785659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12} v 0) -- 0x7f0c8c109fd0 con 0x7f0c8c10f3d0 2024-09-21T13:56:15.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.639+0000 7f0c827fc640 1 -- 172.21.15.2:0/2277785659 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12}]=0 pool '9395fcd5-0867-411e-8183-9f38ae58245b' already exists v755) ==== 183+0+0 (secure 0 0 0) 0x7f0c8408efb0 con 0x7f0c8c10f3d0 2024-09-21T13:56:15.640 INFO:tasks.workunit.client.0.smithi002.stderr:pool '9395fcd5-0867-411e-8183-9f38ae58245b' already exists 2024-09-21T13:56:15.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 -- 172.21.15.2:0/2277785659 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0c7807b110 msgr2=0x7f0c7807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:15.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 --2- 172.21.15.2:0/2277785659 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0c7807b110 0x7f0c7807d5d0 secure :-1 s=READY pgs=3892 cs=0 l=1 rev1=1 crypto rx=0x7f0c880099a0 tx=0x7f0c88009500 comp rx=0 tx=0).stop 2024-09-21T13:56:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 -- 172.21.15.2:0/2277785659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c8c10f3d0 msgr2=0x7f0c8c1a04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 --2- 172.21.15.2:0/2277785659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c8c10f3d0 0x7f0c8c1a04a0 secure :-1 s=READY pgs=2857 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009230 tx=0x7f0c84032bf0 comp rx=0 tx=0).stop 2024-09-21T13:56:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 -- 172.21.15.2:0/2277785659 shutdown_connections 2024-09-21T13:56:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 --2- 172.21.15.2:0/2277785659 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0c7807b110 0x7f0c7807d5d0 unknown :-1 s=CLOSED pgs=3892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 --2- 172.21.15.2:0/2277785659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c8c10f3d0 0x7f0c8c1a04a0 unknown :-1 s=CLOSED pgs=2857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 --2- 172.21.15.2:0/2277785659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8c102140 0x7f0c8c19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 --2- 172.21.15.2:0/2277785659 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0c8c101820 0x7f0c8c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 -- 172.21.15.2:0/2277785659 >> 172.21.15.2:0/2277785659 conn(0x7f0c8c0fd690 msgr2=0x7f0c8c0ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:56:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 -- 172.21.15.2:0/2277785659 shutdown_connections 2024-09-21T13:56:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.641+0000 7f0c93893640 1 -- 172.21.15.2:0/2277785659 wait complete. 2024-09-21T13:56:15.651 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool application enable 9395fcd5-0867-411e-8183-9f38ae58245b rados 2024-09-21T13:56:15.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.737+0000 7f0457252640 1 -- 172.21.15.2:0/3707569185 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0450107900 msgr2=0x7f0450107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:15.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.737+0000 7f0457252640 1 --2- 172.21.15.2:0/3707569185 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0450107900 0x7f0450107d40 secure :-1 s=READY pgs=2980 cs=0 l=1 rev1=1 crypto rx=0x7f0440009ca0 tx=0x7f044002a8c0 comp rx=0 tx=0).stop 2024-09-21T13:56:15.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.737+0000 7f0457252640 1 -- 172.21.15.2:0/3707569185 shutdown_connections 2024-09-21T13:56:15.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.737+0000 7f0457252640 1 --2- 172.21.15.2:0/3707569185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0450108280 0x7f045010fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:15.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.737+0000 7f0457252640 1 --2- 172.21.15.2:0/3707569185 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0450107900 0x7f0450107d40 unknown :-1 s=CLOSED pgs=2980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.737+0000 7f0457252640 1 --2- 172.21.15.2:0/3707569185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450101820 0x7f0450101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.737+0000 7f0457252640 1 -- 172.21.15.2:0/3707569185 >> 172.21.15.2:0/3707569185 conn(0x7f0450076e00 msgr2=0x7f0450079680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.737+0000 7f0457252640 1 -- 172.21.15.2:0/3707569185 shutdown_connections 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.737+0000 7f0457252640 1 -- 172.21.15.2:0/3707569185 wait complete. 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f0457252640 1 Processor -- start 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f0457252640 1 -- start start 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f0457252640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0450101820 0x7f0450198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f0457252640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450107900 0x7f0450199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f0457252640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0450108280 0x7f045019e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f0457252640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0450112700 con 0x7f0450107900 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f0457252640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0450112580 con 0x7f0450101820 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f0457252640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f0450112880 con 0x7f0450108280 2024-09-21T13:56:15.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f04557ef640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0450108280 0x7f045019e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f044ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450107900 0x7f0450199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f044ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450107900 0x7f0450199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59522/0 (socket says 172.21.15.2:59522) 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f04557ef640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0450108280 0x7f045019e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:45366/0 (socket says 172.21.15.2:45366) 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f044ffff640 1 -- 172.21.15.2:0/2177177431 learned_addr learned my addr 172.21.15.2:0/2177177431 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f0454fee640 1 --2- 172.21.15.2:0/2177177431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0450101820 0x7f0450198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f04557ef640 1 -- 172.21.15.2:0/2177177431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0450101820 msgr2=0x7f0450198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f04557ef640 1 --2- 172.21.15.2:0/2177177431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0450101820 0x7f0450198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f04557ef640 1 -- 172.21.15.2:0/2177177431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450107900 msgr2=0x7f0450199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.738+0000 7f04557ef640 1 --2- 172.21.15.2:0/2177177431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450107900 0x7f0450199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.739+0000 7f04557ef640 1 -- 172.21.15.2:0/2177177431 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045019ecc0 con 0x7f0450108280 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.739+0000 7f0454fee640 1 --2- 172.21.15.2:0/2177177431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0450101820 0x7f0450198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:56:15.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.739+0000 7f044ffff640 1 --2- 172.21.15.2:0/2177177431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450107900 0x7f0450199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:56:15.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.739+0000 7f04557ef640 1 --2- 172.21.15.2:0/2177177431 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0450108280 0x7f045019e4f0 secure :-1 s=READY pgs=2981 cs=0 l=1 rev1=1 crypto rx=0x7f044800e970 tx=0x7f044800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:56:15.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.739+0000 7f044dffb640 1 -- 172.21.15.2:0/2177177431 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044800ccc0 con 0x7f0450108280 2024-09-21T13:56:15.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.739+0000 7f044dffb640 1 -- 172.21.15.2:0/2177177431 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f0448005020 con 0x7f0450108280 2024-09-21T13:56:15.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.739+0000 7f0457252640 1 -- 172.21.15.2:0/2177177431 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045019efb0 con 0x7f0450108280 2024-09-21T13:56:15.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.739+0000 7f044dffb640 1 -- 172.21.15.2:0/2177177431 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04480044a0 con 0x7f0450108280 2024-09-21T13:56:15.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.739+0000 7f0457252640 1 -- 172.21.15.2:0/2177177431 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04501a5850 con 0x7f0450108280 2024-09-21T13:56:15.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.740+0000 7f0457252640 1 -- 172.21.15.2:0/2177177431 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0450101c00 con 0x7f0450108280 2024-09-21T13:56:15.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.740+0000 7f044dffb640 1 -- 172.21.15.2:0/2177177431 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f0448004a00 con 0x7f0450108280 2024-09-21T13:56:15.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.741+0000 7f044dffb640 1 --2- 172.21.15.2:0/2177177431 >> v2:172.21.15.2:6800/2394073254 conn(0x7f043c07b110 0x7f043c07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:15.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.741+0000 7f044dffb640 1 -- 172.21.15.2:0/2177177431 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(755..755 src has 1..755) ==== 8205+0+0 (secure 0 0 0) 0x7f044809eaf0 con 0x7f0450108280 2024-09-21T13:56:15.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.741+0000 7f0454fee640 1 --2- 172.21.15.2:0/2177177431 >> v2:172.21.15.2:6800/2394073254 conn(0x7f043c07b110 0x7f043c07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:15.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.742+0000 7f0454fee640 1 --2- 172.21.15.2:0/2177177431 >> v2:172.21.15.2:6800/2394073254 conn(0x7f043c07b110 0x7f043c07d5d0 secure :-1 s=READY pgs=3893 cs=0 l=1 rev1=1 crypto rx=0x7f0438009b50 tx=0x7f0438005f90 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:56:15.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.746+0000 7f044dffb640 1 -- 172.21.15.2:0/2177177431 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0448069920 con 0x7f0450108280 2024-09-21T13:56:15.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:15.938+0000 7f0457252640 1 -- 172.21.15.2:0/2177177431 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} v 0) -- 0x7f045007a500 con 0x7f0450108280 2024-09-21T13:56:16.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:16.530+0000 7f044dffb640 1 -- 172.21.15.2:0/2177177431 <== mon.2 v2:172.21.15.2:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"}]=0 enabled application 'rados' on pool '9395fcd5-0867-411e-8183-9f38ae58245b' v756) ==== 213+0+0 (secure 0 0 0) 0x7f044806e7d0 con 0x7f0450108280 2024-09-21T13:56:16.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:16.650+0000 7f0457252640 1 -- 172.21.15.2:0/2177177431 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} v 0) -- 0x7f045010b110 con 0x7f0450108280 2024-09-21T13:56:16.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2277785659' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12}]': finished 2024-09-21T13:56:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[30076]: osdmap e755: 8 total, 8 up, 8 in 2024-09-21T13:56:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2277785659' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12} : dispatch 2024-09-21T13:56:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[30076]: pgmap v1199: 188 pgs: 12 unknown, 176 active+clean; 746 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.4 KiB/s wr, 1 op/s 2024-09-21T13:56:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2177177431' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:16.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:16.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2277785659' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12}]': finished 2024-09-21T13:56:16.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[40622]: osdmap e755: 8 total, 8 up, 8 in 2024-09-21T13:56:16.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2277785659' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12} : dispatch 2024-09-21T13:56:16.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[40622]: pgmap v1199: 188 pgs: 12 unknown, 176 active+clean; 746 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.4 KiB/s wr, 1 op/s 2024-09-21T13:56:16.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2177177431' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:16.851 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:16 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:16.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2277785659' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12}]': finished 2024-09-21T13:56:16.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:16 smithi162 ceph-mon[33046]: osdmap e755: 8 total, 8 up, 8 in 2024-09-21T13:56:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2277785659' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pg_num": 12} : dispatch 2024-09-21T13:56:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:16 smithi162 ceph-mon[33046]: pgmap v1199: 188 pgs: 12 unknown, 176 active+clean; 746 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.4 KiB/s wr, 1 op/s 2024-09-21T13:56:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:16 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2177177431' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:16.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:16 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:17.536 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.535+0000 7f044dffb640 1 -- 172.21.15.2:0/2177177431 <== mon.2 v2:172.21.15.2:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"}]=0 enabled application 'rados' on pool '9395fcd5-0867-411e-8183-9f38ae58245b' v757) ==== 213+0+0 (secure 0 0 0) 0x7f044809c6f0 con 0x7f0450108280 2024-09-21T13:56:17.536 INFO:tasks.workunit.client.0.smithi002.stderr:enabled application 'rados' on pool '9395fcd5-0867-411e-8183-9f38ae58245b' 2024-09-21T13:56:17.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.538+0000 7f0457252640 1 -- 172.21.15.2:0/2177177431 >> v2:172.21.15.2:6800/2394073254 conn(0x7f043c07b110 msgr2=0x7f043c07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:17.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.538+0000 7f0457252640 1 --2- 172.21.15.2:0/2177177431 >> v2:172.21.15.2:6800/2394073254 conn(0x7f043c07b110 0x7f043c07d5d0 secure :-1 s=READY pgs=3893 cs=0 l=1 rev1=1 crypto rx=0x7f0438009b50 tx=0x7f0438005f90 comp rx=0 tx=0).stop 2024-09-21T13:56:17.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.538+0000 7f0457252640 1 -- 172.21.15.2:0/2177177431 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0450108280 msgr2=0x7f045019e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:17.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.538+0000 7f0457252640 1 --2- 172.21.15.2:0/2177177431 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0450108280 0x7f045019e4f0 secure :-1 s=READY pgs=2981 cs=0 l=1 rev1=1 crypto rx=0x7f044800e970 tx=0x7f044800ee30 comp rx=0 tx=0).stop 2024-09-21T13:56:17.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.539+0000 7f0457252640 1 -- 172.21.15.2:0/2177177431 shutdown_connections 2024-09-21T13:56:17.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.539+0000 7f0457252640 1 --2- 172.21.15.2:0/2177177431 >> v2:172.21.15.2:6800/2394073254 conn(0x7f043c07b110 0x7f043c07d5d0 unknown :-1 s=CLOSED pgs=3893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:17.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.539+0000 7f0457252640 1 --2- 172.21.15.2:0/2177177431 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0450108280 0x7f045019e4f0 unknown :-1 s=CLOSED pgs=2981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:17.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.539+0000 7f0457252640 1 --2- 172.21.15.2:0/2177177431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450107900 0x7f0450199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:17.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.539+0000 7f0457252640 1 --2- 172.21.15.2:0/2177177431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0450101820 0x7f0450198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:17.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.539+0000 7f0457252640 1 -- 172.21.15.2:0/2177177431 >> 172.21.15.2:0/2177177431 conn(0x7f0450076e00 msgr2=0x7f04500ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:56:17.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.539+0000 7f0457252640 1 -- 172.21.15.2:0/2177177431 shutdown_connections 2024-09-21T13:56:17.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.539+0000 7f0457252640 1 -- 172.21.15.2:0/2177177431 wait complete. 2024-09-21T13:56:17.550 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool set-quota 9395fcd5-0867-411e-8183-9f38ae58245b max_objects 10 2024-09-21T13:56:17.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.641+0000 7f0eccd00640 1 -- 172.21.15.2:0/902993050 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0ec8101c90 msgr2=0x7f0ec8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:17.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.641+0000 7f0eccd00640 1 --2- 172.21.15.2:0/902993050 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0ec8101c90 0x7f0ec8102070 secure :-1 s=READY pgs=2982 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009860 tx=0x7f0eb802a340 comp rx=0 tx=0).stop 2024-09-21T13:56:17.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.641+0000 7f0eccd00640 1 -- 172.21.15.2:0/902993050 shutdown_connections 2024-09-21T13:56:17.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.641+0000 7f0eccd00640 1 --2- 172.21.15.2:0/902993050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec8108010 0x7f0ec810e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:17.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.641+0000 7f0eccd00640 1 --2- 172.21.15.2:0/902993050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8107690 0x7f0ec8107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:17.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.641+0000 7f0eccd00640 1 --2- 172.21.15.2:0/902993050 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0ec8101c90 0x7f0ec8102070 unknown :-1 s=CLOSED pgs=2982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:17.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.641+0000 7f0eccd00640 1 -- 172.21.15.2:0/902993050 >> 172.21.15.2:0/902993050 conn(0x7f0ec80fd690 msgr2=0x7f0ec80ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:56:17.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.641+0000 7f0eccd00640 1 -- 172.21.15.2:0/902993050 shutdown_connections 2024-09-21T13:56:17.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.641+0000 7f0eccd00640 1 -- 172.21.15.2:0/902993050 wait complete. 2024-09-21T13:56:17.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0eccd00640 1 Processor -- start 2024-09-21T13:56:17.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0eccd00640 1 -- start start 2024-09-21T13:56:17.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0eccd00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec8101c90 0x7f0ec8198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:17.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0eccd00640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0ec8107690 0x7f0ec8198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:17.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0eccd00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8108010 0x7f0ec819e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:17.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0eccd00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec81113e0 con 0x7f0ec8101c90 2024-09-21T13:56:17.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0eccd00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec8111260 con 0x7f0ec8108010 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0eccd00640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec8111560 con 0x7f0ec8107690 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0ec659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec8101c90 0x7f0ec8198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0ec659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec8101c90 0x7f0ec8198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36812/0 (socket says 172.21.15.2:36812) 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0ec659c640 1 -- 172.21.15.2:0/1995168068 learned_addr learned my addr 172.21.15.2:0/1995168068 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.642+0000 7f0ebffff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0ec8107690 0x7f0ec8198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ec6d9d640 1 --2- 172.21.15.2:0/1995168068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8108010 0x7f0ec819e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ec659c640 1 -- 172.21.15.2:0/1995168068 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0ec8107690 msgr2=0x7f0ec8198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ec659c640 1 --2- 172.21.15.2:0/1995168068 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0ec8107690 0x7f0ec8198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ec659c640 1 -- 172.21.15.2:0/1995168068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8108010 msgr2=0x7f0ec819e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ec659c640 1 --2- 172.21.15.2:0/1995168068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8108010 0x7f0ec819e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ec659c640 1 -- 172.21.15.2:0/1995168068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec819eb20 con 0x7f0ec8101c90 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ebffff640 1 --2- 172.21.15.2:0/1995168068 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0ec8107690 0x7f0ec8198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:56:17.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ec6d9d640 1 --2- 172.21.15.2:0/1995168068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8108010 0x7f0ec819e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:56:17.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ec659c640 1 --2- 172.21.15.2:0/1995168068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec8101c90 0x7f0ec8198a80 secure :-1 s=READY pgs=2858 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009980 tx=0x7f0eb8033d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:56:17.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ebf7fe640 1 -- 172.21.15.2:0/1995168068 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb803f020 con 0x7f0ec8101c90 2024-09-21T13:56:17.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0eccd00640 1 -- 172.21.15.2:0/1995168068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec819edb0 con 0x7f0ec8101c90 2024-09-21T13:56:17.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ebf7fe640 1 -- 172.21.15.2:0/1995168068 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f0eb80044c0 con 0x7f0ec8101c90 2024-09-21T13:56:17.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0ebf7fe640 1 -- 172.21.15.2:0/1995168068 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8037040 con 0x7f0ec8101c90 2024-09-21T13:56:17.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.643+0000 7f0eccd00640 1 -- 172.21.15.2:0/1995168068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec81a5550 con 0x7f0ec8101c90 2024-09-21T13:56:17.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.644+0000 7f0eccd00640 1 -- 172.21.15.2:0/1995168068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec8102070 con 0x7f0ec8101c90 2024-09-21T13:56:17.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.645+0000 7f0ebf7fe640 1 -- 172.21.15.2:0/1995168068 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f0eb8042020 con 0x7f0ec8101c90 2024-09-21T13:56:17.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.645+0000 7f0ebf7fe640 1 --2- 172.21.15.2:0/1995168068 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0eb407b110 0x7f0eb407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:56:17.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.646+0000 7f0ebf7fe640 1 -- 172.21.15.2:0/1995168068 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(757..757 src has 1..757) ==== 8218+0+0 (secure 0 0 0) 0x7f0eb80beba0 con 0x7f0ec8101c90 2024-09-21T13:56:17.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.646+0000 7f0ebffff640 1 --2- 172.21.15.2:0/1995168068 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0eb407b110 0x7f0eb407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:56:17.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.646+0000 7f0ebffff640 1 --2- 172.21.15.2:0/1995168068 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0eb407b110 0x7f0eb407d5d0 secure :-1 s=READY pgs=3894 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8105ce0 tx=0x7f0eb0009110 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:56:17.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.650+0000 7f0ebf7fe640 1 -- 172.21.15.2:0/1995168068 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0eb8049020 con 0x7f0ec8101c90 2024-09-21T13:56:17.846 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:17.846+0000 7f0eccd00640 1 -- 172.21.15.2:0/1995168068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"} v 0) -- 0x7f0ec81a5780 con 0x7f0ec8101c90 2024-09-21T13:56:17.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:17 smithi002 ceph-mon[30076]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:56:17.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"}]': finished 2024-09-21T13:56:17.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:17 smithi002 ceph-mon[30076]: osdmap e756: 8 total, 8 up, 8 in 2024-09-21T13:56:17.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:17 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2177177431' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:17.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:17 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:17 smithi002 ceph-mon[40622]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:56:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"}]': finished 2024-09-21T13:56:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:17 smithi002 ceph-mon[40622]: osdmap e756: 8 total, 8 up, 8 in 2024-09-21T13:56:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:17 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2177177431' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:17.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:17 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:17.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:17 smithi162 ceph-mon[33046]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:56:17.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"}]': finished 2024-09-21T13:56:17.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:17 smithi162 ceph-mon[33046]: osdmap e756: 8 total, 8 up, 8 in 2024-09-21T13:56:17.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:17 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2177177431' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:17.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:17 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"} : dispatch 2024-09-21T13:56:18.536 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:18.535+0000 7f0ebf7fe640 1 -- 172.21.15.2:0/1995168068 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 9395fcd5-0867-411e-8183-9f38ae58245b v758) ==== 223+0+0 (secure 0 0 0) 0x7f0eb8089940 con 0x7f0ec8101c90 2024-09-21T13:56:18.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:18.655+0000 7f0eccd00640 1 -- 172.21.15.2:0/1995168068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"} v 0) -- 0x7f0ec81a59d0 con 0x7f0ec8101c90 2024-09-21T13:56:18.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:18 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"}]': finished 2024-09-21T13:56:18.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:18 smithi002 ceph-mon[30076]: osdmap e757: 8 total, 8 up, 8 in 2024-09-21T13:56:18.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:18 smithi002 ceph-mon[30076]: pgmap v1202: 188 pgs: 12 unknown, 176 active+clean; 746 KiB data, 808 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:56:18.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:18 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:56:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:18 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"}]': finished 2024-09-21T13:56:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:18 smithi002 ceph-mon[40622]: osdmap e757: 8 total, 8 up, 8 in 2024-09-21T13:56:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:18 smithi002 ceph-mon[40622]: pgmap v1202: 188 pgs: 12 unknown, 176 active+clean; 746 KiB data, 808 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:56:18.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:18 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:56:18.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:18 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "app": "rados"}]': finished 2024-09-21T13:56:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:18 smithi162 ceph-mon[33046]: osdmap e757: 8 total, 8 up, 8 in 2024-09-21T13:56:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:18 smithi162 ceph-mon[33046]: pgmap v1202: 188 pgs: 12 unknown, 176 active+clean; 746 KiB data, 808 MiB used, 714 GiB / 715 GiB avail 2024-09-21T13:56:18.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:18 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:56:19.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.542+0000 7f0ebf7fe640 1 -- 172.21.15.2:0/1995168068 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 9395fcd5-0867-411e-8183-9f38ae58245b v759) ==== 223+0+0 (secure 0 0 0) 0x7f0eb808e7f0 con 0x7f0ec8101c90 2024-09-21T13:56:19.543 INFO:tasks.workunit.client.0.smithi002.stderr:set-quota max_objects = 10 for pool 9395fcd5-0867-411e-8183-9f38ae58245b 2024-09-21T13:56:19.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.547+0000 7f0eccd00640 1 -- 172.21.15.2:0/1995168068 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0eb407b110 msgr2=0x7f0eb407d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:19.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.547+0000 7f0eccd00640 1 --2- 172.21.15.2:0/1995168068 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0eb407b110 0x7f0eb407d5d0 secure :-1 s=READY pgs=3894 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8105ce0 tx=0x7f0eb0009110 comp rx=0 tx=0).stop 2024-09-21T13:56:19.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.547+0000 7f0eccd00640 1 -- 172.21.15.2:0/1995168068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec8101c90 msgr2=0x7f0ec8198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:56:19.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.547+0000 7f0eccd00640 1 --2- 172.21.15.2:0/1995168068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec8101c90 0x7f0ec8198a80 secure :-1 s=READY pgs=2858 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009980 tx=0x7f0eb8033d30 comp rx=0 tx=0).stop 2024-09-21T13:56:19.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.548+0000 7f0eccd00640 1 -- 172.21.15.2:0/1995168068 shutdown_connections 2024-09-21T13:56:19.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.548+0000 7f0eccd00640 1 --2- 172.21.15.2:0/1995168068 >> v2:172.21.15.2:6800/2394073254 conn(0x7f0eb407b110 0x7f0eb407d5d0 secure :-1 s=CLOSED pgs=3894 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8105ce0 tx=0x7f0eb0009110 comp rx=0 tx=0).stop 2024-09-21T13:56:19.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.548+0000 7f0eccd00640 1 --2- 172.21.15.2:0/1995168068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8108010 0x7f0ec819e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:19.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.548+0000 7f0eccd00640 1 --2- 172.21.15.2:0/1995168068 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f0ec8107690 0x7f0ec8198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:19.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.548+0000 7f0eccd00640 1 --2- 172.21.15.2:0/1995168068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec8101c90 0x7f0ec8198a80 unknown :-1 s=CLOSED pgs=2858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:56:19.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.548+0000 7f0eccd00640 1 -- 172.21.15.2:0/1995168068 >> 172.21.15.2:0/1995168068 conn(0x7f0ec80fd690 msgr2=0x7f0ec8100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:56:19.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.548+0000 7f0eccd00640 1 -- 172.21.15.2:0/1995168068 shutdown_connections 2024-09-21T13:56:19.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:56:19.548+0000 7f0eccd00640 1 -- 172.21.15.2:0/1995168068 wait complete. 2024-09-21T13:56:19.560 INFO:tasks.workunit.client.0.smithi002.stderr:+ sleep 30 2024-09-21T13:56:19.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:56:19 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:56:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:56:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:19 smithi162 ceph-mon[33046]: osdmap e758: 8 total, 8 up, 8 in 2024-09-21T13:56:19.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:19 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:56:19.849 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:56:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:56:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:56:19.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:56:19.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:19 smithi002 ceph-mon[30076]: osdmap e758: 8 total, 8 up, 8 in 2024-09-21T13:56:19.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:19 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:56:19.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:56:19.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:19 smithi002 ceph-mon[40622]: osdmap e758: 8 total, 8 up, 8 in 2024-09-21T13:56:19.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:19 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"} : dispatch 2024-09-21T13:56:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:56:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:20 smithi002 ceph-mon[30076]: osdmap e759: 8 total, 8 up, 8 in 2024-09-21T13:56:20.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:20 smithi002 ceph-mon[30076]: pgmap v1205: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-21T13:56:20.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:20.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:56:20.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:20 smithi002 ceph-mon[40622]: osdmap e759: 8 total, 8 up, 8 in 2024-09-21T13:56:20.850 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:20 smithi002 ceph-mon[40622]: pgmap v1205: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-21T13:56:20.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:20.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/1995168068' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "field": "max_objects", "val": "10"}]': finished 2024-09-21T13:56:20.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:20 smithi162 ceph-mon[33046]: osdmap e759: 8 total, 8 up, 8 in 2024-09-21T13:56:20.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:20 smithi162 ceph-mon[33046]: pgmap v1205: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-21T13:56:23.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:22 smithi002 ceph-mon[30076]: pgmap v1206: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 980 B/s rd, 2.5 KiB/s wr, 1 op/s 2024-09-21T13:56:23.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:22 smithi002 ceph-mon[40622]: pgmap v1206: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 980 B/s rd, 2.5 KiB/s wr, 1 op/s 2024-09-21T13:56:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:22 smithi162 ceph-mon[33046]: pgmap v1206: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 980 B/s rd, 2.5 KiB/s wr, 1 op/s 2024-09-21T13:56:24.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:23 smithi002 ceph-mon[30076]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:56:24.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:23 smithi002 ceph-mon[40622]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:56:24.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:23 smithi162 ceph-mon[33046]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T13:56:25.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:24 smithi002 ceph-mon[30076]: pgmap v1207: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 2.1 KiB/s wr, 1 op/s 2024-09-21T13:56:25.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:24 smithi002 ceph-mon[40622]: pgmap v1207: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 2.1 KiB/s wr, 1 op/s 2024-09-21T13:56:25.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:24 smithi162 ceph-mon[33046]: pgmap v1207: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 2.1 KiB/s wr, 1 op/s 2024-09-21T13:56:27.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:26 smithi002 ceph-mon[30076]: pgmap v1208: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-21T13:56:27.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:26 smithi002 ceph-mon[40622]: pgmap v1208: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-21T13:56:27.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:26 smithi162 ceph-mon[33046]: pgmap v1208: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-21T13:56:29.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:28 smithi002 ceph-mon[30076]: pgmap v1209: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-09-21T13:56:29.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:28 smithi002 ceph-mon[40622]: pgmap v1209: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-09-21T13:56:29.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:28 smithi162 ceph-mon[33046]: pgmap v1209: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-09-21T13:56:29.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:56:29 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:56:30.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:56:30.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:56:30.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:56:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:56:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:56:30.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:56:31.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:30 smithi002 ceph-mon[30076]: pgmap v1210: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-09-21T13:56:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:30 smithi002 ceph-mon[40622]: pgmap v1210: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-09-21T13:56:31.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:31.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:30 smithi162 ceph-mon[33046]: pgmap v1210: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-09-21T13:56:33.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:32 smithi002 ceph-mon[30076]: pgmap v1211: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:32 smithi002 ceph-mon[40622]: pgmap v1211: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:33.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:32 smithi162 ceph-mon[33046]: pgmap v1211: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:35.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:34 smithi002 ceph-mon[30076]: pgmap v1212: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:34 smithi002 ceph-mon[40622]: pgmap v1212: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:35.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:34 smithi162 ceph-mon[33046]: pgmap v1212: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:37.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:36 smithi002 ceph-mon[30076]: pgmap v1213: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:36 smithi002 ceph-mon[40622]: pgmap v1213: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:37.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:36 smithi162 ceph-mon[33046]: pgmap v1213: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:39.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:38 smithi002 ceph-mon[30076]: pgmap v1214: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:38 smithi002 ceph-mon[40622]: pgmap v1214: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:39.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:38 smithi162 ceph-mon[33046]: pgmap v1214: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:39.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:56:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:56:40.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:56:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:56:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:56:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:41.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:40 smithi002 ceph-mon[30076]: pgmap v1215: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:40 smithi002 ceph-mon[40622]: pgmap v1215: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:40 smithi162 ceph-mon[33046]: pgmap v1215: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:43.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:42 smithi002 ceph-mon[30076]: pgmap v1216: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:42 smithi002 ceph-mon[40622]: pgmap v1216: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:42 smithi162 ceph-mon[33046]: pgmap v1216: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:45.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:44 smithi002 ceph-mon[30076]: pgmap v1217: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:45.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:44 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:56:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:44 smithi002 ceph-mon[40622]: pgmap v1217: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:45.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:44 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:56:45.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:44 smithi162 ceph-mon[33046]: pgmap v1217: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:45.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:44 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:56:47.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:46 smithi002 ceph-mon[30076]: pgmap v1218: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:47.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:46 smithi002 ceph-mon[40622]: pgmap v1218: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:46 smithi162 ceph-mon[33046]: pgmap v1218: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:48 smithi162 ceph-mon[33046]: pgmap v1219: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:49.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:48 smithi002 ceph-mon[30076]: pgmap v1219: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:49.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:48 smithi002 ceph-mon[40622]: pgmap v1219: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:49.562 INFO:tasks.workunit.client.0.smithi002.stderr:++ seq 1 10 2024-09-21T13:56:49.563 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:56:49.563 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 9395fcd5-0867-411e-8183-9f38ae58245b put obj1 /etc/passwd 2024-09-21T13:56:49.607 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:56:49.607 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 9395fcd5-0867-411e-8183-9f38ae58245b put obj2 /etc/passwd 2024-09-21T13:56:49.647 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:56:49.648 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 9395fcd5-0867-411e-8183-9f38ae58245b put obj3 /etc/passwd 2024-09-21T13:56:49.687 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:56:49.687 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 9395fcd5-0867-411e-8183-9f38ae58245b put obj4 /etc/passwd 2024-09-21T13:56:49.726 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:56:49.726 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 9395fcd5-0867-411e-8183-9f38ae58245b put obj5 /etc/passwd 2024-09-21T13:56:49.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:56:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:56:49.763 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:56:49.763 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 9395fcd5-0867-411e-8183-9f38ae58245b put obj6 /etc/passwd 2024-09-21T13:56:49.800 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:56:49.801 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 9395fcd5-0867-411e-8183-9f38ae58245b put obj7 /etc/passwd 2024-09-21T13:56:49.837 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:56:49.837 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 9395fcd5-0867-411e-8183-9f38ae58245b put obj8 /etc/passwd 2024-09-21T13:56:49.874 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:56:49.874 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 9395fcd5-0867-411e-8183-9f38ae58245b put obj9 /etc/passwd 2024-09-21T13:56:49.911 INFO:tasks.workunit.client.0.smithi002.stderr:+ for f in `seq 1 10` 2024-09-21T13:56:49.911 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 9395fcd5-0867-411e-8183-9f38ae58245b put obj10 /etc/passwd 2024-09-21T13:56:49.948 INFO:tasks.workunit.client.0.smithi002.stderr:+ sleep 30 2024-09-21T13:56:50.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:56:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:56:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:56:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:50 smithi162 ceph-mon[33046]: pgmap v1220: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:51.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:51.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:50 smithi002 ceph-mon[30076]: pgmap v1220: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:51.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:56:51.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:50 smithi002 ceph-mon[40622]: pgmap v1220: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:56:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:52 smithi162 ceph-mon[33046]: pgmap v1221: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:53.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:52 smithi002 ceph-mon[30076]: pgmap v1221: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:53.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:52 smithi002 ceph-mon[40622]: pgmap v1221: 188 pgs: 188 active+clean; 759 KiB data, 808 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:56:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:54 smithi162 ceph-mon[33046]: pgmap v1222: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-21T13:56:55.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:54 smithi002 ceph-mon[40622]: pgmap v1222: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-21T13:56:55.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:54 smithi002 ceph-mon[30076]: pgmap v1222: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-21T13:56:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:55 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:56:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:55 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:56:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:55 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:56:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:55 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:56:56.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:55 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:56:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:55 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:56:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:55 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:56:56.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:55 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:56:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:55 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:56:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:55 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:56:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:55 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:56:56.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:55 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:56:57.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:56 smithi162 ceph-mon[33046]: pgmap v1223: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-21T13:56:57.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:56 smithi002 ceph-mon[30076]: pgmap v1223: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-21T13:56:57.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:56 smithi002 ceph-mon[40622]: pgmap v1223: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-21T13:56:59.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:58 smithi162 ceph-mon[33046]: pgmap v1224: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-21T13:56:59.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:58 smithi162 ceph-mon[33046]: pool '9395fcd5-0867-411e-8183-9f38ae58245b' is full (reached quota's max_objects: 10) 2024-09-21T13:56:59.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:58 smithi162 ceph-mon[33046]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:56:59.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:58 smithi162 ceph-mon[33046]: osdmap e760: 8 total, 8 up, 8 in 2024-09-21T13:56:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:58 smithi002 ceph-mon[40622]: pgmap v1224: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-21T13:56:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:58 smithi002 ceph-mon[40622]: pool '9395fcd5-0867-411e-8183-9f38ae58245b' is full (reached quota's max_objects: 10) 2024-09-21T13:56:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:58 smithi002 ceph-mon[40622]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:56:59.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:58 smithi002 ceph-mon[40622]: osdmap e760: 8 total, 8 up, 8 in 2024-09-21T13:56:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:58 smithi002 ceph-mon[30076]: pgmap v1224: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-21T13:56:59.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:58 smithi002 ceph-mon[30076]: pool '9395fcd5-0867-411e-8183-9f38ae58245b' is full (reached quota's max_objects: 10) 2024-09-21T13:56:59.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:58 smithi002 ceph-mon[30076]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-21T13:56:59.351 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:58 smithi002 ceph-mon[30076]: osdmap e760: 8 total, 8 up, 8 in 2024-09-21T13:56:59.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:56:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:57:00.099 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:59 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:57:00.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:56:59 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:59 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:57:00.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:56:59 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:00.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:56:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:56:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:57:00.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:59 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:57:00.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:56:59 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:00 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:01.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:00 smithi162 ceph-mon[33046]: pgmap v1226: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:57:01.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:00 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:01.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:00 smithi002 ceph-mon[30076]: pgmap v1226: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:57:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:00 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:01.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:00 smithi002 ceph-mon[40622]: pgmap v1226: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:57:03.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:02 smithi162 ceph-mon[33046]: pgmap v1227: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:57:03.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:02 smithi002 ceph-mon[30076]: pgmap v1227: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:57:03.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:02 smithi002 ceph-mon[40622]: pgmap v1227: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-21T13:57:05.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:04 smithi162 ceph-mon[33046]: pgmap v1228: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:05.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:04 smithi002 ceph-mon[30076]: pgmap v1228: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:05.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:04 smithi002 ceph-mon[40622]: pgmap v1228: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:07.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:06 smithi162 ceph-mon[33046]: pgmap v1229: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:07.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:06 smithi002 ceph-mon[30076]: pgmap v1229: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:07.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:06 smithi002 ceph-mon[40622]: pgmap v1229: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:09.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:08 smithi162 ceph-mon[33046]: pgmap v1230: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:09.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:08 smithi002 ceph-mon[30076]: pgmap v1230: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:09.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:08 smithi002 ceph-mon[40622]: pgmap v1230: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:09.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:57:09 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:57:10.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:09 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:57:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:57:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:10 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:11.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:10 smithi162 ceph-mon[33046]: pgmap v1231: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T13:57:11.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:10 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:11.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:10 smithi002 ceph-mon[30076]: pgmap v1231: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T13:57:11.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:10 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:11.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:10 smithi002 ceph-mon[40622]: pgmap v1231: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T13:57:13.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:12 smithi162 ceph-mon[33046]: pgmap v1232: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:13.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:12 smithi002 ceph-mon[30076]: pgmap v1232: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:13.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:12 smithi002 ceph-mon[40622]: pgmap v1232: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:14.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:13 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:14.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:13 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:14.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:13 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:15.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:14 smithi162 ceph-mon[33046]: pgmap v1233: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:15.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:14 smithi002 ceph-mon[30076]: pgmap v1233: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:15.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:14 smithi002 ceph-mon[40622]: pgmap v1233: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:17.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:16 smithi162 ceph-mon[33046]: pgmap v1234: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:17.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:16 smithi002 ceph-mon[30076]: pgmap v1234: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:17.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:16 smithi002 ceph-mon[40622]: pgmap v1234: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:19.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:18 smithi162 ceph-mon[33046]: pgmap v1235: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:19.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:18 smithi002 ceph-mon[30076]: pgmap v1235: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:19.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:18 smithi002 ceph-mon[40622]: pgmap v1235: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:19.949 INFO:tasks.workunit.client.0.smithi002.stderr:+ rados -p 38aaefc6-8a1e-49b1-92ce-d87544792aec put threemore /etc/passwd 2024-09-21T13:57:19.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:57:19 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:57:19.993 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool set-quota 38aaefc6-8a1e-49b1-92ce-d87544792aec max_bytes 0 2024-09-21T13:57:20.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.085+0000 7f301350e640 1 -- 172.21.15.2:0/219332208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c1091a0 msgr2=0x7f300c10f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:20.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.085+0000 7f301350e640 1 --2- 172.21.15.2:0/219332208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c1091a0 0x7f300c10f9a0 secure :-1 s=READY pgs=2875 cs=0 l=1 rev1=1 crypto rx=0x7f3004009900 tx=0x7f300402a410 comp rx=0 tx=0).stop 2024-09-21T13:57:20.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.085+0000 7f301350e640 1 -- 172.21.15.2:0/219332208 shutdown_connections 2024-09-21T13:57:20.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.085+0000 7f301350e640 1 --2- 172.21.15.2:0/219332208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c1091a0 0x7f300c10f9a0 unknown :-1 s=CLOSED pgs=2875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:20.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.085+0000 7f301350e640 1 --2- 172.21.15.2:0/219332208 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f300c108820 0x7f300c108c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:20.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.085+0000 7f301350e640 1 --2- 172.21.15.2:0/219332208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f300c06a6b0 0x7f300c06aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:20.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.085+0000 7f301350e640 1 -- 172.21.15.2:0/219332208 >> 172.21.15.2:0/219332208 conn(0x7f300c0776c0 msgr2=0x7f300c077ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:57:20.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.085+0000 7f301350e640 1 -- 172.21.15.2:0/219332208 shutdown_connections 2024-09-21T13:57:20.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.085+0000 7f301350e640 1 -- 172.21.15.2:0/219332208 wait complete. 2024-09-21T13:57:20.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f301350e640 1 Processor -- start 2024-09-21T13:57:20.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f301350e640 1 -- start start 2024-09-21T13:57:20.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f301350e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c06a6b0 0x7f300c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:20.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f301350e640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f300c108820 0x7f300c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:20.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f301350e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f300c1091a0 0x7f300c19e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:20.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f301350e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f300c112570 con 0x7f300c06a6b0 2024-09-21T13:57:20.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f301350e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f300c1123f0 con 0x7f300c1091a0 2024-09-21T13:57:20.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f301350e640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f300c1126f0 con 0x7f300c108820 2024-09-21T13:57:20.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f30112aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c06a6b0 0x7f300c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:20.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f3010aa9640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f300c108820 0x7f300c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:20.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f30112aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c06a6b0 0x7f300c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57322/0 (socket says 172.21.15.2:57322) 2024-09-21T13:57:20.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f30112aa640 1 -- 172.21.15.2:0/295353788 learned_addr learned my addr 172.21.15.2:0/295353788 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:57:20.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f3011aab640 1 --2- 172.21.15.2:0/295353788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f300c1091a0 0x7f300c19e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f3010aa9640 1 -- 172.21.15.2:0/295353788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f300c1091a0 msgr2=0x7f300c19e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f3010aa9640 1 --2- 172.21.15.2:0/295353788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f300c1091a0 0x7f300c19e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f3010aa9640 1 -- 172.21.15.2:0/295353788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c06a6b0 msgr2=0x7f300c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f3010aa9640 1 --2- 172.21.15.2:0/295353788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c06a6b0 0x7f300c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f3010aa9640 1 -- 172.21.15.2:0/295353788 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300c19ea10 con 0x7f300c108820 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.086+0000 7f30112aa640 1 --2- 172.21.15.2:0/295353788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c06a6b0 0x7f300c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.087+0000 7f3010aa9640 1 --2- 172.21.15.2:0/295353788 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f300c108820 0x7f300c198eb0 secure :-1 s=READY pgs=3000 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00e9f0 tx=0x7f2ffc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.087+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc00cd80 con 0x7f300c108820 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.087+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2ffc0035f0 con 0x7f300c108820 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.087+0000 7f301350e640 1 -- 172.21.15.2:0/295353788 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300c19ed00 con 0x7f300c108820 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.087+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc0044a0 con 0x7f300c108820 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.087+0000 7f301350e640 1 -- 172.21.15.2:0/295353788 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f300c1a53c0 con 0x7f300c108820 2024-09-21T13:57:20.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.088+0000 7f301350e640 1 -- 172.21.15.2:0/295353788 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300c06aa90 con 0x7f300c108820 2024-09-21T13:57:20.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.089+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f2ffc004000 con 0x7f300c108820 2024-09-21T13:57:20.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.089+0000 7f30027fc640 1 --2- 172.21.15.2:0/295353788 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2ff807b110 0x7f2ff807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:20.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.089+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(760..760 src has 1..760) ==== 8218+0+0 (secure 0 0 0) 0x7f2ffc09ef30 con 0x7f300c108820 2024-09-21T13:57:20.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.089+0000 7f30112aa640 1 --2- 172.21.15.2:0/295353788 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2ff807b110 0x7f2ff807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:20.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.089+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=761}) -- 0x7f2ff8086e10 con 0x7f300c108820 2024-09-21T13:57:20.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.090+0000 7f30112aa640 1 --2- 172.21.15.2:0/295353788 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2ff807b110 0x7f2ff807d5d0 secure :-1 s=READY pgs=3906 cs=0 l=1 rev1=1 crypto rx=0x7f300800f710 tx=0x7f3008007670 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:57:20.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.094+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ffc069cd0 con 0x7f300c108820 2024-09-21T13:57:20.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:57:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:57:20.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.287+0000 7f301350e640 1 -- 172.21.15.2:0/295353788 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} v 0) -- 0x7f300c1a5680 con 0x7f300c108820 2024-09-21T13:57:20.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.937+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 <== mon.2 v2:172.21.15.2:3301/0 7 ==== osd_map(761..761 src has 1..761) ==== 628+0+0 (secure 0 0 0) 0x7f2ffc09cb20 con 0x7f300c108820 2024-09-21T13:57:20.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.937+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=762}) -- 0x7f2ff80879c0 con 0x7f300c108820 2024-09-21T13:57:20.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:20.941+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 <== mon.2 v2:172.21.15.2:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v761) ==== 217+0+0 (secure 0 0 0) 0x7f2ffc06eb80 con 0x7f300c108820 2024-09-21T13:57:21.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.062+0000 7f301350e640 1 -- 172.21.15.2:0/295353788 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} v 0) -- 0x7f300c1a58d0 con 0x7f300c108820 2024-09-21T13:57:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:20 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:20 smithi162 ceph-mon[33046]: pgmap v1236: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:20 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/295353788' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:20 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:21.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:20 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:21.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:20 smithi002 ceph-mon[30076]: pgmap v1236: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:21.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:20 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/295353788' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:21.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:20 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:21.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:20 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:21.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:20 smithi002 ceph-mon[40622]: pgmap v1236: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:21.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:20 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/295353788' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:21.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:20 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:21.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.942+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 <== mon.2 v2:172.21.15.2:3301/0 9 ==== osd_map(762..762 src has 1..762) ==== 628+0+0 (secure 0 0 0) 0x7f2ffc061460 con 0x7f300c108820 2024-09-21T13:57:21.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.942+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=763}) -- 0x7f2ff8087fc0 con 0x7f300c108820 2024-09-21T13:57:21.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.947+0000 7f30027fc640 1 -- 172.21.15.2:0/295353788 <== mon.2 v2:172.21.15.2:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v762) ==== 217+0+0 (secure 0 0 0) 0x7f2ffc064960 con 0x7f300c108820 2024-09-21T13:57:21.947 INFO:tasks.workunit.client.0.smithi002.stderr:set-quota max_bytes = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec 2024-09-21T13:57:21.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 -- 172.21.15.2:0/295353788 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2ff807b110 msgr2=0x7f2ff807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:21.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 --2- 172.21.15.2:0/295353788 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2ff807b110 0x7f2ff807d5d0 secure :-1 s=READY pgs=3906 cs=0 l=1 rev1=1 crypto rx=0x7f300800f710 tx=0x7f3008007670 comp rx=0 tx=0).stop 2024-09-21T13:57:21.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 -- 172.21.15.2:0/295353788 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f300c108820 msgr2=0x7f300c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:21.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 --2- 172.21.15.2:0/295353788 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f300c108820 0x7f300c198eb0 secure :-1 s=READY pgs=3000 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00e9f0 tx=0x7f2ffc00eeb0 comp rx=0 tx=0).stop 2024-09-21T13:57:21.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 -- 172.21.15.2:0/295353788 shutdown_connections 2024-09-21T13:57:21.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 --2- 172.21.15.2:0/295353788 >> v2:172.21.15.2:6800/2394073254 conn(0x7f2ff807b110 0x7f2ff807d5d0 unknown :-1 s=CLOSED pgs=3906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:21.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 --2- 172.21.15.2:0/295353788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f300c1091a0 0x7f300c19e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:21.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 --2- 172.21.15.2:0/295353788 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f300c108820 0x7f300c198eb0 unknown :-1 s=CLOSED pgs=3000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:21.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 --2- 172.21.15.2:0/295353788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c06a6b0 0x7f300c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:21.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 -- 172.21.15.2:0/295353788 >> 172.21.15.2:0/295353788 conn(0x7f300c0776c0 msgr2=0x7f300c104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:57:21.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 -- 172.21.15.2:0/295353788 shutdown_connections 2024-09-21T13:57:21.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:21.951+0000 7f301350e640 1 -- 172.21.15.2:0/295353788 wait complete. 2024-09-21T13:57:21.963 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool set-quota 38aaefc6-8a1e-49b1-92ce-d87544792aec max_objects 0 2024-09-21T13:57:22.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.053+0000 7ff2043d3640 1 -- 172.21.15.2:0/3164698283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1fc10d0f0 msgr2=0x7ff1fc10f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:22.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.053+0000 7ff2043d3640 1 --2- 172.21.15.2:0/3164698283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1fc10d0f0 0x7ff1fc10f570 secure :-1 s=READY pgs=2876 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4009ca0 tx=0x7ff1f402a8c0 comp rx=0 tx=0).stop 2024-09-21T13:57:22.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.053+0000 7ff2043d3640 1 -- 172.21.15.2:0/3164698283 shutdown_connections 2024-09-21T13:57:22.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.053+0000 7ff2043d3640 1 --2- 172.21.15.2:0/3164698283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1fc10d0f0 0x7ff1fc10f570 unknown :-1 s=CLOSED pgs=2876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:22.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.053+0000 7ff2043d3640 1 --2- 172.21.15.2:0/3164698283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1fc1045c0 0x7ff1fc10caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:22.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.053+0000 7ff2043d3640 1 --2- 172.21.15.2:0/3164698283 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff1fc103ca0 0x7ff1fc104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:22.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.053+0000 7ff2043d3640 1 -- 172.21.15.2:0/3164698283 >> 172.21.15.2:0/3164698283 conn(0x7ff1fc0fd690 msgr2=0x7ff1fc0ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:57:22.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.053+0000 7ff2043d3640 1 -- 172.21.15.2:0/3164698283 shutdown_connections 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.053+0000 7ff2043d3640 1 -- 172.21.15.2:0/3164698283 wait complete. 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff2043d3640 1 Processor -- start 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff2043d3640 1 -- start start 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff2043d3640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff1fc103ca0 0x7ff1fc1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff2043d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1fc1045c0 0x7ff1fc198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff2043d3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1fc10d0f0 0x7ff1fc19e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff2043d3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc112490 con 0x7ff1fc1045c0 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff2043d3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc112310 con 0x7ff1fc10d0f0 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff2043d3640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7ff1fc112610 con 0x7ff1fc103ca0 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff20216f640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff1fc103ca0 0x7ff1fc1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff20196e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1fc1045c0 0x7ff1fc198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff20216f640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff1fc103ca0 0x7ff1fc1988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:36436/0 (socket says 172.21.15.2:36436) 2024-09-21T13:57:22.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff20216f640 1 -- 172.21.15.2:0/2620424452 learned_addr learned my addr 172.21.15.2:0/2620424452 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff20196e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1fc1045c0 0x7ff1fc198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57340/0 (socket says 172.21.15.2:57340) 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.054+0000 7ff202970640 1 --2- 172.21.15.2:0/2620424452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1fc10d0f0 0x7ff1fc19e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff20216f640 1 -- 172.21.15.2:0/2620424452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1fc10d0f0 msgr2=0x7ff1fc19e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff20216f640 1 --2- 172.21.15.2:0/2620424452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1fc10d0f0 0x7ff1fc19e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff20216f640 1 -- 172.21.15.2:0/2620424452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1fc1045c0 msgr2=0x7ff1fc198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff20216f640 1 --2- 172.21.15.2:0/2620424452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1fc1045c0 0x7ff1fc198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff20216f640 1 -- 172.21.15.2:0/2620424452 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1fc19e990 con 0x7ff1fc103ca0 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff20196e640 1 --2- 172.21.15.2:0/2620424452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1fc1045c0 0x7ff1fc198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff20216f640 1 --2- 172.21.15.2:0/2620424452 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff1fc103ca0 0x7ff1fc1988f0 secure :-1 s=READY pgs=3001 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800ea60 tx=0x7ff1f800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800cde0 con 0x7ff1fc103ca0 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff1f80035f0 con 0x7ff1fc103ca0 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff2043d3640 1 -- 172.21.15.2:0/2620424452 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1fc19ec80 con 0x7ff1fc103ca0 2024-09-21T13:57:22.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80044a0 con 0x7ff1fc103ca0 2024-09-21T13:57:22.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.055+0000 7ff2043d3640 1 -- 172.21.15.2:0/2620424452 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1fc101a00 con 0x7ff1fc103ca0 2024-09-21T13:57:22.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.056+0000 7ff2043d3640 1 -- 172.21.15.2:0/2620424452 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1fc06ba20 con 0x7ff1fc103ca0 2024-09-21T13:57:22.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.057+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7ff1f8004000 con 0x7ff1fc103ca0 2024-09-21T13:57:22.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.057+0000 7ff1f37fe640 1 --2- 172.21.15.2:0/2620424452 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff1e807b110 0x7ff1e807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:22.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.057+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(762..762 src has 1..762) ==== 8218+0+0 (secure 0 0 0) 0x7ff1f809ee70 con 0x7ff1fc103ca0 2024-09-21T13:57:22.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.057+0000 7ff20196e640 1 --2- 172.21.15.2:0/2620424452 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff1e807b110 0x7ff1e807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:22.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.057+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=763}) -- 0x7ff1e8086f10 con 0x7ff1fc103ca0 2024-09-21T13:57:22.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.058+0000 7ff20196e640 1 --2- 172.21.15.2:0/2620424452 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff1e807b110 0x7ff1e807d5d0 secure :-1 s=READY pgs=3907 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc0ffec0 tx=0x7ff1ec010040 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:57:22.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.062+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff1f806ae20 con 0x7ff1fc103ca0 2024-09-21T13:57:22.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:57:22.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:21 smithi162 ceph-mon[33046]: osdmap e761: 8 total, 8 up, 8 in 2024-09-21T13:57:22.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:21 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/295353788' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:22.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:21 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:22.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.249+0000 7ff2043d3640 1 -- 172.21.15.2:0/2620424452 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} v 0) -- 0x7ff1fc199a10 con 0x7ff1fc103ca0 2024-09-21T13:57:22.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:57:22.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:21 smithi002 ceph-mon[30076]: osdmap e761: 8 total, 8 up, 8 in 2024-09-21T13:57:22.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:21 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/295353788' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:22.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:21 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:22.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:57:22.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:21 smithi002 ceph-mon[40622]: osdmap e761: 8 total, 8 up, 8 in 2024-09-21T13:57:22.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:21 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/295353788' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:22.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:21 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"} : dispatch 2024-09-21T13:57:22.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.944+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 <== mon.2 v2:172.21.15.2:3301/0 7 ==== osd_map(763..763 src has 1..763) ==== 628+0+0 (secure 0 0 0) 0x7ff1f809ca60 con 0x7ff1fc103ca0 2024-09-21T13:57:22.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.944+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=764}) -- 0x7ff1e8087ac0 con 0x7ff1fc103ca0 2024-09-21T13:57:22.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:22.948+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 <== mon.2 v2:172.21.15.2:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v763) ==== 221+0+0 (secure 0 0 0) 0x7ff1f8069c90 con 0x7ff1fc103ca0 2024-09-21T13:57:23.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.065+0000 7ff2043d3640 1 -- 172.21.15.2:0/2620424452 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} v 0) -- 0x7ff1fc101cc0 con 0x7ff1fc103ca0 2024-09-21T13:57:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:22 smithi162 ceph-mon[33046]: pgmap v1238: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:57:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:22 smithi162 ceph-mon[33046]: osdmap e762: 8 total, 8 up, 8 in 2024-09-21T13:57:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:22 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2620424452' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:23.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:22 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:23.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:22 smithi002 ceph-mon[30076]: pgmap v1238: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:23.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:57:23.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:22 smithi002 ceph-mon[30076]: osdmap e762: 8 total, 8 up, 8 in 2024-09-21T13:57:23.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:22 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2620424452' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:23.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:22 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:23.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:22 smithi002 ceph-mon[40622]: pgmap v1238: 188 pgs: 188 active+clean; 884 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:23.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_bytes", "val": "0"}]': finished 2024-09-21T13:57:23.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:22 smithi002 ceph-mon[40622]: osdmap e762: 8 total, 8 up, 8 in 2024-09-21T13:57:23.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:22 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2620424452' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:23.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:22 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:23.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.959+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 <== mon.2 v2:172.21.15.2:3301/0 9 ==== osd_map(764..764 src has 1..764) ==== 628+0+0 (secure 0 0 0) 0x7ff1f806c0c0 con 0x7ff1fc103ca0 2024-09-21T13:57:23.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.959+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=765}) -- 0x7ff1e80880c0 con 0x7ff1fc103ca0 2024-09-21T13:57:23.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.965+0000 7ff1f37fe640 1 -- 172.21.15.2:0/2620424452 <== mon.2 v2:172.21.15.2:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec v764) ==== 221+0+0 (secure 0 0 0) 0x7ff1f806eb40 con 0x7ff1fc103ca0 2024-09-21T13:57:23.966 INFO:tasks.workunit.client.0.smithi002.stderr:set-quota max_objects = 0 for pool 38aaefc6-8a1e-49b1-92ce-d87544792aec 2024-09-21T13:57:23.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 -- 172.21.15.2:0/2620424452 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff1e807b110 msgr2=0x7ff1e807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:23.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 --2- 172.21.15.2:0/2620424452 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff1e807b110 0x7ff1e807d5d0 secure :-1 s=READY pgs=3907 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc0ffec0 tx=0x7ff1ec010040 comp rx=0 tx=0).stop 2024-09-21T13:57:23.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 -- 172.21.15.2:0/2620424452 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff1fc103ca0 msgr2=0x7ff1fc1988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:23.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 --2- 172.21.15.2:0/2620424452 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff1fc103ca0 0x7ff1fc1988f0 secure :-1 s=READY pgs=3001 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800ea60 tx=0x7ff1f800ef20 comp rx=0 tx=0).stop 2024-09-21T13:57:23.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 -- 172.21.15.2:0/2620424452 shutdown_connections 2024-09-21T13:57:23.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 --2- 172.21.15.2:0/2620424452 >> v2:172.21.15.2:6800/2394073254 conn(0x7ff1e807b110 0x7ff1e807d5d0 unknown :-1 s=CLOSED pgs=3907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:23.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 --2- 172.21.15.2:0/2620424452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1fc10d0f0 0x7ff1fc19e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:23.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 --2- 172.21.15.2:0/2620424452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1fc1045c0 0x7ff1fc198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:23.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 --2- 172.21.15.2:0/2620424452 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7ff1fc103ca0 0x7ff1fc1988f0 unknown :-1 s=CLOSED pgs=3001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:23.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 -- 172.21.15.2:0/2620424452 >> 172.21.15.2:0/2620424452 conn(0x7ff1fc0fd690 msgr2=0x7ff1fc10f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:57:23.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 -- 172.21.15.2:0/2620424452 shutdown_connections 2024-09-21T13:57:23.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:23.969+0000 7ff2043d3640 1 -- 172.21.15.2:0/2620424452 wait complete. 2024-09-21T13:57:23.981 INFO:tasks.workunit.client.0.smithi002.stderr:+ sleep 30 2024-09-21T13:57:24.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:57:24.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:23 smithi162 ceph-mon[33046]: osdmap e763: 8 total, 8 up, 8 in 2024-09-21T13:57:24.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:23 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2620424452' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:24.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:23 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:24.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:57:24.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:23 smithi002 ceph-mon[40622]: osdmap e763: 8 total, 8 up, 8 in 2024-09-21T13:57:24.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:23 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2620424452' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:24.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:23 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:57:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:23 smithi002 ceph-mon[30076]: osdmap e763: 8 total, 8 up, 8 in 2024-09-21T13:57:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:23 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2620424452' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:24.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:23 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"} : dispatch 2024-09-21T13:57:25.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:24 smithi162 ceph-mon[33046]: pgmap v1241: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T13:57:25.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:24 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:57:25.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:24 smithi162 ceph-mon[33046]: osdmap e764: 8 total, 8 up, 8 in 2024-09-21T13:57:25.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:24 smithi002 ceph-mon[30076]: pgmap v1241: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T13:57:25.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:24 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:57:25.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:24 smithi002 ceph-mon[30076]: osdmap e764: 8 total, 8 up, 8 in 2024-09-21T13:57:25.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:24 smithi002 ceph-mon[40622]: pgmap v1241: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-21T13:57:25.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:24 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "field": "max_objects", "val": "0"}]': finished 2024-09-21T13:57:25.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:24 smithi002 ceph-mon[40622]: osdmap e764: 8 total, 8 up, 8 in 2024-09-21T13:57:26.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:25 smithi162 ceph-mon[33046]: pgmap v1243: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-09-21T13:57:26.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:25 smithi002 ceph-mon[30076]: pgmap v1243: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-09-21T13:57:26.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:25 smithi002 ceph-mon[40622]: pgmap v1243: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-09-21T13:57:29.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:28 smithi002 ceph-mon[30076]: pgmap v1244: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-09-21T13:57:29.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:28 smithi002 ceph-mon[40622]: pgmap v1244: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-09-21T13:57:29.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:28 smithi162 ceph-mon[33046]: pgmap v1244: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-09-21T13:57:29.829 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:57:29 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:57:30.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:29 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:30.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:29 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:30.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:29 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:57:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:57:30.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:29 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:31.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:30 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:31.100 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:30 smithi002 ceph-mon[30076]: pgmap v1245: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T13:57:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:30 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:31.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:30 smithi002 ceph-mon[40622]: pgmap v1245: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T13:57:31.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:30 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:31.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:30 smithi162 ceph-mon[33046]: pgmap v1245: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T13:57:33.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:32 smithi002 ceph-mon[30076]: pgmap v1246: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-09-21T13:57:33.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:32 smithi002 ceph-mon[40622]: pgmap v1246: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-09-21T13:57:33.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:32 smithi162 ceph-mon[33046]: pgmap v1246: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-09-21T13:57:35.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:34 smithi002 ceph-mon[30076]: pgmap v1247: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:35.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:34 smithi002 ceph-mon[40622]: pgmap v1247: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:35.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:34 smithi162 ceph-mon[33046]: pgmap v1247: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:37.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:36 smithi002 ceph-mon[30076]: pgmap v1248: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 866 B/s rd, 0 op/s 2024-09-21T13:57:37.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:36 smithi002 ceph-mon[40622]: pgmap v1248: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 866 B/s rd, 0 op/s 2024-09-21T13:57:37.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:36 smithi162 ceph-mon[33046]: pgmap v1248: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 866 B/s rd, 0 op/s 2024-09-21T13:57:39.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:38 smithi002 ceph-mon[30076]: pgmap v1249: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:39.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:38 smithi002 ceph-mon[40622]: pgmap v1249: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:39.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:38 smithi162 ceph-mon[33046]: pgmap v1249: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:39.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:57:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:57:40.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:39 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:57:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:57:41.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:40 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:41.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:40 smithi002 ceph-mon[30076]: pgmap v1250: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:40 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:41.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:40 smithi002 ceph-mon[40622]: pgmap v1250: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:40 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:41.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:40 smithi162 ceph-mon[33046]: pgmap v1250: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:43.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:42 smithi002 ceph-mon[30076]: pgmap v1251: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:43.100 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:42 smithi002 ceph-mon[40622]: pgmap v1251: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:43.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:42 smithi162 ceph-mon[33046]: pgmap v1251: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:45.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:44 smithi162 ceph-mon[33046]: pgmap v1252: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:45.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:44 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:45.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:44 smithi002 ceph-mon[40622]: pgmap v1252: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:45.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:44 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:45.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:44 smithi002 ceph-mon[30076]: pgmap v1252: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:45.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:44 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:57:47.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:46 smithi162 ceph-mon[33046]: pgmap v1253: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:47.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:46 smithi002 ceph-mon[30076]: pgmap v1253: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:47.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:46 smithi002 ceph-mon[40622]: pgmap v1253: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:49.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:48 smithi002 ceph-mon[30076]: pgmap v1254: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:49.152 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:48 smithi002 ceph-mon[40622]: pgmap v1254: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:49.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:48 smithi162 ceph-mon[33046]: pgmap v1254: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:49.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:57:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:57:50.100 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:49 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:57:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:57:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:50 smithi162 ceph-mon[33046]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:51.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:50 smithi162 ceph-mon[33046]: pgmap v1255: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:51.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:50 smithi002 ceph-mon[30076]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:51.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:50 smithi002 ceph-mon[30076]: pgmap v1255: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:51.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:50 smithi002 ceph-mon[40622]: from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T13:57:51.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:50 smithi002 ceph-mon[40622]: pgmap v1255: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:53.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:52 smithi162 ceph-mon[33046]: pgmap v1256: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:53.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:52 smithi002 ceph-mon[30076]: pgmap v1256: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:53.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:52 smithi002 ceph-mon[40622]: pgmap v1256: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T13:57:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool delete 38aaefc6-8a1e-49b1-92ce-d87544792aec 38aaefc6-8a1e-49b1-92ce-d87544792aec --yes-i-really-really-mean-it 2024-09-21T13:57:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.082+0000 7fe19233d640 1 -- 172.21.15.2:0/4289666728 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe18c109120 msgr2=0x7fe18c10f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.082+0000 7fe19233d640 1 --2- 172.21.15.2:0/4289666728 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe18c109120 0x7fe18c10f920 secure :-1 s=READY pgs=3002 cs=0 l=1 rev1=1 crypto rx=0x7fe184009ca0 tx=0x7fe18402a8c0 comp rx=0 tx=0).stop 2024-09-21T13:57:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.082+0000 7fe19233d640 1 -- 172.21.15.2:0/4289666728 shutdown_connections 2024-09-21T13:57:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.082+0000 7fe19233d640 1 --2- 172.21.15.2:0/4289666728 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe18c109120 0x7fe18c10f920 unknown :-1 s=CLOSED pgs=3002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.082+0000 7fe19233d640 1 --2- 172.21.15.2:0/4289666728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c1087a0 0x7fe18c108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.082+0000 7fe19233d640 1 --2- 172.21.15.2:0/4289666728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe18c102da0 0x7fe18c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.082+0000 7fe19233d640 1 -- 172.21.15.2:0/4289666728 >> 172.21.15.2:0/4289666728 conn(0x7fe18c0fe800 msgr2=0x7fe18c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:57:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.082+0000 7fe19233d640 1 -- 172.21.15.2:0/4289666728 shutdown_connections 2024-09-21T13:57:54.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.082+0000 7fe19233d640 1 -- 172.21.15.2:0/4289666728 wait complete. 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe19233d640 1 Processor -- start 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe19233d640 1 -- start start 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe19233d640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe18c102da0 0x7fe18c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe19233d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c1087a0 0x7fe18c198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe19233d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe18c109120 0x7fe18c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe19233d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c112500 con 0x7fe18c109120 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe19233d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c112380 con 0x7fe18c1087a0 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe19233d640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7fe18c112680 con 0x7fe18c102da0 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe18bfff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe18c102da0 0x7fe18c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe18bfff640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe18c102da0 0x7fe18c1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:41740/0 (socket says 172.21.15.2:41740) 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe1908da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe18c109120 0x7fe18c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe18bfff640 1 -- 172.21.15.2:0/112721634 learned_addr learned my addr 172.21.15.2:0/112721634 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe183fff640 1 --2- 172.21.15.2:0/112721634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c1087a0 0x7fe18c198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe18bfff640 1 -- 172.21.15.2:0/112721634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c1087a0 msgr2=0x7fe18c198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe18bfff640 1 --2- 172.21.15.2:0/112721634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c1087a0 0x7fe18c198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe18bfff640 1 -- 172.21.15.2:0/112721634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe18c109120 msgr2=0x7fe18c19e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe18bfff640 1 --2- 172.21.15.2:0/112721634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe18c109120 0x7fe18c19e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.083+0000 7fe18bfff640 1 -- 172.21.15.2:0/112721634 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c19ea40 con 0x7fe18c102da0 2024-09-21T13:57:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.084+0000 7fe18bfff640 1 --2- 172.21.15.2:0/112721634 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe18c102da0 0x7fe18c1989a0 secure :-1 s=READY pgs=3003 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00ea60 tx=0x7fe17c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:57:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.084+0000 7fe189ffb640 1 -- 172.21.15.2:0/112721634 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c00cde0 con 0x7fe18c102da0 2024-09-21T13:57:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.084+0000 7fe189ffb640 1 -- 172.21.15.2:0/112721634 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fe17c0035f0 con 0x7fe18c102da0 2024-09-21T13:57:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.084+0000 7fe189ffb640 1 -- 172.21.15.2:0/112721634 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0044a0 con 0x7fe18c102da0 2024-09-21T13:57:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.084+0000 7fe19233d640 1 -- 172.21.15.2:0/112721634 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18c19ed30 con 0x7fe18c102da0 2024-09-21T13:57:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.084+0000 7fe19233d640 1 -- 172.21.15.2:0/112721634 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18c1a53f0 con 0x7fe18c102da0 2024-09-21T13:57:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.085+0000 7fe19233d640 1 -- 172.21.15.2:0/112721634 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18c103180 con 0x7fe18c102da0 2024-09-21T13:57:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.086+0000 7fe189ffb640 1 -- 172.21.15.2:0/112721634 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7fe17c004000 con 0x7fe18c102da0 2024-09-21T13:57:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.086+0000 7fe189ffb640 1 --2- 172.21.15.2:0/112721634 >> v2:172.21.15.2:6800/2394073254 conn(0x7fe17807b110 0x7fe17807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:54.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.086+0000 7fe189ffb640 1 -- 172.21.15.2:0/112721634 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(764..764 src has 1..764) ==== 8218+0+0 (secure 0 0 0) 0x7fe17c09eea0 con 0x7fe18c102da0 2024-09-21T13:57:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.086+0000 7fe183fff640 1 --2- 172.21.15.2:0/112721634 >> v2:172.21.15.2:6800/2394073254 conn(0x7fe17807b110 0x7fe17807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.087+0000 7fe189ffb640 1 -- 172.21.15.2:0/112721634 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=765}) -- 0x7fe178086e90 con 0x7fe18c102da0 2024-09-21T13:57:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.087+0000 7fe183fff640 1 --2- 172.21.15.2:0/112721634 >> v2:172.21.15.2:6800/2394073254 conn(0x7fe17807b110 0x7fe17807d5d0 secure :-1 s=READY pgs=3908 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0ff420 tx=0x7fe17400b410 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:57:54.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.091+0000 7fe189ffb640 1 -- 172.21.15.2:0/112721634 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe17c069c40 con 0x7fe18c102da0 2024-09-21T13:57:54.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.281+0000 7fe19233d640 1 -- 172.21.15.2:0/112721634 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe18c1a56b0 con 0x7fe18c102da0 2024-09-21T13:57:54.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.872+0000 7fe189ffb640 1 -- 172.21.15.2:0/112721634 <== mon.2 v2:172.21.15.2:3301/0 7 ==== osd_map(765..765 src has 1..765) ==== 296+0+0 (secure 0 0 0) 0x7fe17c09ca90 con 0x7fe18c102da0 2024-09-21T13:57:54.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.873+0000 7fe189ffb640 1 -- 172.21.15.2:0/112721634 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=766}) -- 0x7fe178087760 con 0x7fe18c102da0 2024-09-21T13:57:54.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.877+0000 7fe189ffb640 1 -- 172.21.15.2:0/112721634 <== mon.2 v2:172.21.15.2:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true}]=0 pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' removed v765) ==== 248+0+0 (secure 0 0 0) 0x7fe17c06eaf0 con 0x7fe18c102da0 2024-09-21T13:57:54.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.994+0000 7fe19233d640 1 -- 172.21.15.2:0/112721634 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe18c1a5930 con 0x7fe18c102da0 2024-09-21T13:57:54.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.995+0000 7fe189ffb640 1 -- 172.21.15.2:0/112721634 <== mon.2 v2:172.21.15.2:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true}]=0 pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' does not exist v765) ==== 255+0+0 (secure 0 0 0) 0x7fe17c06c0c0 con 0x7fe18c102da0 2024-09-21T13:57:54.995 INFO:tasks.workunit.client.0.smithi002.stderr:pool '38aaefc6-8a1e-49b1-92ce-d87544792aec' does not exist 2024-09-21T13:57:54.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.997+0000 7fe19233d640 1 -- 172.21.15.2:0/112721634 >> v2:172.21.15.2:6800/2394073254 conn(0x7fe17807b110 msgr2=0x7fe17807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:54.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.997+0000 7fe19233d640 1 --2- 172.21.15.2:0/112721634 >> v2:172.21.15.2:6800/2394073254 conn(0x7fe17807b110 0x7fe17807d5d0 secure :-1 s=READY pgs=3908 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0ff420 tx=0x7fe17400b410 comp rx=0 tx=0).stop 2024-09-21T13:57:54.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.997+0000 7fe19233d640 1 -- 172.21.15.2:0/112721634 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe18c102da0 msgr2=0x7fe18c1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:54.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.997+0000 7fe19233d640 1 --2- 172.21.15.2:0/112721634 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe18c102da0 0x7fe18c1989a0 secure :-1 s=READY pgs=3003 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00ea60 tx=0x7fe17c00ef20 comp rx=0 tx=0).stop 2024-09-21T13:57:54.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.997+0000 7fe19233d640 1 -- 172.21.15.2:0/112721634 shutdown_connections 2024-09-21T13:57:54.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.997+0000 7fe19233d640 1 --2- 172.21.15.2:0/112721634 >> v2:172.21.15.2:6800/2394073254 conn(0x7fe17807b110 0x7fe17807d5d0 unknown :-1 s=CLOSED pgs=3908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:54.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.997+0000 7fe19233d640 1 --2- 172.21.15.2:0/112721634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe18c109120 0x7fe18c19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:54.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.997+0000 7fe19233d640 1 --2- 172.21.15.2:0/112721634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c1087a0 0x7fe18c198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:54.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.997+0000 7fe19233d640 1 --2- 172.21.15.2:0/112721634 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7fe18c102da0 0x7fe18c1989a0 unknown :-1 s=CLOSED pgs=3003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:54.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.997+0000 7fe19233d640 1 -- 172.21.15.2:0/112721634 >> 172.21.15.2:0/112721634 conn(0x7fe18c0fe800 msgr2=0x7fe18c100020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:57:54.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.998+0000 7fe19233d640 1 -- 172.21.15.2:0/112721634 shutdown_connections 2024-09-21T13:57:54.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:54.998+0000 7fe19233d640 1 -- 172.21.15.2:0/112721634 wait complete. 2024-09-21T13:57:55.006 INFO:tasks.workunit.client.0.smithi002.stderr:+ ceph osd pool delete 9395fcd5-0867-411e-8183-9f38ae58245b 9395fcd5-0867-411e-8183-9f38ae58245b --yes-i-really-really-mean-it 2024-09-21T13:57:55.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.092+0000 7f3549833640 1 -- 172.21.15.2:0/411103982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35441045c0 msgr2=0x7f354410caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:55.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.092+0000 7f3549833640 1 --2- 172.21.15.2:0/411103982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35441045c0 0x7f354410caa0 secure :-1 s=READY pgs=2877 cs=0 l=1 rev1=1 crypto rx=0x7f3538009860 tx=0x7f353802a340 comp rx=0 tx=0).stop 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.092+0000 7f3549833640 1 -- 172.21.15.2:0/411103982 shutdown_connections 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.092+0000 7f3549833640 1 --2- 172.21.15.2:0/411103982 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f354410d0f0 0x7f354410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.092+0000 7f3549833640 1 --2- 172.21.15.2:0/411103982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35441045c0 0x7f354410caa0 unknown :-1 s=CLOSED pgs=2877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.092+0000 7f3549833640 1 --2- 172.21.15.2:0/411103982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3544103ca0 0x7f3544104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.092+0000 7f3549833640 1 -- 172.21.15.2:0/411103982 >> 172.21.15.2:0/411103982 conn(0x7f35440fd690 msgr2=0x7f35440ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.092+0000 7f3549833640 1 -- 172.21.15.2:0/411103982 shutdown_connections 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.092+0000 7f3549833640 1 -- 172.21.15.2:0/411103982 wait complete. 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.093+0000 7f3549833640 1 Processor -- start 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.093+0000 7f3549833640 1 -- start start 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.093+0000 7f3549833640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f3544103ca0 0x7f354419acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.093+0000 7f3549833640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35441045c0 0x7f354419b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.093+0000 7f3549833640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354410d0f0 0x7f35441a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.093+0000 7f3549833640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3544112490 con 0x7f35441045c0 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.093+0000 7f3549833640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3544112310 con 0x7f354410d0f0 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.093+0000 7f3549833640 1 -- --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_getmap magic: 0 -- 0x7f3544112610 con 0x7f3544103ca0 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3542ffd640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f3544103ca0 0x7f354419acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f35427fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35441045c0 0x7f354419b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3542ffd640 1 --2- >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f3544103ca0 0x7f354419acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3301/0 says I am v2:172.21.15.2:41758/0 (socket says 172.21.15.2:41758) 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3542ffd640 1 -- 172.21.15.2:0/2713475504 learned_addr learned my addr 172.21.15.2:0/2713475504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f35437fe640 1 --2- 172.21.15.2:0/2713475504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354410d0f0 0x7f35441a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3542ffd640 1 -- 172.21.15.2:0/2713475504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354410d0f0 msgr2=0x7f35441a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3542ffd640 1 --2- 172.21.15.2:0/2713475504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354410d0f0 0x7f35441a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3542ffd640 1 -- 172.21.15.2:0/2713475504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35441045c0 msgr2=0x7f354419b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3542ffd640 1 --2- 172.21.15.2:0/2713475504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35441045c0 0x7f354419b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3542ffd640 1 -- 172.21.15.2:0/2713475504 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35441a0d60 con 0x7f3544103ca0 2024-09-21T13:57:55.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f35427fc640 1 --2- 172.21.15.2:0/2713475504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35441045c0 0x7f354419b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:57:55.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3542ffd640 1 --2- 172.21.15.2:0/2713475504 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f3544103ca0 0x7f354419acc0 secure :-1 s=READY pgs=3004 cs=0 l=1 rev1=1 crypto rx=0x7f353400b4a0 tx=0x7f353400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:57:55.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3548831640 1 -- 172.21.15.2:0/2713475504 <== mon.2 v2:172.21.15.2:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534014070 con 0x7f3544103ca0 2024-09-21T13:57:55.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3548831640 1 -- 172.21.15.2:0/2713475504 <== mon.2 v2:172.21.15.2:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f3534010a90 con 0x7f3544103ca0 2024-09-21T13:57:55.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3549833640 1 -- 172.21.15.2:0/2713475504 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35441a1050 con 0x7f3544103ca0 2024-09-21T13:57:55.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3548831640 1 -- 172.21.15.2:0/2713475504 <== mon.2 v2:172.21.15.2:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534017b80 con 0x7f3544103ca0 2024-09-21T13:57:55.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.094+0000 7f3549833640 1 -- 172.21.15.2:0/2713475504 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35441a7710 con 0x7f3544103ca0 2024-09-21T13:57:55.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.095+0000 7f3549833640 1 -- 172.21.15.2:0/2713475504 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3544104080 con 0x7f3544103ca0 2024-09-21T13:57:55.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.096+0000 7f3548831640 1 -- 172.21.15.2:0/2713475504 <== mon.2 v2:172.21.15.2:3301/0 4 ==== mgrmap(e 22) ==== 103253+0+0 (secure 0 0 0) 0x7f3534017070 con 0x7f3544103ca0 2024-09-21T13:57:55.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.096+0000 7f3548831640 1 --2- 172.21.15.2:0/2713475504 >> v2:172.21.15.2:6800/2394073254 conn(0x7f352c07b110 0x7f352c07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:57:55.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.097+0000 7f35427fc640 1 --2- 172.21.15.2:0/2713475504 >> v2:172.21.15.2:6800/2394073254 conn(0x7f352c07b110 0x7f352c07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:57:55.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.097+0000 7f3548831640 1 -- 172.21.15.2:0/2713475504 <== mon.2 v2:172.21.15.2:3301/0 5 ==== osd_map(765..765 src has 1..765) ==== 7830+0+0 (secure 0 0 0) 0x7f353409dfd0 con 0x7f3544103ca0 2024-09-21T13:57:55.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.097+0000 7f3548831640 1 -- 172.21.15.2:0/2713475504 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=766}) -- 0x7f352c086670 con 0x7f3544103ca0 2024-09-21T13:57:55.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.097+0000 7f35427fc640 1 --2- 172.21.15.2:0/2713475504 >> v2:172.21.15.2:6800/2394073254 conn(0x7f352c07b110 0x7f352c07d5d0 secure :-1 s=READY pgs=3909 cs=0 l=1 rev1=1 crypto rx=0x7f3538009830 tx=0x7f35380058d0 comp rx=0 tx=0).ready entity=mgr.14607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:57:55.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.101+0000 7f3548831640 1 -- 172.21.15.2:0/2713475504 <== mon.2 v2:172.21.15.2:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3534068f40 con 0x7f3544103ca0 2024-09-21T13:57:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:54 smithi162 ceph-mon[33046]: pgmap v1257: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:54 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/112721634' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:55.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:54 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:55.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.295+0000 7f3549833640 1 -- 172.21.15.2:0/2713475504 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} v 0) -- 0x7f35441a79d0 con 0x7f3544103ca0 2024-09-21T13:57:55.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:54 smithi002 ceph-mon[40622]: pgmap v1257: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:55.349 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:54 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/112721634' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:55.350 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:54 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:55.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:54 smithi002 ceph-mon[30076]: pgmap v1257: 188 pgs: 188 active+clean; 897 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T13:57:55.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:54 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/112721634' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:55.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:54 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:55.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.879+0000 7f3548831640 1 -- 172.21.15.2:0/2713475504 <== mon.2 v2:172.21.15.2:3301/0 7 ==== osd_map(766..766 src has 1..766) ==== 296+0+0 (secure 0 0 0) 0x7f35340d5710 con 0x7f3544103ca0 2024-09-21T13:57:55.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.879+0000 7f3548831640 1 -- 172.21.15.2:0/2713475504 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_subscribe({osdmap=767}) -- 0x7f352c086f00 con 0x7f3544103ca0 2024-09-21T13:57:55.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:55.885+0000 7f3548831640 1 -- 172.21.15.2:0/2713475504 <== mon.2 v2:172.21.15.2:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true}]=0 pool '9395fcd5-0867-411e-8183-9f38ae58245b' removed v766) ==== 248+0+0 (secure 0 0 0) 0x7f353406ddf0 con 0x7f3544103ca0 2024-09-21T13:57:56.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.008+0000 7f3549833640 1 -- 172.21.15.2:0/2713475504 --> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} v 0) -- 0x7f354419bde0 con 0x7f3544103ca0 2024-09-21T13:57:56.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.008+0000 7f3548831640 1 -- 172.21.15.2:0/2713475504 <== mon.2 v2:172.21.15.2:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true}]=0 pool '9395fcd5-0867-411e-8183-9f38ae58245b' does not exist v766) ==== 255+0+0 (secure 0 0 0) 0x7f353409bdc0 con 0x7f3544103ca0 2024-09-21T13:57:56.008 INFO:tasks.workunit.client.0.smithi002.stderr:pool '9395fcd5-0867-411e-8183-9f38ae58245b' does not exist 2024-09-21T13:57:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 -- 172.21.15.2:0/2713475504 >> v2:172.21.15.2:6800/2394073254 conn(0x7f352c07b110 msgr2=0x7f352c07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 --2- 172.21.15.2:0/2713475504 >> v2:172.21.15.2:6800/2394073254 conn(0x7f352c07b110 0x7f352c07d5d0 secure :-1 s=READY pgs=3909 cs=0 l=1 rev1=1 crypto rx=0x7f3538009830 tx=0x7f35380058d0 comp rx=0 tx=0).stop 2024-09-21T13:57:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 -- 172.21.15.2:0/2713475504 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f3544103ca0 msgr2=0x7f354419acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:57:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 --2- 172.21.15.2:0/2713475504 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f3544103ca0 0x7f354419acc0 secure :-1 s=READY pgs=3004 cs=0 l=1 rev1=1 crypto rx=0x7f353400b4a0 tx=0x7f353400b960 comp rx=0 tx=0).stop 2024-09-21T13:57:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 -- 172.21.15.2:0/2713475504 shutdown_connections 2024-09-21T13:57:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 --2- 172.21.15.2:0/2713475504 >> v2:172.21.15.2:6800/2394073254 conn(0x7f352c07b110 0x7f352c07d5d0 unknown :-1 s=CLOSED pgs=3909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 --2- 172.21.15.2:0/2713475504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354410d0f0 0x7f35441a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 --2- 172.21.15.2:0/2713475504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35441045c0 0x7f354419b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 --2- 172.21.15.2:0/2713475504 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x7f3544103ca0 0x7f354419acc0 unknown :-1 s=CLOSED pgs=3004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:57:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 -- 172.21.15.2:0/2713475504 >> 172.21.15.2:0/2713475504 conn(0x7f35440fd690 msgr2=0x7f354410e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:57:56.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 -- 172.21.15.2:0/2713475504 shutdown_connections 2024-09-21T13:57:56.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-21T13:57:56.011+0000 7f3549833640 1 -- 172.21.15.2:0/2713475504 wait complete. 2024-09-21T13:57:56.020 INFO:tasks.workunit.client.0.smithi002.stdout:OK 2024-09-21T13:57:56.021 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo OK 2024-09-21T13:57:56.021 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T13:57:56.021 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T13:57:56.089 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-09-21T13:57:56.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T13:57:56.152 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T13:57:56.152 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[40622]: osdmap e765: 8 total, 8 up, 8 in 2024-09-21T13:57:56.152 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/112721634' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.153 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.153 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2713475504' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.153 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T13:57:56.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[30076]: osdmap e765: 8 total, 8 up, 8 in 2024-09-21T13:57:56.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/112721634' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2713475504' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:55 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T13:57:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:55 smithi162 ceph-mon[33046]: osdmap e765: 8 total, 8 up, 8 in 2024-09-21T13:57:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/112721634' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "pool2": "38aaefc6-8a1e-49b1-92ce-d87544792aec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:55 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2713475504' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:55 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.439 DEBUG:teuthology.parallel:result is None 2024-09-21T13:57:56.440 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T13:57:56.506 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T13:57:56.507 DEBUG:teuthology.orchestra.run.smithi002:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-21T13:57:56.569 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T13:57:56.569 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T13:57:56.579 INFO:tasks.cephadm:Teardown begin 2024-09-21T13:57:56.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T13:57:56.635 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T13:57:56.663 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T13:57:56.663 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T13:57:56.691 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T13:57:56.718 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T13:57:56.721 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T13:57:56.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.a 2024-09-21T13:57:56.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:56 smithi162 ceph-mon[33046]: pgmap v1259: 176 pgs: 176 active+clean; 708 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:56.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:56 smithi162 ceph-mon[33046]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:57:56.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T13:57:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:56 smithi162 ceph-mon[33046]: osdmap e766: 8 total, 8 up, 8 in 2024-09-21T13:57:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:56 smithi162 ceph-mon[33046]: from='client.? 172.21.15.2:0/2713475504' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:56 smithi162 ceph-mon[33046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:56 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:57:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:56 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:57:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:56 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:57:56.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:56 smithi162 ceph-mon[33046]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:57:57.087 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[40622]: pgmap v1259: 176 pgs: 176 active+clean; 708 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:57.087 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[40622]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:57:57.087 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T13:57:57.087 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[40622]: osdmap e766: 8 total, 8 up, 8 in 2024-09-21T13:57:57.087 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[40622]: from='client.? 172.21.15.2:0/2713475504' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:57.087 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[40622]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:57.087 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:57:57.087 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:57:57.087 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:57:57.087 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[40622]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:56 smithi002 systemd[1]: Stopping Ceph mon.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[30076]: pgmap v1259: 176 pgs: 176 active+clean; 708 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[30076]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-21T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[30076]: osdmap e766: 8 total, 8 up, 8 in 2024-09-21T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[30076]: from='client.? 172.21.15.2:0/2713475504' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[30076]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "9395fcd5-0867-411e-8183-9f38ae58245b", "pool2": "9395fcd5-0867-411e-8183-9f38ae58245b", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:56 smithi002 ceph-mon[30076]: from='mgr.14607 172.21.15.2:0/4174026053' entity='mgr.y' 2024-09-21T13:57:57.349 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:57 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a[30053]: 2024-09-21T13:57:57.087+0000 7fbb3a5f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:57:57.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:57 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a[30053]: 2024-09-21T13:57:57.087+0000 7fbb3a5f7640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T13:57:57.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:57 smithi002 podman[147479]: 2024-09-21 13:57:57.117571675 +0000 UTC m=+0.152472389 container died cd34e73343396fe7019ccefc093fb190257e3587cdef7789e84935193f6da204 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T13:57:57.350 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:57 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:57:57] ENGINE Bus STOPPING 2024-09-21T13:57:57.350 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:57 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:57:57] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T13:57:57.350 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:57 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:57:57] ENGINE Bus STOPPED 2024-09-21T13:57:57.350 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:57 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:57:57] ENGINE Bus STARTING 2024-09-21T13:57:57.350 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:57 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:57:57] ENGINE Serving on http://:::9283 2024-09-21T13:57:57.350 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:57 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: [21/Sep/2024:13:57:57] ENGINE Bus STARTED 2024-09-21T13:57:57.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:57 smithi002 podman[147479]: 2024-09-21 13:57:57.72715708 +0000 UTC m=+0.762057792 container cleanup cd34e73343396fe7019ccefc093fb190257e3587cdef7789e84935193f6da204 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T13:57:57.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:57 smithi002 bash[147479]: ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a 2024-09-21T13:57:58.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.a.service' 2024-09-21T13:57:58.235 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:57 smithi002 podman[147496]: 2024-09-21 13:57:57.97052858 +0000 UTC m=+0.856041012 container remove cd34e73343396fe7019ccefc093fb190257e3587cdef7789e84935193f6da204 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:57:58.235 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:58 smithi002 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T13:57:58.235 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:58 smithi002 systemd[1]: Stopped Ceph mon.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:57:58.235 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 21 13:57:58 smithi002 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.a.service: Consumed 39.334s CPU time. 2024-09-21T13:57:58.251 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:57:58.251 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T13:57:58.251 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-09-21T13:57:58.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.c 2024-09-21T13:57:58.599 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:58 smithi002 systemd[1]: Stopping Ceph mon.c for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:57:58.966 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:58 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-c[40599]: 2024-09-21T13:57:58.608+0000 7ff39af7e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:57:58.966 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:58 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-c[40599]: 2024-09-21T13:57:58.608+0000 7ff39af7e640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T13:57:58.966 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:58 smithi002 podman[147623]: 2024-09-21 13:57:58.690697332 +0000 UTC m=+0.209106590 container died cda42718abf5511e3d45d5a5b40e8bfec0b359a5096b1f0cefe0b297c8784735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-c, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:57:59.333 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:59 smithi002 podman[147623]: 2024-09-21 13:57:59.073775244 +0000 UTC m=+0.592184494 container cleanup cda42718abf5511e3d45d5a5b40e8bfec0b359a5096b1f0cefe0b297c8784735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-c, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T13:57:59.333 INFO:journalctl@ceph.mon.c.smithi002.stdout:Sep 21 13:57:59 smithi002 bash[147623]: ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-c 2024-09-21T13:57:59.508 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.c.service' 2024-09-21T13:57:59.543 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:57:59.543 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-09-21T13:57:59.544 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-09-21T13:57:59.544 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.b 2024-09-21T13:57:59.952 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:59 smithi162 systemd[1]: Stopping Ceph mon.b for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:57:59.953 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:57:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug there is no tcmu-runner data available 2024-09-21T13:58:00.099 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:57:59 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: ::ffff:172.21.15.162 - - [21/Sep/2024:13:57:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-21T13:58:00.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-b[33023]: 2024-09-21T13:57:59.951+0000 7f8866290640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:58:00.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:57:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-b[33023]: 2024-09-21T13:57:59.951+0000 7f8866290640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T13:58:00.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:58:00 smithi162 podman[68180]: 2024-09-21 13:58:00.064629392 +0000 UTC m=+0.317903561 container died c5985f32b311f04e4a33bf8681b8c101ff6579f50d8112826e8666818df6c728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:58:00.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:58:00 smithi162 podman[68180]: 2024-09-21 13:58:00.576662343 +0000 UTC m=+0.829936511 container cleanup c5985f32b311f04e4a33bf8681b8c101ff6579f50d8112826e8666818df6c728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2) 2024-09-21T13:58:00.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:58:00 smithi162 bash[68180]: ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-b 2024-09-21T13:58:01.016 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.b.service' 2024-09-21T13:58:01.038 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:58:00 smithi162 podman[68197]: 2024-09-21 13:58:00.786637386 +0000 UTC m=+0.725624048 container remove c5985f32b311f04e4a33bf8681b8c101ff6579f50d8112826e8666818df6c728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T13:58:01.039 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:58:01 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T13:58:01.039 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:58:01 smithi162 systemd[1]: Stopped Ceph mon.b for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:58:01.039 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 13:58:01 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@mon.b.service: Consumed 23.549s CPU time. 2024-09-21T13:58:01.065 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:58:01.065 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-09-21T13:58:01.066 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T13:58:01.066 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@mgr.y 2024-09-21T13:58:01.349 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:58:01 smithi002 systemd[1]: Stopping Ceph mgr.y for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:58:01.679 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:58:01 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y[30335]: 2024-09-21T13:58:01.370+0000 7fbeea9bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:58:01.679 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:58:01 smithi002 podman[147757]: 2024-09-21 13:58:01.403566062 +0000 UTC m=+0.126519518 container died e26b0d1e4d277786a6114031c4967061cb8a678efe8f4f0f26666232dc69a2d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T13:58:02.055 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:58:01 smithi002 podman[147757]: 2024-09-21 13:58:01.803794167 +0000 UTC m=+0.526747622 container cleanup e26b0d1e4d277786a6114031c4967061cb8a678efe8f4f0f26666232dc69a2d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T13:58:02.055 INFO:journalctl@ceph.mgr.y.smithi002.stdout:Sep 21 13:58:01 smithi002 bash[147757]: ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-y 2024-09-21T13:58:02.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@mgr.y.service' 2024-09-21T13:58:02.226 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:58:02.227 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T13:58:02.227 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T13:58:02.227 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@mgr.x 2024-09-21T13:58:02.573 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:58:02 smithi162 systemd[1]: Stopping Ceph mgr.x for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:58:02.823 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:58:02 smithi162 podman[68312]: 2024-09-21 13:58:02.572823834 +0000 UTC m=+0.152976859 container died bb4dab5e6b7d4553b56d4a1f2d278e5e5e7f7f32376bfd04ac0a4d6c06a75fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T13:58:03.107 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:58:02 smithi162 podman[68312]: 2024-09-21 13:58:02.8980981 +0000 UTC m=+0.478251114 container cleanup bb4dab5e6b7d4553b56d4a1f2d278e5e5e7f7f32376bfd04ac0a4d6c06a75fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T13:58:03.107 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:58:02 smithi162 bash[68312]: ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x 2024-09-21T13:58:03.378 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:58:03 smithi162 podman[68330]: 2024-09-21 13:58:03.108001053 +0000 UTC m=+0.538541907 container remove bb4dab5e6b7d4553b56d4a1f2d278e5e5e7f7f32376bfd04ac0a4d6c06a75fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T13:58:03.378 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Sep 21 13:58:03 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-09-21T13:58:03.382 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@mgr.x.service' 2024-09-21T13:58:03.417 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:58:03.417 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T13:58:03.417 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T13:58:03.417 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.0 2024-09-21T13:58:03.727 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:03 smithi002 systemd[1]: Stopping Ceph osd.0 for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:58:04.099 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:03 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0[44379]: 2024-09-21T13:58:03.726+0000 7fa8049f9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:58:04.100 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:03 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0[44379]: 2024-09-21T13:58:03.726+0000 7fa8049f9640 -1 osd.0 766 *** Got signal Terminated *** 2024-09-21T13:58:04.100 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:03 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0[44379]: 2024-09-21T13:58:03.726+0000 7fa8049f9640 -1 osd.0 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:58:09.427 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:09 smithi002 podman[147888]: 2024-09-21 13:58:09.10170883 +0000 UTC m=+5.485717922 container died 0aae0ecbe585820ec37d7465f402ea498a5d6cfb11433211e1a7b8abaaea4a47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T13:58:09.849 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:09 smithi002 podman[147888]: 2024-09-21 13:58:09.426847003 +0000 UTC m=+5.810856085 container cleanup 0aae0ecbe585820ec37d7465f402ea498a5d6cfb11433211e1a7b8abaaea4a47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:58:09.850 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:09 smithi002 bash[147888]: ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0 2024-09-21T13:58:10.349 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:09 smithi002 podman[147908]: 2024-09-21 13:58:09.926685609 +0000 UTC m=+0.817161736 container remove 0aae0ecbe585820ec37d7465f402ea498a5d6cfb11433211e1a7b8abaaea4a47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:58:10.696 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:10 smithi002 podman[148003]: 2024-09-21 13:58:10.322009767 +0000 UTC m=+0.016518616 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:58:10.696 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:10 smithi002 podman[148003]: 2024-09-21 13:58:10.435883048 +0000 UTC m=+0.130391926 container create c4fddabef3af17072fbea288092115b68f4b8fa7151e10c41bae778e9c2f47ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T13:58:11.100 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:10 smithi002 podman[148003]: 2024-09-21 13:58:10.696917788 +0000 UTC m=+0.391426625 container init c4fddabef3af17072fbea288092115b68f4b8fa7151e10c41bae778e9c2f47ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T13:58:11.100 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:10 smithi002 podman[148003]: 2024-09-21 13:58:10.70223461 +0000 UTC m=+0.396743454 container start c4fddabef3af17072fbea288092115b68f4b8fa7151e10c41bae778e9c2f47ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T13:58:11.100 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:10 smithi002 podman[148003]: 2024-09-21 13:58:10.788283771 +0000 UTC m=+0.482792615 container attach c4fddabef3af17072fbea288092115b68f4b8fa7151e10c41bae778e9c2f47ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T13:58:11.100 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:10 smithi002 podman[148003]: 2024-09-21 13:58:10.898315364 +0000 UTC m=+0.592824223 container died c4fddabef3af17072fbea288092115b68f4b8fa7151e10c41bae778e9c2f47ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T13:58:11.454 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 21 13:58:11 smithi002 podman[148046]: 2024-09-21 13:58:11.433192225 +0000 UTC m=+0.528581652 container remove c4fddabef3af17072fbea288092115b68f4b8fa7151e10c41bae778e9c2f47ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T13:58:11.460 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.0.service' 2024-09-21T13:58:11.504 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:58:11.504 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T13:58:11.504 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T13:58:11.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.1 2024-09-21T13:58:11.830 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:11 smithi002 systemd[1]: Stopping Ceph osd.1 for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:58:12.099 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:11 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1[50496]: 2024-09-21T13:58:11.829+0000 7f52bcc13640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:58:12.100 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:11 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1[50496]: 2024-09-21T13:58:11.829+0000 7f52bcc13640 -1 osd.1 766 *** Got signal Terminated *** 2024-09-21T13:58:12.100 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:11 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1[50496]: 2024-09-21T13:58:11.829+0000 7f52bcc13640 -1 osd.1 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:58:17.305 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:17 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:17.011Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused" 2024-09-21T13:58:17.306 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:17 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:17.012Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T13:58:17.571 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:17 smithi002 podman[148136]: 2024-09-21 13:58:17.306023551 +0000 UTC m=+5.571508446 container died ff11eb80c0ffcf62bc3b69116670fd2fc63cc97920e413e52a29c64ec63a8488 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:58:17.849 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:17 smithi002 podman[148136]: 2024-09-21 13:58:17.669369322 +0000 UTC m=+5.934854209 container cleanup ff11eb80c0ffcf62bc3b69116670fd2fc63cc97920e413e52a29c64ec63a8488 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T13:58:17.849 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:17 smithi002 bash[148136]: ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1 2024-09-21T13:58:18.348 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:17 smithi002 podman[148156]: 2024-09-21 13:58:17.97952234 +0000 UTC m=+0.675364235 container remove ff11eb80c0ffcf62bc3b69116670fd2fc63cc97920e413e52a29c64ec63a8488 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T13:58:18.600 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:18 smithi002 podman[148250]: 2024-09-21 13:58:18.251922609 +0000 UTC m=+0.016718168 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:58:18.600 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:18 smithi002 podman[148250]: 2024-09-21 13:58:18.375395542 +0000 UTC m=+0.140191087 container create 721a26b243600f2a2bd33f0b3e79f9a22368906fe3141e1da10e82721873ca13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T13:58:18.600 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:18 smithi002 podman[148250]: 2024-09-21 13:58:18.583079743 +0000 UTC m=+0.347875295 container init 721a26b243600f2a2bd33f0b3e79f9a22368906fe3141e1da10e82721873ca13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS) 2024-09-21T13:58:18.600 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:18 smithi002 podman[148250]: 2024-09-21 13:58:18.588132252 +0000 UTC m=+0.352927794 container start 721a26b243600f2a2bd33f0b3e79f9a22368906fe3141e1da10e82721873ca13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T13:58:19.099 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:18 smithi002 podman[148250]: 2024-09-21 13:58:18.733135913 +0000 UTC m=+0.497931470 container attach 721a26b243600f2a2bd33f0b3e79f9a22368906fe3141e1da10e82721873ca13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T13:58:19.100 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 21 13:58:18 smithi002 podman[148250]: 2024-09-21 13:58:18.783652512 +0000 UTC m=+0.548448067 container died 721a26b243600f2a2bd33f0b3e79f9a22368906fe3141e1da10e82721873ca13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T13:58:19.430 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.1.service' 2024-09-21T13:58:19.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:58:19.470 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T13:58:19.470 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T13:58:19.470 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.2 2024-09-21T13:58:19.800 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:19 smithi002 systemd[1]: Stopping Ceph osd.2 for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:58:20.099 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2[56281]: 2024-09-21T13:58:19.799+0000 7f6f5d8ed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:58:20.099 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2[56281]: 2024-09-21T13:58:19.799+0000 7f6f5d8ed640 -1 osd.2 766 *** Got signal Terminated *** 2024-09-21T13:58:20.099 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:19 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2[56281]: 2024-09-21T13:58:19.799+0000 7f6f5d8ed640 -1 osd.2 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:58:25.597 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:25 smithi002 podman[148378]: 2024-09-21 13:58:25.280711751 +0000 UTC m=+5.586561351 container died 1f36ee17bafd3cf5839331f0c1938809d6810183823d33cd49a9f44b8cf479e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T13:58:25.597 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:25 smithi002 podman[148378]: 2024-09-21 13:58:25.597401592 +0000 UTC m=+5.903251194 container cleanup 1f36ee17bafd3cf5839331f0c1938809d6810183823d33cd49a9f44b8cf479e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T13:58:25.849 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:25 smithi002 bash[148378]: ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2 2024-09-21T13:58:25.850 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:25 smithi002 podman[148411]: 2024-09-21 13:58:25.807216143 +0000 UTC m=+0.521129387 container remove 1f36ee17bafd3cf5839331f0c1938809d6810183823d33cd49a9f44b8cf479e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T13:58:26.560 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:26 smithi002 podman[148506]: 2024-09-21 13:58:26.216211207 +0000 UTC m=+0.108686772 container create ccb7207180666e6121f4a2ce1bc50964ea684dd94cca9fe5a9155dd615f7d110 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T13:58:26.560 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:26 smithi002 podman[148506]: 2024-09-21 13:58:26.12397851 +0000 UTC m=+0.016454076 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:58:26.560 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:26 smithi002 podman[148506]: 2024-09-21 13:58:26.426995654 +0000 UTC m=+0.319471219 container init ccb7207180666e6121f4a2ce1bc50964ea684dd94cca9fe5a9155dd615f7d110 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T13:58:26.560 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:26 smithi002 podman[148506]: 2024-09-21 13:58:26.432085585 +0000 UTC m=+0.324561150 container start ccb7207180666e6121f4a2ce1bc50964ea684dd94cca9fe5a9155dd615f7d110 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:58:26.560 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:26 smithi002 podman[148506]: 2024-09-21 13:58:26.560296779 +0000 UTC m=+0.452772362 container attach ccb7207180666e6121f4a2ce1bc50964ea684dd94cca9fe5a9155dd615f7d110 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True) 2024-09-21T13:58:26.849 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 21 13:58:26 smithi002 podman[148506]: 2024-09-21 13:58:26.621305292 +0000 UTC m=+0.513780864 container died ccb7207180666e6121f4a2ce1bc50964ea684dd94cca9fe5a9155dd615f7d110 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:58:27.188 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:27 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:27.011Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused" 2024-09-21T13:58:27.188 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:27 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:27.012Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused" 2024-09-21T13:58:27.188 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:27 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:27.012Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T13:58:27.216 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.2.service' 2024-09-21T13:58:27.260 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:58:27.260 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T13:58:27.260 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T13:58:27.260 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.3 2024-09-21T13:58:27.599 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:27 smithi002 systemd[1]: Stopping Ceph osd.3 for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:58:28.100 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:27 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3[62290]: 2024-09-21T13:58:27.601+0000 7fef82b51640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:58:28.100 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:27 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3[62290]: 2024-09-21T13:58:27.601+0000 7fef82b51640 -1 osd.3 766 *** Got signal Terminated *** 2024-09-21T13:58:28.100 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:27 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3[62290]: 2024-09-21T13:58:27.601+0000 7fef82b51640 -1 osd.3 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:58:28.469 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:58:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:58:27.997Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nfs msg="Unable to refresh target groups" err="Get \"http://172.21.15.2:8765/sd/prometheus/sd-config?service=nfs\": dial tcp 172.21.15.2:8765: connect: connection refused" 2024-09-21T13:58:28.469 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:58:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:58:27.999Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.2:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.2:8765: connect: connection refused" 2024-09-21T13:58:28.469 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:58:27 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:58:27.999Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.2:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.2:8765: connect: connection refused" 2024-09-21T13:58:28.469 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:58:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:58:28.002Z caller=refresh.go:90 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.2:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.2:8765: connect: connection refused" 2024-09-21T13:58:28.469 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:58:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:58:28.003Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.2:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.2:8765: connect: connection refused" 2024-09-21T13:58:28.469 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:58:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:58:28.003Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=smb msg="Unable to refresh target groups" err="Get \"http://172.21.15.2:8765/sd/prometheus/sd-config?service=smb\": dial tcp 172.21.15.2:8765: connect: connection refused" 2024-09-21T13:58:28.469 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:58:28 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:58:28.003Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.2:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.2:8765: connect: connection refused" 2024-09-21T13:58:29.734 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:29 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:29.568+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:30.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:30 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:30.688+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:30.983 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:30 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:30.534+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:31.729 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:31 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:31.325+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:31.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:31 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:31.485+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:31.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:31 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:31.729+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:32.599 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:32 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3[62290]: 2024-09-21T13:58:32.160+0000 7fef7b15e640 -1 osd.3 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.451634+0000 front 2024-09-21T13:58:08.451558+0000 (oldest deadline 2024-09-21T13:58:31.951750+0000) 2024-09-21T13:58:32.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:32 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:32.340+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:32.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:32 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:32.471+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:33.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:32 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:32.754+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:33.436 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:33 smithi002 podman[148632]: 2024-09-21 13:58:33.158335931 +0000 UTC m=+5.663322093 container died dcb35597a0d598e10648597d8b1b37512b2201faf4905a92091ea0414284d721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T13:58:33.725 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:33 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:33.494+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:33.726 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:33 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:33.327+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:33.849 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:33 smithi002 podman[148632]: 2024-09-21 13:58:33.651321819 +0000 UTC m=+6.156307980 container cleanup dcb35597a0d598e10648597d8b1b37512b2201faf4905a92091ea0414284d721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:58:33.849 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:33 smithi002 bash[148632]: ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3 2024-09-21T13:58:33.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:33 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:33.725+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:33.982 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:33 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:33.921+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:34.202 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:33 smithi002 podman[148653]: 2024-09-21 13:58:33.877529234 +0000 UTC m=+0.717880348 container remove dcb35597a0d598e10648597d8b1b37512b2201faf4905a92091ea0414284d721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T13:58:34.455 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:34 smithi002 podman[148747]: 2024-09-21 13:58:34.203284032 +0000 UTC m=+0.105467445 container create f423c4b8d4fa45d53eb12849ae25a0d25ffc9af6a58f4e7b53bfde33814556ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T13:58:34.456 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:34 smithi002 podman[148747]: 2024-09-21 13:58:34.11400048 +0000 UTC m=+0.016183906 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:58:34.456 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:34 smithi002 podman[148747]: 2024-09-21 13:58:34.455651039 +0000 UTC m=+0.357834460 container init f423c4b8d4fa45d53eb12849ae25a0d25ffc9af6a58f4e7b53bfde33814556ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T13:58:34.698 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:34 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:34.307+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:34.699 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:34 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:34.508+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:34.849 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:34 smithi002 podman[148747]: 2024-09-21 13:58:34.461677567 +0000 UTC m=+0.363860979 container start f423c4b8d4fa45d53eb12849ae25a0d25ffc9af6a58f4e7b53bfde33814556ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T13:58:34.850 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:34 smithi002 podman[148747]: 2024-09-21 13:58:34.555788055 +0000 UTC m=+0.457971473 container attach f423c4b8d4fa45d53eb12849ae25a0d25ffc9af6a58f4e7b53bfde33814556ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T13:58:34.850 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 21 13:58:34 smithi002 podman[148747]: 2024-09-21 13:58:34.670604984 +0000 UTC m=+0.572788406 container died f423c4b8d4fa45d53eb12849ae25a0d25ffc9af6a58f4e7b53bfde33814556ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T13:58:34.961 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:34 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:34.698+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:35.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:34 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:34.961+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:35.259 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.3.service' 2024-09-21T13:58:35.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:58:35.301 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T13:58:35.301 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T13:58:35.301 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.4 2024-09-21T13:58:35.617 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:35 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:35.292+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:35.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:35 smithi162 systemd[1]: Stopping Ceph osd.4 for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:58:35.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:35 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:35.534+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:35.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:35 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:35.616+0000 7fddfd983640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:58:35.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:35 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:35.616+0000 7fddfd983640 -1 osd.4 766 *** Got signal Terminated *** 2024-09-21T13:58:35.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:35 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:35.616+0000 7fddfd983640 -1 osd.4 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:58:35.978 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:35 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:35.657+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:36.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:35 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:35.978+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:36.666 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:36 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:36.327+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:36.666 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:36 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:36.488+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:36.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:36 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:36.665+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:37.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:37.012Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T13:58:37.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:37.012Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused" 2024-09-21T13:58:37.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:37 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:37.013Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T13:58:37.371 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:36 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:36.983+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:37.675 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:37 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:37.535+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:37.675 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:37 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:37.371+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:37.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:37 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:37.675+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:38.363 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:38.017+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:38.721 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:38.363+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:38.721 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:38.506+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:38.721 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:38.506+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.802066+0000 front 2024-09-21T13:58:13.802148+0000 (oldest deadline 2024-09-21T13:58:38.502073+0000) 2024-09-21T13:58:38.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:38.720+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:39.371 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:39.016+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:39.685 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:39.371+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:39.685 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:39.460+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:39.685 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:39.460+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.802066+0000 front 2024-09-21T13:58:13.802148+0000 (oldest deadline 2024-09-21T13:58:38.502073+0000) 2024-09-21T13:58:39.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:39.684+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:39.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:39.684+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:40.383 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:39 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:39.982+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:40.643 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:40 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:40.382+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:40.644 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:40 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:40.473+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:08.100782+0000 front 2024-09-21T13:58:08.100790+0000 (oldest deadline 2024-09-21T13:58:29.200778+0000) 2024-09-21T13:58:40.644 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:40 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4[37687]: 2024-09-21T13:58:40.473+0000 7fddf9f98640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.802066+0000 front 2024-09-21T13:58:13.802148+0000 (oldest deadline 2024-09-21T13:58:38.502073+0000) 2024-09-21T13:58:40.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:40 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:40.643+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:40.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:40 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:40.643+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:41.353 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:40 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:40.997+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:41.353 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:41 smithi162 podman[68461]: 2024-09-21 13:58:41.165851 +0000 UTC m=+5.659837296 container died 65cea776f4754abb50e72faeecbab6ec2838b18c707b218bdccb1b24bceb4653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:58:41.663 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:41 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:41.352+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:41.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:41 smithi162 podman[68461]: 2024-09-21 13:58:41.564723518 +0000 UTC m=+6.058709807 container cleanup 65cea776f4754abb50e72faeecbab6ec2838b18c707b218bdccb1b24bceb4653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:58:41.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:41 smithi162 bash[68461]: ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4 2024-09-21T13:58:41.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:41 smithi162 podman[68481]: 2024-09-21 13:58:41.796772112 +0000 UTC m=+0.624619569 container remove 65cea776f4754abb50e72faeecbab6ec2838b18c707b218bdccb1b24bceb4653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T13:58:41.961 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:41 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:41.662+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:41.961 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:41 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:41.662+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:42.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:41 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:41.960+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:42.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:41 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:41.960+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:42.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:42 smithi162 podman[68576]: 2024-09-21 13:58:42.03362577 +0000 UTC m=+0.016526796 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:58:42.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:42 smithi162 podman[68576]: 2024-09-21 13:58:42.130984926 +0000 UTC m=+0.113885949 container create c3b196cd6f17041c9e6b0e2825d651a9b9d71dde3bba133c3311075ce715b93e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T13:58:42.601 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:42 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:42.309+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:42.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:42 smithi162 podman[68576]: 2024-09-21 13:58:42.400232939 +0000 UTC m=+0.383133966 container init c3b196cd6f17041c9e6b0e2825d651a9b9d71dde3bba133c3311075ce715b93e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T13:58:42.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:42 smithi162 podman[68576]: 2024-09-21 13:58:42.40514438 +0000 UTC m=+0.388045405 container start c3b196cd6f17041c9e6b0e2825d651a9b9d71dde3bba133c3311075ce715b93e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T13:58:42.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:42 smithi162 podman[68576]: 2024-09-21 13:58:42.491890689 +0000 UTC m=+0.474791717 container attach c3b196cd6f17041c9e6b0e2825d651a9b9d71dde3bba133c3311075ce715b93e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4-deactivate, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T13:58:42.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 13:58:42 smithi162 podman[68576]: 2024-09-21 13:58:42.601936704 +0000 UTC m=+0.584837737 container died c3b196cd6f17041c9e6b0e2825d651a9b9d71dde3bba133c3311075ce715b93e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:58:42.924 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:42 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:42.703+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:42.924 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:42 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:42.703+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:43.195 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:42 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:42.924+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:43.195 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:42 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:42.924+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:43.213 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.4.service' 2024-09-21T13:58:43.254 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:58:43.255 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T13:58:43.255 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T13:58:43.255 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.5 2024-09-21T13:58:43.482 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:43 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:43.290+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:43.482 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:43 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:43.290+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.353152+0000 front 2024-09-21T13:58:15.353129+0000 (oldest deadline 2024-09-21T13:58:42.353684+0000) 2024-09-21T13:58:43.482 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:43 smithi162 systemd[1]: Stopping Ceph osd.5 for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:58:43.891 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:43 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:43.742+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:43.891 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:43 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:43.742+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:43.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:43 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:43.575+0000 7fc0f2e18640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:58:43.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:43 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:43.575+0000 7fc0f2e18640 -1 osd.5 766 *** Got signal Terminated *** 2024-09-21T13:58:43.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:43 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:43.575+0000 7fc0f2e18640 -1 osd.5 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:58:44.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:43 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:43.891+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:44.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:43 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:43.891+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:44.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:44 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:44.325+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:44.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:44 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:44.325+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.353152+0000 front 2024-09-21T13:58:15.353129+0000 (oldest deadline 2024-09-21T13:58:42.353684+0000) 2024-09-21T13:58:45.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:44 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:44.858+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:45.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:44 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:44.858+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:45.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:44 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:44.767+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:45.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:44 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:44.767+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:45.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:45 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:45.280+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:45.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:45 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:45.280+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.353152+0000 front 2024-09-21T13:58:15.353129+0000 (oldest deadline 2024-09-21T13:58:42.353684+0000) 2024-09-21T13:58:46.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:45 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:45.798+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:46.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:45 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:45.798+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:46.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:45 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:45.855+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:46.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:45 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:45.856+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:46.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:46 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:46.257+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:46.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:46 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:46.257+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.353152+0000 front 2024-09-21T13:58:15.353129+0000 (oldest deadline 2024-09-21T13:58:42.353684+0000) 2024-09-21T13:58:47.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:46 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:46.791+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:47.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:46 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:46.791+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:47.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:46 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:46.855+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:47.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:46 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:46.855+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:47.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:46 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:46.855+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:47.349 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:47 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:47.013Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused" 2024-09-21T13:58:47.349 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:47 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:47.013Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused" 2024-09-21T13:58:47.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:47 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:47.014Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T13:58:47.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:47 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:47.283+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:47.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:47 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:47.283+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.353152+0000 front 2024-09-21T13:58:15.353129+0000 (oldest deadline 2024-09-21T13:58:42.353684+0000) 2024-09-21T13:58:47.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:47 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:47.283+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:22.854653+0000 front 2024-09-21T13:58:22.854607+0000 (oldest deadline 2024-09-21T13:58:46.954485+0000) 2024-09-21T13:58:48.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:47 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:47.798+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:48.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:47 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:47.798+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:48.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:47 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:47.867+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:48.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:47 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:47.867+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:48.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:47 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:47.867+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:48.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:48.303+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:03.051887+0000 front 2024-09-21T13:58:03.051801+0000 (oldest deadline 2024-09-21T13:58:30.652298+0000) 2024-09-21T13:58:48.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:48.303+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.353152+0000 front 2024-09-21T13:58:15.353129+0000 (oldest deadline 2024-09-21T13:58:42.353684+0000) 2024-09-21T13:58:48.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5[43401]: 2024-09-21T13:58:48.303+0000 7fc0eb425640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:22.854653+0000 front 2024-09-21T13:58:22.854607+0000 (oldest deadline 2024-09-21T13:58:46.954485+0000) 2024-09-21T13:58:49.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:48.758+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:49.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:48.758+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:49.233 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:48 smithi162 podman[68703]: 2024-09-21 13:58:48.930492559 +0000 UTC m=+5.450289169 container died 9977feafa3216e850d7cfa783d27b44a85b921e5e59ec95c0698e80f869f1b76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731) 2024-09-21T13:58:49.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:48.877+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:49.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:48.877+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:49.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:48 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:48.877+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:49.599 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:49 smithi162 podman[68703]: 2024-09-21 13:58:49.306321697 +0000 UTC m=+5.826118303 container cleanup 9977feafa3216e850d7cfa783d27b44a85b921e5e59ec95c0698e80f869f1b76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T13:58:49.599 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:49 smithi162 bash[68703]: ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5 2024-09-21T13:58:49.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:49 smithi162 podman[68724]: 2024-09-21 13:58:49.599562297 +0000 UTC m=+0.661367208 container remove 9977feafa3216e850d7cfa783d27b44a85b921e5e59ec95c0698e80f869f1b76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T13:58:49.891 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:49.732+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:49.892 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:49.732+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:50.219 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:49.891+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:50.219 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:49.891+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:50.219 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:49 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:49.891+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:50.220 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:49 smithi162 podman[68815]: 2024-09-21 13:58:49.814630667 +0000 UTC m=+0.016171928 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:58:50.220 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:49 smithi162 podman[68815]: 2024-09-21 13:58:49.934020542 +0000 UTC m=+0.135561793 container create 5813ebe8487818801aecf1e441265955a24e44436a13ccee10208177121d097e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T13:58:50.220 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:50 smithi162 podman[68815]: 2024-09-21 13:58:50.136591019 +0000 UTC m=+0.338132278 container init 5813ebe8487818801aecf1e441265955a24e44436a13ccee10208177121d097e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T13:58:50.220 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:50 smithi162 podman[68815]: 2024-09-21 13:58:50.141401552 +0000 UTC m=+0.342942805 container start 5813ebe8487818801aecf1e441265955a24e44436a13ccee10208177121d097e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T13:58:50.220 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:50 smithi162 podman[68815]: 2024-09-21 13:58:50.219783743 +0000 UTC m=+0.421325002 container attach 5813ebe8487818801aecf1e441265955a24e44436a13ccee10208177121d097e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T13:58:50.482 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 13:58:50 smithi162 podman[68815]: 2024-09-21 13:58:50.325041811 +0000 UTC m=+0.526583074 container died 5813ebe8487818801aecf1e441265955a24e44436a13ccee10208177121d097e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T13:58:50.873 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:50 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:50.754+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:50.873 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:50 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:50.754+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:50.873 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:50 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:50.754+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:19.554614+0000 front 2024-09-21T13:58:19.554676+0000 (oldest deadline 2024-09-21T13:58:50.155229+0000) 2024-09-21T13:58:50.896 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.5.service' 2024-09-21T13:58:50.935 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:58:50.935 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T13:58:50.935 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T13:58:50.935 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.6 2024-09-21T13:58:51.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:51 smithi162 systemd[1]: Stopping Ceph osd.6 for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:58:51.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:50 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:50.889+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:51.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:50 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:50.889+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:51.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:50 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:50.889+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:51.723 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:51 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:51.272+0000 7f5ab6345640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:58:51.723 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:51 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:51.272+0000 7f5ab6345640 -1 osd.6 766 *** Got signal Terminated *** 2024-09-21T13:58:51.723 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:51 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:51.272+0000 7f5ab6345640 -1 osd.6 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:58:51.723 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:51 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:51.722+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:51.723 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:51 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:51.722+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:51.724 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:51 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:51.722+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:19.554614+0000 front 2024-09-21T13:58:19.554676+0000 (oldest deadline 2024-09-21T13:58:50.155229+0000) 2024-09-21T13:58:51.982 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:51 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:51.886+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:51.982 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:51 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:51.886+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:51.982 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:51 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:51.886+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:53.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:52 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:52.758+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:53.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:52 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:52.758+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:53.232 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:52 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:52.758+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:19.554614+0000 front 2024-09-21T13:58:19.554676+0000 (oldest deadline 2024-09-21T13:58:50.155229+0000) 2024-09-21T13:58:53.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:52 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:52.879+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:53.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:52 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:52.879+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:53.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:52 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:52.879+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:53.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:53 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:53.716+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:53.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:53 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:53.716+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:53.982 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:53 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:53.716+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:19.554614+0000 front 2024-09-21T13:58:19.554676+0000 (oldest deadline 2024-09-21T13:58:50.155229+0000) 2024-09-21T13:58:53.983 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:53 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:53.860+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:53.983 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:53 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:53.860+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:53.983 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:53 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:53.860+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:54.982 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:54 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:54.882+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:54.982 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:54 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:54.882+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:54.982 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:54 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:54.882+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:54.983 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:54 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:54.685+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:54.983 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:54 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:54.685+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:54.983 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:54 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:54.685+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:19.554614+0000 front 2024-09-21T13:58:19.554676+0000 (oldest deadline 2024-09-21T13:58:50.155229+0000) 2024-09-21T13:58:55.910 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:55 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:55.653+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:05.553131+0000 front 2024-09-21T13:58:05.553070+0000 (oldest deadline 2024-09-21T13:58:29.652897+0000) 2024-09-21T13:58:55.910 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:55 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:55.653+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:13.654902+0000 front 2024-09-21T13:58:13.654973+0000 (oldest deadline 2024-09-21T13:58:39.554269+0000) 2024-09-21T13:58:55.910 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:55 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:55.653+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:19.554614+0000 front 2024-09-21T13:58:19.554676+0000 (oldest deadline 2024-09-21T13:58:50.155229+0000) 2024-09-21T13:58:55.910 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:55 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6[49371]: 2024-09-21T13:58:55.653+0000 7f5ab295a640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.2:6815 osd.3 since back 2024-09-21T13:58:30.155622+0000 front 2024-09-21T13:58:30.155646+0000 (oldest deadline 2024-09-21T13:58:55.455542+0000) 2024-09-21T13:58:56.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:55 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:55.909+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:56.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:55 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:55.909+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:56.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:55 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:55.909+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:56.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:55 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:55.910+0000 7f6c8a0b0640 -1 osd.7 766 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24439.0:1155 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e766) 2024-09-21T13:58:57.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:56 smithi162 podman[68941]: 2024-09-21 13:58:56.803101458 +0000 UTC m=+5.645858455 container died af20fe6219384ceb4b41b5ffdf880d0f678cfc3d39200b8f1a14feb99da82d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T13:58:57.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:56 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:56.896+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:57.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:56 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:56.896+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:57.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:56 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:56.896+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:57.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:56 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:56.896+0000 7f6c8a0b0640 -1 osd.7 766 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24439.0:1155 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e766) 2024-09-21T13:58:57.349 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:57 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:57.014Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused" 2024-09-21T13:58:57.349 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:57 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:57.014Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused" 2024-09-21T13:58:57.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:58:57 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:58:57.015Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T13:58:57.435 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:57 smithi162 podman[68941]: 2024-09-21 13:58:57.218084785 +0000 UTC m=+6.060841782 container cleanup af20fe6219384ceb4b41b5ffdf880d0f678cfc3d39200b8f1a14feb99da82d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T13:58:57.435 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:57 smithi162 bash[68941]: ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6 2024-09-21T13:58:57.732 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:57 smithi162 podman[68962]: 2024-09-21 13:58:57.435834877 +0000 UTC m=+0.627465244 container remove af20fe6219384ceb4b41b5ffdf880d0f678cfc3d39200b8f1a14feb99da82d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T13:58:58.097 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:57 smithi162 podman[69056]: 2024-09-21 13:58:57.738979262 +0000 UTC m=+0.016852823 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:58:58.097 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:57 smithi162 podman[69056]: 2024-09-21 13:58:57.869941934 +0000 UTC m=+0.147815537 container create f596fc0337d490efbc06d6d24b0b792ccfcd90816ce7b0fcb319b5c053b003a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:58:58.097 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:58 smithi162 podman[69056]: 2024-09-21 13:58:58.097318788 +0000 UTC m=+0.375192346 container init f596fc0337d490efbc06d6d24b0b792ccfcd90816ce7b0fcb319b5c053b003a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T13:58:58.097 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:57 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:57.901+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:58.097 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:57 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:57.901+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:58.097 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:57 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:57.901+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:58.098 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:57 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:57.901+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6815 osd.3 since back 2024-09-21T13:58:32.422940+0000 front 2024-09-21T13:58:32.422914+0000 (oldest deadline 2024-09-21T13:58:57.722729+0000) 2024-09-21T13:58:58.098 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:57 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:57.901+0000 7f6c8a0b0640 -1 osd.7 766 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24439.0:1155 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e766) 2024-09-21T13:58:58.482 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:58 smithi162 podman[69056]: 2024-09-21 13:58:58.102572246 +0000 UTC m=+0.380445812 container start f596fc0337d490efbc06d6d24b0b792ccfcd90816ce7b0fcb319b5c053b003a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T13:58:58.483 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:58 smithi162 podman[69056]: 2024-09-21 13:58:58.205713865 +0000 UTC m=+0.483587443 container attach f596fc0337d490efbc06d6d24b0b792ccfcd90816ce7b0fcb319b5c053b003a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T13:58:58.483 INFO:journalctl@ceph.osd.6.smithi162.stdout:Sep 21 13:58:58 smithi162 podman[69056]: 2024-09-21 13:58:58.286141917 +0000 UTC m=+0.564015476 container died f596fc0337d490efbc06d6d24b0b792ccfcd90816ce7b0fcb319b5c053b003a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-6-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:58:58.846 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.6.service' 2024-09-21T13:58:58.884 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:58:58.884 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T13:58:58.884 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T13:58:58.884 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.7 2024-09-21T13:58:59.206 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:58.946+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:58:59.207 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:58.946+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:58:59.207 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:58.946+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:58:59.207 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:58.946+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6815 osd.3 since back 2024-09-21T13:58:32.422940+0000 front 2024-09-21T13:58:32.422914+0000 (oldest deadline 2024-09-21T13:58:57.722729+0000) 2024-09-21T13:58:59.207 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:58 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:58.946+0000 7f6c8a0b0640 -1 osd.7 766 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24439.0:1155 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e766) 2024-09-21T13:58:59.207 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:58 smithi162 systemd[1]: Stopping Ceph osd.7 for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:58:59.207 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:59.204+0000 7f6c91aa3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:58:59.207 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:59.204+0000 7f6c91aa3640 -1 osd.7 766 *** Got signal Terminated *** 2024-09-21T13:58:59.207 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:59.204+0000 7f6c91aa3640 -1 osd.7 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:59:00.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:59.961+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:59:00.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:59.961+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:59:00.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:59.961+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:59:00.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:59.961+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6815 osd.3 since back 2024-09-21T13:58:32.422940+0000 front 2024-09-21T13:58:32.422914+0000 (oldest deadline 2024-09-21T13:58:57.722729+0000) 2024-09-21T13:59:00.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:58:59 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:58:59.961+0000 7f6c8a0b0640 -1 osd.7 766 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24439.0:1155 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e766) 2024-09-21T13:59:01.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:00 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:00.947+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:59:01.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:00 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:00.947+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:59:01.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:00 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:00.947+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:59:01.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:00 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:00.947+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6815 osd.3 since back 2024-09-21T13:58:32.422940+0000 front 2024-09-21T13:58:32.422914+0000 (oldest deadline 2024-09-21T13:58:57.722729+0000) 2024-09-21T13:59:01.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:00 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:00.948+0000 7f6c8a0b0640 -1 osd.7 766 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24439.0:1155 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e766) 2024-09-21T13:59:02.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:01 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:01.908+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:59:02.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:01 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:01.908+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:59:02.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:01 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:01.908+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:59:02.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:01 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:01.908+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6815 osd.3 since back 2024-09-21T13:58:32.422940+0000 front 2024-09-21T13:58:32.422914+0000 (oldest deadline 2024-09-21T13:58:57.722729+0000) 2024-09-21T13:59:02.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:01 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:01.908+0000 7f6c8a0b0640 -1 osd.7 766 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24439.0:1155 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e766) 2024-09-21T13:59:03.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:02 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:02.896+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:59:03.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:02 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:02.896+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:59:03.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:02 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:02.896+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:59:03.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:02 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:02.896+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6815 osd.3 since back 2024-09-21T13:58:32.422940+0000 front 2024-09-21T13:58:32.422914+0000 (oldest deadline 2024-09-21T13:58:57.722729+0000) 2024-09-21T13:59:03.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:02 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:02.896+0000 7f6c8a0b0640 -1 osd.7 766 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24439.0:1155 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e766) 2024-09-21T13:59:04.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:03.866+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6803 osd.0 since back 2024-09-21T13:58:07.720741+0000 front 2024-09-21T13:58:07.720702+0000 (oldest deadline 2024-09-21T13:58:33.620771+0000) 2024-09-21T13:59:04.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:03.866+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6807 osd.1 since back 2024-09-21T13:58:15.921655+0000 front 2024-09-21T13:58:15.921734+0000 (oldest deadline 2024-09-21T13:58:41.821590+0000) 2024-09-21T13:59:04.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:03.866+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6811 osd.2 since back 2024-09-21T13:58:21.822117+0000 front 2024-09-21T13:58:21.822019+0000 (oldest deadline 2024-09-21T13:58:46.522028+0000) 2024-09-21T13:59:04.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:03.866+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.2:6815 osd.3 since back 2024-09-21T13:58:32.422940+0000 front 2024-09-21T13:58:32.422914+0000 (oldest deadline 2024-09-21T13:58:57.722729+0000) 2024-09-21T13:59:04.232 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:03.866+0000 7f6c8a0b0640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.162:6802 osd.4 since back 2024-09-21T13:58:37.723186+0000 front 2024-09-21T13:58:37.723125+0000 (oldest deadline 2024-09-21T13:59:03.623148+0000) 2024-09-21T13:59:04.233 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:03 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7[55612]: 2024-09-21T13:59:03.866+0000 7f6c8a0b0640 -1 osd.7 766 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24439.0:1155 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e766) 2024-09-21T13:59:04.996 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:04 smithi162 podman[69182]: 2024-09-21 13:59:04.744677231 +0000 UTC m=+5.639516106 container died eb085ddd5236a971bccf6e5a1c04be4d5b2300387439c1367e5ee1b64b1b6166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T13:59:05.395 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:05 smithi162 podman[69182]: 2024-09-21 13:59:05.094819498 +0000 UTC m=+5.989658372 container cleanup eb085ddd5236a971bccf6e5a1c04be4d5b2300387439c1367e5ee1b64b1b6166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD) 2024-09-21T13:59:05.396 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:05 smithi162 bash[69182]: ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7 2024-09-21T13:59:05.732 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:05 smithi162 podman[69215]: 2024-09-21 13:59:05.395978937 +0000 UTC m=+0.648294097 container remove eb085ddd5236a971bccf6e5a1c04be4d5b2300387439c1367e5ee1b64b1b6166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:59:06.015 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:05 smithi162 podman[69309]: 2024-09-21 13:59:05.738327139 +0000 UTC m=+0.091934126 container create c3ef2c038a10fcbff86b7a6d1c18528e52941907532e337bd9c16478542f4d33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:59:06.015 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:05 smithi162 podman[69309]: 2024-09-21 13:59:05.662294988 +0000 UTC m=+0.015901991 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:59:06.016 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:05 smithi162 podman[69309]: 2024-09-21 13:59:05.932649245 +0000 UTC m=+0.286256250 container init c3ef2c038a10fcbff86b7a6d1c18528e52941907532e337bd9c16478542f4d33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:59:06.016 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:05 smithi162 podman[69309]: 2024-09-21 13:59:05.93773423 +0000 UTC m=+0.291341218 container start c3ef2c038a10fcbff86b7a6d1c18528e52941907532e337bd9c16478542f4d33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-21T13:59:06.016 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:06 smithi162 podman[69309]: 2024-09-21 13:59:06.015802739 +0000 UTC m=+0.369409741 container attach c3ef2c038a10fcbff86b7a6d1c18528e52941907532e337bd9c16478542f4d33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T13:59:06.411 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 13:59:06 smithi162 podman[69309]: 2024-09-21 13:59:06.122116926 +0000 UTC m=+0.475723914 container died c3ef2c038a10fcbff86b7a6d1c18528e52941907532e337bd9c16478542f4d33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T13:59:06.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@osd.7.service' 2024-09-21T13:59:06.755 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:59:06.755 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T13:59:06.755 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-09-21T13:59:06.755 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@rgw.foo.a 2024-09-21T13:59:07.061 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:59:06 smithi002 systemd[1]: Stopping Ceph rgw.foo.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:59:07.061 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:59:07.014Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T13:59:07.061 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:59:07.015Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused" 2024-09-21T13:59:07.061 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:59:07.015Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T13:59:07.349 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:59:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-rgw-foo-a[66867]: 2024-09-21T13:59:07.059+0000 7f3fe0aec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:59:07.349 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:59:07 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-rgw-foo-a[66867]: 2024-09-21T13:59:07.060+0000 7f3fe4358880 -1 shutting down 2024-09-21T13:59:17.350 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:59:17 smithi002 bash[148886]: time="2024-09-21T13:59:17Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-e6144070-781d-11ef-baf6-efdc52797490-rgw-foo-a in 10 seconds, resorting to SIGKILL" 2024-09-21T13:59:17.350 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:59:17 smithi002 podman[148886]: 2024-09-21 13:59:17.096900144 +0000 UTC m=+10.139697442 container died 89bb81dd660f72d8d0e2a410979b9c000ed9f4431a9819dd77a17a5c692c63bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-rgw-foo-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:59:17.350 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:17 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:59:17.014Z caller=dispatch.go:353 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused" 2024-09-21T13:59:17.351 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:17 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:59:17.015Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.2:8443: connect: connection refused" 2024-09-21T13:59:17.351 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:17 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:59:17.015Z caller=notify.go:848 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] aggrGroup="{}/{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-09-21T13:59:17.802 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:59:17 smithi002 podman[148886]: 2024-09-21 13:59:17.632006961 +0000 UTC m=+10.674804246 container cleanup 89bb81dd660f72d8d0e2a410979b9c000ed9f4431a9819dd77a17a5c692c63bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-rgw-foo-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:59:17.802 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:59:17 smithi002 bash[148886]: ceph-e6144070-781d-11ef-baf6-efdc52797490-rgw-foo-a 2024-09-21T13:59:17.802 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:59:17 smithi002 podman[148909]: 2024-09-21 13:59:17.799707569 +0000 UTC m=+0.699253490 container remove 89bb81dd660f72d8d0e2a410979b9c000ed9f4431a9819dd77a17a5c692c63bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-rgw-foo-a, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T13:59:17.802 INFO:journalctl@ceph.rgw.foo.a.smithi002.stdout:Sep 21 13:59:17 smithi002 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@rgw.foo.a.service: Main process exited, code=exited, status=137/n/a 2024-09-21T13:59:18.064 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@rgw.foo.a.service' 2024-09-21T13:59:18.101 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:59:18.101 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-09-21T13:59:18.101 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-09-21T13:59:18.101 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-e6144070-781d-11ef-baf6-efdc52797490@prometheus.a 2024-09-21T13:59:18.397 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 systemd[1]: Stopping Ceph prometheus.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:59:18.687 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.397Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.397Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..." 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.398Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..." 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.398Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.398Z caller=main.go:984 level=info msg="Scrape discovery manager stopped" 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.398Z caller=main.go:998 level=info msg="Notify discovery manager stopped" 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.398Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped" 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.398Z caller=main.go:1039 level=info msg="Stopping scrape manager..." 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.398Z caller=main.go:1031 level=info msg="Scrape manager stopped" 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.398Z caller=notifier.go:618 level=info component=notifier msg="Stopping notification manager..." 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.399Z caller=main.go:1261 level=info msg="Notifier manager stopped" 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a[64778]: ts=2024-09-21T13:59:18.399Z caller=main.go:1273 level=info msg="See you next time!" 2024-09-21T13:59:18.688 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 podman[69437]: 2024-09-21 13:59:18.408038809 +0000 UTC m=+0.112177369 container died fdb2bf917df5bcb52d50133af640a6ab19325ab9d1817636d9734eef353b11b3 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T13:59:18.982 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 podman[69437]: 2024-09-21 13:59:18.786983745 +0000 UTC m=+0.491122301 container cleanup fdb2bf917df5bcb52d50133af640a6ab19325ab9d1817636d9734eef353b11b3 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-21T13:59:18.982 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Sep 21 13:59:18 smithi162 bash[69437]: ceph-e6144070-781d-11ef-baf6-efdc52797490-prometheus-a 2024-09-21T13:59:19.166 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e6144070-781d-11ef-baf6-efdc52797490@prometheus.a.service' 2024-09-21T13:59:19.202 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:59:19.203 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-09-21T13:59:19.203 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm rm-cluster --fsid e6144070-781d-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T13:59:19.415 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:59:21.356 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:21 smithi002 systemd[1]: Stopping Ceph alertmanager.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:59:21.654 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:21 smithi002 ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a[75692]: ts=2024-09-21T13:59:21.356Z caller=main.go:542 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-21T13:59:21.654 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:21 smithi002 podman[149391]: 2024-09-21 13:59:21.397840365 +0000 UTC m=+0.148619174 container died deae1ea01a15fabc9dd7768b7b66f25dd6cb8d85f40c618fdc0742bc80fc8a13 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:59:21.971 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:21 smithi002 podman[149391]: 2024-09-21 13:59:21.746751887 +0000 UTC m=+0.497530701 container cleanup deae1ea01a15fabc9dd7768b7b66f25dd6cb8d85f40c618fdc0742bc80fc8a13 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:59:21.971 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:21 smithi002 bash[149391]: ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a 2024-09-21T13:59:21.971 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:21 smithi002 podman[149410]: 2024-09-21 13:59:21.904950834 +0000 UTC m=+0.501026343 container remove deae1ea01a15fabc9dd7768b7b66f25dd6cb8d85f40c618fdc0742bc80fc8a13 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-21T13:59:21.972 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:21 smithi002 podman[149410]: 2024-09-21 13:59:21.972262435 +0000 UTC m=+0.568337943 volume remove 2d0161523a32f563b1342d9b0e0bb38af26b3976f92adf2edc664548e1a1039c 2024-09-21T13:59:22.600 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:59:22 smithi002 systemd[1]: Stopping Ceph node-exporter.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:59:22.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:22 smithi002 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@alertmanager.a.service: Deactivated successfully. 2024-09-21T13:59:22.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:22 smithi002 systemd[1]: Stopped Ceph alertmanager.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:59:22.600 INFO:journalctl@ceph.alertmanager.a.smithi002.stdout:Sep 21 13:59:22 smithi002 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@alertmanager.a.service: Consumed 1.917s CPU time. 2024-09-21T13:59:23.099 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:59:22 smithi002 podman[149528]: 2024-09-21 13:59:22.83819437 +0000 UTC m=+0.257155265 container died 533e8164e573b5badd9c18d9b64b59d6caf0cfa2beb292afa2f375775ef243a0 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T13:59:23.450 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:59:23 smithi002 podman[149528]: 2024-09-21 13:59:23.183040602 +0000 UTC m=+0.602001484 container cleanup 533e8164e573b5badd9c18d9b64b59d6caf0cfa2beb292afa2f375775ef243a0 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T13:59:23.450 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:59:23 smithi002 bash[149528]: ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a 2024-09-21T13:59:23.745 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:59:23 smithi002 podman[149545]: 2024-09-21 13:59:23.450726201 +0000 UTC m=+0.612424777 container remove 533e8164e573b5badd9c18d9b64b59d6caf0cfa2beb292afa2f375775ef243a0 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-21T13:59:23.745 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:59:23 smithi002 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-21T13:59:23.746 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:59:23 smithi002 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-21T13:59:23.746 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:59:23 smithi002 systemd[1]: Stopped Ceph node-exporter.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:59:23.746 INFO:journalctl@ceph.node-exporter.a.smithi002.stdout:Sep 21 13:59:23 smithi002 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@node-exporter.a.service: Consumed 3.948s CPU time. 2024-09-21T13:59:24.244 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm rm-cluster --fsid e6144070-781d-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T13:59:24.445 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:59:25.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:59:25 smithi162 systemd[1]: Stopping Ceph iscsi.iscsi.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:59:25.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:59:25 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a[60877]: debug Shutdown received 2024-09-21T13:59:36.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:59:35 smithi162 bash[69859]: time="2024-09-21T13:59:35Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a in 10 seconds, resorting to SIGKILL" 2024-09-21T13:59:36.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:59:35 smithi162 podman[69859]: 2024-09-21 13:59:35.980801578 +0000 UTC m=+10.120718401 container died 83f1cb6134cb6130a83766722d2282ea194183e3f5470ecc4eba9aa125d310f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:59:36.606 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:59:36 smithi162 podman[69859]: 2024-09-21 13:59:36.389114159 +0000 UTC m=+10.529030981 container cleanup 83f1cb6134cb6130a83766722d2282ea194183e3f5470ecc4eba9aa125d310f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T13:59:36.606 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:59:36 smithi162 bash[69859]: ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a 2024-09-21T13:59:36.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:59:36 smithi162 podman[69883]: 2024-09-21 13:59:36.606855497 +0000 UTC m=+0.626126444 container remove 83f1cb6134cb6130a83766722d2282ea194183e3f5470ecc4eba9aa125d310f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-iscsi-iscsi-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True) 2024-09-21T13:59:36.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:59:36 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-09-21T13:59:36.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:59:36 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-09-21T13:59:36.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:59:36 smithi162 systemd[1]: Stopped Ceph iscsi.iscsi.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:59:36.983 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Sep 21 13:59:36 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@iscsi.iscsi.a.service: Consumed 2.775s CPU time. 2024-09-21T13:59:38.388 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:38 smithi162 systemd[1]: Stopping Ceph grafana.a for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:59:38.700 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=server t=2024-09-21T13:59:38.41933696Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-09-21T13:59:38.700 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=ticker t=2024-09-21T13:59:38.419719213Z level=info msg=stopped last_tick=2024-09-21T13:59:30Z 2024-09-21T13:59:38.700 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=tracing t=2024-09-21T13:59:38.419728745Z level=info msg="Closing tracing" 2024-09-21T13:59:38.700 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:38 smithi162 ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a[63498]: logger=grafana-apiserver t=2024-09-21T13:59:38.419773496Z level=info msg="StorageObjectCountTracker pruner is exiting" 2024-09-21T13:59:38.700 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:38 smithi162 podman[70163]: 2024-09-21 13:59:38.429852805 +0000 UTC m=+0.124503682 container died d6ab1261f5be4517d06d5e97a48787c9875fbd72cabf1fc15e8451ea3d5ce5a1 (image=quay.io/ceph/grafana:10.4.8, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T13:59:38.982 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:38 smithi162 podman[70163]: 2024-09-21 13:59:38.790773773 +0000 UTC m=+0.485424654 container cleanup d6ab1261f5be4517d06d5e97a48787c9875fbd72cabf1fc15e8451ea3d5ce5a1 (image=quay.io/ceph/grafana:10.4.8, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T13:59:38.982 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:38 smithi162 bash[70163]: ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a 2024-09-21T13:59:39.377 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:39 smithi162 podman[70180]: 2024-09-21 13:59:39.025117583 +0000 UTC m=+0.595862458 container remove d6ab1261f5be4517d06d5e97a48787c9875fbd72cabf1fc15e8451ea3d5ce5a1 (image=quay.io/ceph/grafana:10.4.8, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-grafana-a, maintainer=Grafana Labs ) 2024-09-21T13:59:39.377 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:39 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@grafana.a.service: Deactivated successfully. 2024-09-21T13:59:39.377 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:39 smithi162 systemd[1]: Stopped Ceph grafana.a for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:59:39.378 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Sep 21 13:59:39 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@grafana.a.service: Consumed 13.204s CPU time. 2024-09-21T13:59:39.640 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:59:39 smithi162 systemd[1]: Stopping Ceph node-exporter.b for e6144070-781d-11ef-baf6-efdc52797490... 2024-09-21T13:59:39.937 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:59:39 smithi162 podman[70311]: 2024-09-21 13:59:39.64130633 +0000 UTC m=+0.121663350 container died 675cc8bbfb2cbc15ccc9b4c08affe8314540efc432c766bcebedfd03355a9e0e (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T13:59:40.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:59:40 smithi162 podman[70311]: 2024-09-21 13:59:40.028635859 +0000 UTC m=+0.508992879 container cleanup 675cc8bbfb2cbc15ccc9b4c08affe8314540efc432c766bcebedfd03355a9e0e (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T13:59:40.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:59:40 smithi162 bash[70311]: ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b 2024-09-21T13:59:40.552 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:59:40 smithi162 podman[70329]: 2024-09-21 13:59:40.279666155 +0000 UTC m=+0.638983597 container remove 675cc8bbfb2cbc15ccc9b4c08affe8314540efc432c766bcebedfd03355a9e0e (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-e6144070-781d-11ef-baf6-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-21T13:59:40.552 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:59:40 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-21T13:59:40.552 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:59:40 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-21T13:59:40.553 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:59:40 smithi162 systemd[1]: Stopped Ceph node-exporter.b for e6144070-781d-11ef-baf6-efdc52797490. 2024-09-21T13:59:40.553 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Sep 21 13:59:40 smithi162 systemd[1]: ceph-e6144070-781d-11ef-baf6-efdc52797490@node-exporter.b.service: Consumed 3.626s CPU time. 2024-09-21T13:59:41.075 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T13:59:41.109 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T13:59:41.136 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T13:59:41.138 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7914021/remote/smithi002/crash 2024-09-21T13:59:41.138 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/crash -- . 2024-09-21T13:59:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T13:59:41.199 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2024-09-21T13:59:41.201 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7914021/remote/smithi162/crash 2024-09-21T13:59:41.202 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/crash -- . 2024-09-21T13:59:41.247 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/e6144070-781d-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T13:59:41.247 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2024-09-21T13:59:41.248 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T13:59:41.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v CEPHADM_STRAY_DAEMON | head -n 1 2024-09-21T13:59:41.281 INFO:tasks.cephadm:Compressing logs... 2024-09-21T13:59:41.282 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T13:59:41.324 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/tcmu-runner.log 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi162.stderr:: No such file or directory 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.7.log 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/tcmu-runner.log: 63.9% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/tcmu-runner.log.gz 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.7.log: --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.4.log 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.6.log 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.5.log 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.6.log: 79.8% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.0.log 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:: No such file or directory 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.1.log 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.0.log: /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mon.c.log 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.audit.log: /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mon.a.log 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.2.log 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mon.a.log: 89.1%gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mgr.y.log 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.log 2024-09-21T13:59:41.360 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.5.log: 92.4% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T13:59:41.360 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.log 2024-09-21T13:59:41.361 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mgr.x.log 2024-09-21T13:59:41.361 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mon.b.log 2024-09-21T13:59:41.362 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T13:59:41.362 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T13:59:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.2.log: /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-client.rgw.foo.a.log 2024-09-21T13:59:41.366 INFO:teuthology.orchestra.run.smithi162.stderr: 87.1% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T13:59:41.369 INFO:teuthology.orchestra.run.smithi162.stderr: 91.4% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T13:59:41.370 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.log: 91.3% 95.3% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T13:59:41.370 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T13:59:41.371 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.3.log 2024-09-21T13:59:41.371 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-client.rgw.foo.a.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T13:59:41.383 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.3.log: 92.8% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T13:59:41.385 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/cephadm.log: 91.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T13:59:41.406 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T13:59:41.412 INFO:teuthology.orchestra.run.smithi002.stderr: 93.9% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-client.rgw.foo.a.log.gz 2024-09-21T13:59:41.799 INFO:teuthology.orchestra.run.smithi002.stderr: 91.0% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T13:59:42.595 INFO:teuthology.orchestra.run.smithi002.stderr: 92.8% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mon.c.log.gz 2024-09-21T13:59:42.630 INFO:teuthology.orchestra.run.smithi162.stderr: 92.9% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mon.b.log.gz 2024-09-21T13:59:43.595 INFO:teuthology.orchestra.run.smithi002.stderr: 92.1% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-mon.a.log.gz 2024-09-21T13:59:47.411 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.6.log.gz 2024-09-21T13:59:47.880 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.7.log.gz 2024-09-21T13:59:47.962 INFO:teuthology.orchestra.run.smithi162.stderr: 94.0% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.4.log.gz 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi002.stderr: 93.9% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.0.log.gz 2024-09-21T13:59:48.229 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.5.log.gz 2024-09-21T13:59:48.231 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-21T13:59:48.231 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m6.893s 2024-09-21T13:59:48.232 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m26.418s 2024-09-21T13:59:48.232 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.953s 2024-09-21T13:59:48.391 INFO:teuthology.orchestra.run.smithi002.stderr: 93.9% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.1.log.gz 2024-09-21T13:59:48.615 INFO:teuthology.orchestra.run.smithi002.stderr: 93.9% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.2.log.gz 2024-09-21T13:59:49.719 INFO:teuthology.orchestra.run.smithi002.stderr: 94.0% -- replaced with /var/log/ceph/e6144070-781d-11ef-baf6-efdc52797490/ceph-osd.3.log.gz 2024-09-21T13:59:49.722 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-21T13:59:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m8.384s 2024-09-21T13:59:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m32.413s 2024-09-21T13:59:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m1.046s 2024-09-21T13:59:49.722 INFO:tasks.cephadm:Archiving logs... 2024-09-21T13:59:49.723 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7914021/remote/smithi002/log 2024-09-21T13:59:49.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T13:59:53.642 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7914021/remote/smithi162/log 2024-09-21T13:59:53.643 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T13:59:57.212 INFO:tasks.cephadm:Removing cluster... 2024-09-21T13:59:57.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo cephadm rm-cluster --fsid e6144070-781d-11ef-baf6-efdc52797490 --force 2024-09-21T13:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:59:57.734 DEBUG:teuthology.orchestra.run.smithi162:> sudo cephadm rm-cluster --fsid e6144070-781d-11ef-baf6-efdc52797490 --force 2024-09-21T13:59:57.937 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: e6144070-781d-11ef-baf6-efdc52797490 2024-09-21T13:59:58.223 INFO:tasks.cephadm:Teardown complete 2024-09-21T13:59:58.224 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T13:59:58.233 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T13:59:58.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T13:59:58.236 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T13:59:58.316 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T13:59:58.324 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T13:59:58.325 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T13:59:58.327 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T13:59:58.341 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-21T13:59:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-21T13:59:58.346 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T13:59:58.346 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-21T13:59:58.346 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +995us[ +992us] +/- 59ms 2024-09-21T13:59:58.346 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -2194us[-2194us] +/- 52ms 2024-09-21T13:59:58.346 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +1762us[+1762us] +/- 72ms 2024-09-21T13:59:58.346 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:59:58.347 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T13:59:58.347 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-21T13:59:58.348 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 +1006us[ +998us] +/- 59ms 2024-09-21T13:59:58.348 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -2171us[-2179us] +/- 52ms 2024-09-21T13:59:58.348 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +1774us[+1774us] +/- 72ms 2024-09-21T13:59:58.348 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:59:58.348 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T13:59:58.357 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T13:59:58.357 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T13:59:58.366 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T13:59:58.468 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T13:59:58.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T13:59:58.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:59:58.568 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T13:59:58.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:59:58.597 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T13:59:58.606 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T13:59:58.615 INFO:teuthology.task.internal:Duration was 2040.685079 seconds 2024-09-21T13:59:58.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T13:59:58.624 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T13:59:58.625 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T13:59:58.627 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T13:59:59.016 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T13:59:59.016 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-21T13:59:59.016 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T13:59:59.038 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T13:59:59.038 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T13:59:59.081 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T13:59:59.082 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T13:59:59.084 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T13:59:59.148 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T13:59:59.148 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T13:59:59.152 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T13:59:59.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T13:59:59.590 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T13:59:59.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T13:59:59.615 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T13:59:59.640 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T13:59:59.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T13:59:59.657 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T13:59:59.679 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-21T13:59:59.704 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-21T13:59:59.750 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T13:59:59.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:59:59.765 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T13:59:59.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:59:59.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T13:59:59.815 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T13:59:59.815 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7914021/remote/smithi002 2024-09-21T13:59:59.816 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T13:59:59.877 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7914021/remote/smithi162 2024-09-21T13:59:59.878 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T13:59:59.914 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T13:59:59.914 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T13:59:59.917 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T13:59:59.963 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T13:59:59.975 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T13:59:59.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T13:59:59.984 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T13:59:59.984 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T13:59:59.987 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T14:00:00.000 INFO:teuthology.orchestra.run.smithi002.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 13:59 /home/ubuntu/cephtest 2024-09-21T14:00:00.018 INFO:teuthology.orchestra.run.smithi162.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 13:59 /home/ubuntu/cephtest 2024-09-21T14:00:00.019 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T14:00:00.028 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T14:00:00.049 INFO:teuthology.run:Summary data: description: orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} duration: 2040.6850786209106 flavor: default owner: scheduled_gabrioux@teuthology success: true 2024-09-21T14:00:00.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T14:00:00.124 INFO:teuthology.run:pass